Jun 09 15:37:57.037545 ip-10-0-128-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 09 15:37:57.037557 ip-10-0-128-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 09 15:37:57.037564 ip-10-0-128-73 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 09 15:37:57.037712 ip-10-0-128-73 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 09 15:38:07.126952 ip-10-0-128-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 09 15:38:07.126970 ip-10-0-128-73 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f7b644e6d8cd4da5ae877d56e7fd345e --
Jun 09 15:40:44.991380 ip-10-0-128-73 systemd[1]: Starting Kubernetes Kubelet...
Jun 09 15:40:45.440153 ip-10-0-128-73 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 15:40:45.440153 ip-10-0-128-73 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 09 15:40:45.440153 ip-10-0-128-73 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 15:40:45.440153 ip-10-0-128-73 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 09 15:40:45.440153 ip-10-0-128-73 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 15:40:45.442446 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.442356    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 09 15:40:45.447192 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447176    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 15:40:45.447192 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447191    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447195    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447198    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447201    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447204    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447209    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447213    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447216    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447220    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447223    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447226    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447229    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447232    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447237    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447239    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447242    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447245    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447248    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447250    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447253    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 15:40:45.447256 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447256    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447259    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447262    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447265    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447268    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447272    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447276    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447280    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447283    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447286    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447288    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447291    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447293    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447296    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447298    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447303    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447307    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447310    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447313    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 15:40:45.447751 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447316    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447318    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447321    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447324    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447327    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447329    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447332    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447334    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447337    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447339    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447342    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447344    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447347    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447350    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447352    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447355    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447358    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447361    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447364    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447367    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 15:40:45.448242 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447369    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447372    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447375    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447377    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447380    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447383    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447385    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447388    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447390    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447393    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447396    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447400    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447403    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447405    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447408    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447411    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447413    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447416    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447419    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 15:40:45.448732 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447421    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447424    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447426    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447429    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447431    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447434    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447436    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447439    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447443    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447446    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447449    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447451    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447454    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447457    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447459    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447462    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447472    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447475    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447478    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.447480    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 15:40:45.449250 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448194    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448200    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448203    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448206    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448208    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448214    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448217    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448221    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448223    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448226    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448229    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448231    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448234    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448236    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448239    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448241    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448245    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448249    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448252    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 15:40:45.449727 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448255    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448258    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448261    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448264    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448266    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448269    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448272    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448275    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448277    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448280    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448283    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448285    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448289    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448293    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448297    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448300    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448304    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448307    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448310    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 15:40:45.450219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448318    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448322    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448325    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448327    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448331    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448336    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448340    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448343    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448346    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448349    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448351    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448354    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448357    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448359    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448363    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448366    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448368    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448372    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448374    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448377    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 15:40:45.450698 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448380    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448382    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448385    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448387    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448390    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448392    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448395    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448397    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448400    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448402    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448405    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448407    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448410    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448418    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448421    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448423    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448427    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448430    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448432    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448435    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 15:40:45.451210 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448438    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448440    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448443    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448446    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448449    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448451    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448460    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448463    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448466    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448468    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448471    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448473    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448476    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448478    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448481    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448484    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448486    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448489    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448491    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448494    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 15:40:45.451738 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448496    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448861    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448866    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448869    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448871    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448875    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448877    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448880    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448883    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448885    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448888    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448891    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448894    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448896    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448899    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448902    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448905    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448908    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448910    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 15:40:45.452258 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448913    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448916    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448919    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448922    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448924    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448927    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448929    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448932    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448934    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448937    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448940    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448942    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448944    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448947    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448950    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448952    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448955    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448959    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448963    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 15:40:45.452709 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448969    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448973    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448976    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448979    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448982    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448985    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.448988    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449008    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449012    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449018    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449022    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449025    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449028    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449030    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449033    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449036    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449038    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449041    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449044    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449046    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 15:40:45.453193 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449050    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449052    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449055    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449057    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449060    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449063    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449065    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449068    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449070    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449073    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449076    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449078    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449081    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449084    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449087    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449090    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449093    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449095    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449098    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449101    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 15:40:45.453676 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449103    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449106    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449109    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449111    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449114    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449117    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449119    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449122    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449124    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449130    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449133    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449136    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449139    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449143    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449146    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449149    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449151    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449154    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449157    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 15:40:45.454219 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449159    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449162    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449165    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449233    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449240    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449246    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449250    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449256    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449259    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449263    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449269    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449272    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449275    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449279    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449282    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449286    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449289    2576 flags.go:64] FLAG: --cgroup-root=""
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449291    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449294    2576 flags.go:64] FLAG: --client-ca-file=""
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449297    2576 flags.go:64] FLAG: --cloud-provider="external"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449300    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449305    2576 flags.go:64] FLAG: --cluster-domain=""
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449308    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449312    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 09 15:40:45.454680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449315    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449324    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449328    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449331    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449334    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449338    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449341    2576 flags.go:64] FLAG: --contention-profiling="false"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449344    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449347    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449350    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449353    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449357    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449361    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449364    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449367    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449370    2576 flags.go:64] FLAG: --enable-server="true"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449373    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449378    2576 flags.go:64] FLAG: --event-burst="100"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449381    2576 flags.go:64] FLAG: --event-qps="50"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449383    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449387    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449390    2576 flags.go:64] FLAG: --eviction-hard=""
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449394    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449396    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449399    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 09 15:40:45.455274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449402    2576 flags.go:64] FLAG: --eviction-soft=""
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449405    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449408    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449411    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449414    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449417    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449420    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449423    2576 flags.go:64] FLAG: --feature-gates=""
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449428    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449431    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449434    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449437    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449440    2576 flags.go:64] FLAG: --healthz-port="10248"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449443    2576 flags.go:64] FLAG: --help="false"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449446    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449449    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449452    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449455    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449459    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449463    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449466    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449469    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449472    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 09 15:40:45.455918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449475    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449478    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449482    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449485    2576 flags.go:64] FLAG: --kube-reserved=""
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449488    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449490    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449493    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449496    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449499    2576 flags.go:64] FLAG: --lock-file=""
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449502    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449505    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449508    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449513    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449516    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449519    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449522    2576 flags.go:64] FLAG: --logging-format="text"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449525    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449529    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449532    2576 flags.go:64] FLAG: --manifest-url=""
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449535    2576 flags.go:64] FLAG: --manifest-url-header=""
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449540    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449543    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449547    2576 flags.go:64] FLAG: --max-pods="110"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449550    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449553    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 09 15:40:45.456957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449556    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449559    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449564    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449567    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449570    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449577    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449580    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449583    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449586    2576 flags.go:64] FLAG: --pod-cidr=""
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449589    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449595    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449598    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449601    2576 flags.go:64] FLAG: --pods-per-core="0"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449604    2576 flags.go:64] FLAG: --port="10250"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449607    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449610    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00dc12652e42d167e"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449614    2576 flags.go:64] FLAG: --qos-reserved=""
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449617    2576 flags.go:64] FLAG: --read-only-port="10255"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449620    2576 flags.go:64] FLAG: --register-node="true"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449623    2576 flags.go:64] FLAG: --register-with-taints=""
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449626    2576 flags.go:64] FLAG: --registry-burst="10"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449629    2576 flags.go:64] FLAG: --registry-qps="5"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449632    2576 flags.go:64] FLAG: --reserved-cpus=""
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449635    2576 flags.go:64] FLAG: --reserved-memory=""
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449640    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 09 15:40:45.458178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449643    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449647    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449649    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449652    2576 flags.go:64] FLAG: --runonce="false"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449656    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449659    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449662    2576 flags.go:64] FLAG: --seccomp-default="false"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449665    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449668    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449671    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449675    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449678    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449681    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449684    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449687    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449690    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449693    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449696    2576 flags.go:64] FLAG: --system-cgroups=""
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449699    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449704    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449707    2576 flags.go:64] FLAG: --tls-cert-file=""
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449710    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449718    2576 flags.go:64] FLAG: --tls-min-version=""
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449721    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449723    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 09 15:40:45.459218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449726    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449729    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449732    2576 flags.go:64] FLAG: --v="2"
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449737    2576 flags.go:64] FLAG: --version="false"
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449741    2576 flags.go:64] FLAG: --vmodule=""
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449745    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.449749    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449896    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449900    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449903    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449906    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449909    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449912    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449915    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449918    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449921    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449923    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449929    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449932    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449935    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449937    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 15:40:45.459855 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449940    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449942    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449945    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449948    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449956    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449960    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449963    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449966    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449968    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449971    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449973    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449976    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449979    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449981    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449984    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.449987    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450009    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450016    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450019    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 15:40:45.460717 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450022    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450025    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450028    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450031    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450033    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450036    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450039    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450041    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450044    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450048    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450051    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450053    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450056    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450059    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450061    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450064    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450067    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450069    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450079    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450082    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 15:40:45.461563 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450084    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450087    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450090    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450094    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450097    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450100    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450103    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450106    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450109    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450111    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450115    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450118    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450121    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450123    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450126    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450128    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450131    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450134    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450137    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 15:40:45.462281 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450141    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450144    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450148    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450151    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450154    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450157    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450159    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450162    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450165    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450168    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450170    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450173    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450183    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450186    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450188    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450191    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450193    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450196    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450204    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450207    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 15:40:45.463112 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450209    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450212    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450215    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450218    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450221    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450224    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.450227    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.450737    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.458963    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.458982    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.460014    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.460028    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460131    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460139    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460145    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 15:40:45.463844 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460152    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460157    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460163    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460168    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460173    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460178    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460183    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460188    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460193    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460199    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460204    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460209    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460213    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460218    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460223    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460227    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460232    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460237    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460241    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460246    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 15:40:45.464371 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460251    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460255    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460260    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460265    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460271    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460278    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460284    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460289    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460294    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460299    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460304    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460309    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460313    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460318    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460322    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460327    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460331    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460336    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460341    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460346    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 15:40:45.464886 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460351    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460355    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460363    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460368    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460373    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460377    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460382    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460387    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460391    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460396    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460400    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460405    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460409    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460414    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460419    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460423    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460428    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460433    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460438    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460442    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 15:40:45.465397 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460447    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460451    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460456    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460461    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460465    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460470    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460475    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460479    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460486    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460491    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460497    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460501    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460506    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460513    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460518    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460526    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460531    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460536    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460541    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 15:40:45.465942 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460545    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460550    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460554    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460559    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460563    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460567    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460572    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460576    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460581    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460585    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460590    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460595    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460600    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460605    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460609    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460614    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 15:40:45.466493 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460618    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.460626    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460840    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460849    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460854    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460859    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460864    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460869    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460874    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460879    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460884    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460888    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460893    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460898    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460903    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 15:40:45.466948 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460908    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460913    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460917    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460921    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460926    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460930    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460935    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460939    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460946    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460952    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460957    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460962    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460968    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460974    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460979    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.460984    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461007    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461013    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461018    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 15:40:45.467377 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461022    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461027    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461031    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461036    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461040    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461045    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461049    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461053    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461058    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461063    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461067    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461072    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461077    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461082    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461087    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461092    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461097    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461101    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461106    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461110    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 15:40:45.467856 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461116    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461123    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461128    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461133    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461139    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461144    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461149    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461153    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461158    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461163    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461167    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461172    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461176    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461182    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461186    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461191    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461195    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461200    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461205    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461209    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 15:40:45.468636 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461214    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461218    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461222    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461227    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461231    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461236    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461241    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461248    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461254    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461259    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461263    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461268    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461274    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461278    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461282    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461287    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461292    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461296    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461301    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461306    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 15:40:45.469528 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461310    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461315    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461319    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461323    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461327    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461332    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:45.461337    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.461345    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.461494    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.464119    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.465589    2576 server.go:1019] "Starting client certificate rotation"
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.465702    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.466666    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 15:40:45.470400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.468697    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 15:40:45.473777 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.473752    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 15:40:45.484591 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.484566    2576 log.go:25] "Validated CRI v1 runtime API"
Jun 09 15:40:45.487082 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.487063    2576 log.go:25] "Validated CRI v1 image API"
Jun 09 15:40:45.489319 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.489302    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 09 15:40:45.492116 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.492097    2576 fs.go:135] Filesystem UUIDs: map[2f507ef4-5d98-40bc-8217-6f6c5fb535d4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 db9ba799-3209-43c0-9bf6-2d2086bf2bd1:/dev/nvme0n1p4]
Jun 09 15:40:45.492182 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.492115    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 09 15:40:45.497277 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.497162    2576 manager.go:216] Machine: {Timestamp:2026-06-09 15:40:45.495795607 +0000 UTC m=+0.374575532 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100685 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a62fe9a0b365a707d291893ff81f7 SystemUUID:ec2a62fe-9a0b-365a-707d-291893ff81f7 BootID:f7b644e6-d8cd-4da5-ae87-7d56e7fd345e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:ae:e2:5e:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:ae:e2:5e:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:1b:2f:6f:54:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 09 15:40:45.497277 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.497266    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 09 15:40:45.497430 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.497345    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 09 15:40:45.498508 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.498476    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 09 15:40:45.498687 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.498511    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 09 15:40:45.499378 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.499366    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jun 09 15:40:45.499432 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.499385    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jun 09 15:40:45.499432 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.499397    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 15:40:45.500193 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.500181    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 15:40:45.500331 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.500317    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 15:40:45.500949 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.500937    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 09 15:40:45.503928 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.503914    2576 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 15:40:45.504090 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504078    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 09 15:40:45.504148 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504122    2576 kubelet.go:486] "Attempting to sync node with API server"
Jun 09 15:40:45.504148 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504145    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 09 15:40:45.504247 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504163    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 09 15:40:45.504247 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504179    2576 kubelet.go:398] "Adding apiserver pod source"
Jun 09 15:40:45.504247 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504192    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 09 15:40:45.504577 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504562    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 15:40:45.504695 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.504586    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 15:40:45.506825 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.506809    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 09 15:40:45.508168 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.508151    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 09 15:40:45.508245 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.508190    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 09 15:40:45.509308 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509293    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 09 15:40:45.509373 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509316    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 09 15:40:45.509373 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509325    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 09 15:40:45.509373 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509333    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 09 15:40:45.509373 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509346    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 09 15:40:45.509373 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509355    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 09 15:40:45.509373 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509368    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 09 15:40:45.509575 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509377    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 09 15:40:45.509575 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509387    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 09 15:40:45.509575 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509396    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 09 15:40:45.509575 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509422    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 09 15:40:45.509575 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.509432    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 09 15:40:45.510678 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.510667    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 09 15:40:45.510740 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.510689    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 09 15:40:45.513808 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.513792    2576 server.go:1268] "Started kubelet"
Jun 09 15:40:45.514032 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.513945    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 09 15:40:45.514173 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.514055    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 09 15:40:45.514803 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.514775    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 09 15:40:45.514847 ip-10-0-128-73 systemd[1]: Started Kubernetes Kubelet.
Jun 09 15:40:45.517332 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.517298    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 09 15:40:45.517549 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.517504    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 09 15:40:45.517549 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.517517    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 09 15:40:45.517687 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.517597    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 09 15:40:45.519359 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.519340    2576 server.go:310] "Adding debug handlers to kubelet server"
Jun 09 15:40:45.520637 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.520614    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 09 15:40:45.522761 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.522746    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 09 15:40:45.522845 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.522817    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 09 15:40:45.522903 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.522842    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:45.523467 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.523444    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 09 15:40:45.523467 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.523469    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 09 15:40:45.523586 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.523445    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 09 15:40:45.523626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.523590    2576 reconstruct.go:97] "Volume reconstruction finished"
Jun 09 15:40:45.523626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.523599    2576 reconciler.go:29] "Reconciler: start to sync state"
Jun 09 15:40:45.524036 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524020    2576 factory.go:55] Registering systemd factory
Jun 09 15:40:45.524036 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524039    2576 factory.go:223] Registration of the systemd container factory successfully
Jun 09 15:40:45.524258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524235    2576 factory.go:153] Registering CRI-O factory
Jun 09 15:40:45.524258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524248    2576 factory.go:223] Registration of the crio container factory successfully
Jun 09 15:40:45.524380 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524291    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 09 15:40:45.524380 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524309    2576 factory.go:103] Registering Raw factory
Jun 09 15:40:45.524380 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524318    2576 manager.go:1196] Started watching for new ooms in manager
Jun 09 15:40:45.524844 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.524832    2576 manager.go:349] Starting recovery of all containers
Jun 09 15:40:45.525036 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.523868    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-73.ec2.internal.18b773ee6cd70aa0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-73.ec2.internal,UID:ip-10-0-128-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-73.ec2.internal,},FirstTimestamp:2026-06-09 15:40:45.513763488 +0000 UTC m=+0.392543413,LastTimestamp:2026-06-09 15:40:45.513763488 +0000 UTC m=+0.392543413,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-73.ec2.internal,}"
Jun 09 15:40:45.527536 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.527511    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lz5lt"
Jun 09 15:40:45.533176 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.533124    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 09 15:40:45.533288 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.533263    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 09 15:40:45.534543 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.534359    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lz5lt"
Jun 09 15:40:45.535088 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.535064    2576 manager.go:354] Recovery completed
Jun 09 15:40:45.539892 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.539880    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 15:40:45.541546 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.541531    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 15:40:45.541624 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.541562    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 15:40:45.541624 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.541576    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 15:40:45.542206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.542098    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 09 15:40:45.542206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.542107    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 15:40:45.542206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.542111    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 09 15:40:45.542206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.542129    2576 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 15:40:45.542809 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.542796    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 15:40:45.542857 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.542819    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 15:40:45.542857 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.542829    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 15:40:45.543195 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.543179    2576 policy_none.go:49] "None policy: Start"
Jun 09 15:40:45.543267 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.543204    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 09 15:40:45.543267 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.543214    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 09 15:40:45.543671 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.543613    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-73.ec2.internal.18b773ee6e7ef7e5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-73.ec2.internal,UID:ip-10-0-128-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-73.ec2.internal,},FirstTimestamp:2026-06-09 15:40:45.541545957 +0000 UTC m=+0.420325884,LastTimestamp:2026-06-09 15:40:45.541545957 +0000 UTC m=+0.420325884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-73.ec2.internal,}"
Jun 09 15:40:45.544285 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.544270    2576 policy_none.go:47] "Start"
Jun 09 15:40:45.594605 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.591907    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 09 15:40:45.594605 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.592976    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 09 15:40:45.594605 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.593021    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 09 15:40:45.594605 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.593042    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 09 15:40:45.594605 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.593073    2576 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jun 09 15:40:45.595246 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.595221    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 15:40:45.600626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.600612    2576 manager.go:337] "Starting Device Plugin manager"
Jun 09 15:40:45.600736 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.600644    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 09 15:40:45.600736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.600658    2576 server.go:87] "Starting device plugin registration server"
Jun 09 15:40:45.600949 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.600937    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 09 15:40:45.601003 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.600950    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 09 15:40:45.601056 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.601034    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 09 15:40:45.601127 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.601111    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 09 15:40:45.601127 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.601124    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 09 15:40:45.601717 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.601694    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 09 15:40:45.601791 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.601754    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:45.693782 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.693671    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"]
Jun 09 15:40:45.693782 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.693770    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 15:40:45.695604 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.695578    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 15:40:45.695751 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.695620    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 15:40:45.695751 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.695635    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 15:40:45.697019 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697003    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 15:40:45.697139 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.697139 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697127    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 15:40:45.697773 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697754    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 15:40:45.697873 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697782    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 15:40:45.697873 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697795    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 15:40:45.697873 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697801    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 15:40:45.697873 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697824    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 15:40:45.697873 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.697835    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 15:40:45.698978 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.698965    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.699040 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.698988    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 15:40:45.699673 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.699657    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 15:40:45.699728 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.699687    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 15:40:45.699728 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.699701    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 15:40:45.701040 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.701024    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 15:40:45.701673 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.701653    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 15:40:45.701764 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.701684    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 15:40:45.701764 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.701697    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeHasSufficientPID"
Jun 09 15:40:45.701764 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.701715    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.707615 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.707598    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.707698 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.707619    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-73.ec2.internal\": node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:45.721380 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.721355    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:45.724620 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.724601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.724686 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.724627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.724686 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.724652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.727034 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.727013    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-73.ec2.internal\" not found" node="ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.731517 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.731499    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-73.ec2.internal\" not found" node="ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.821728 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.821695    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:45.824974 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.824950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.825112 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.824984    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.825112 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.825034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.825112 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.825072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/58267d6e6471fb16c1b68a4f6cfaa490-config\") pod \"kube-apiserver-proxy-ip-10-0-128-73.ec2.internal\" (UID: \"58267d6e6471fb16c1b68a4f6cfaa490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.825112 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.825079    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.825112 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:45.825070    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa226fc2d2c5f842f452b30ccab5b919-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal\" (UID: \"fa226fc2d2c5f842f452b30ccab5b919\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:45.922401 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:45.922365    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:46.023100 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.023027    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:46.031422 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.031397    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:46.036047 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.036026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:46.123782 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.123737    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:46.224232 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.224193    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:46.324730 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.324645    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:46.425134 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.425106    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-73.ec2.internal\" not found"
Jun 09 15:40:46.451018 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.450978    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 15:40:46.464986 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.464965    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 09 15:40:46.465132 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.465084    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 09 15:40:46.465132 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.465089    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 09 15:40:46.499796 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.499756    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa226fc2d2c5f842f452b30ccab5b919.slice/crio-a0a6ba645ca195fc2680f345d503bd3e8d5ef98d9fb660d4a52ab3d23970eca3 WatchSource:0}: Error finding container a0a6ba645ca195fc2680f345d503bd3e8d5ef98d9fb660d4a52ab3d23970eca3: Status 404 returned error can't find the container with id a0a6ba645ca195fc2680f345d503bd3e8d5ef98d9fb660d4a52ab3d23970eca3
Jun 09 15:40:46.500213 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.500188    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58267d6e6471fb16c1b68a4f6cfaa490.slice/crio-42475a4588659daabdd3bff72cca57b96bea6b196b41156d97458391011d3719 WatchSource:0}: Error finding container 42475a4588659daabdd3bff72cca57b96bea6b196b41156d97458391011d3719: Status 404 returned error can't find the container with id 42475a4588659daabdd3bff72cca57b96bea6b196b41156d97458391011d3719
Jun 09 15:40:46.504071 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.504053    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 15:40:46.504317 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.504302    2576 apiserver.go:52] "Watching apiserver"
Jun 09 15:40:46.523482 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.523462    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:46.523482 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.523475    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 09 15:40:46.524861 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.524845    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 09 15:40:46.525159 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.525143    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qf9f5","openshift-multus/multus-additional-cni-plugins-jrv58","openshift-multus/multus-h7slj","openshift-multus/network-metrics-daemon-v69vq","kube-system/konnectivity-agent-nzm45","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7","openshift-dns/node-resolver-nvsms","openshift-network-diagnostics/network-check-target-82cm9","openshift-network-operator/iptables-alerter-7rflf","openshift-ovn-kubernetes/ovnkube-node-pqzgm","kube-system/global-pull-secret-syncer-6d92b","openshift-cluster-node-tuning-operator/tuned-668ct"]
Jun 09 15:40:46.527037 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.527021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.528142 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.528118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.529151 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.529135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.529757 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.529736    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 09 15:40:46.530479 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.530003    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 09 15:40:46.530479 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.530322    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xmntf\""
Jun 09 15:40:46.530615 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.530515    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 09 15:40:46.531212 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.531120    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s6thg\""
Jun 09 15:40:46.531212 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.531174    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 09 15:40:46.531886 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.531501    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 09 15:40:46.531886 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.531639    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 09 15:40:46.532048 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.531923    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 09 15:40:46.532048 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.532028    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 09 15:40:46.532275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.532237    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7cgq5\""
Jun 09 15:40:46.532369 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.532336    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 09 15:40:46.532565 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.532540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:46.532660 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.532640    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:40:46.533500 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.533480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.534647 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.534632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.535480 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.535355    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 15:40:46.535480 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.535460    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"
Jun 09 15:40:46.535959 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.535943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.536204 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ztg7g\""
Jun 09 15:40:46.536294 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536285    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 09 15:40:46.536405 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 09 15:40:46.536576 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536556    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 09 15:40:46.536808 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536791    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 09 15:40:46.536871 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nfnt4\""
Jun 09 15:40:46.536934 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536836    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 15:35:45 +0000 UTC" deadline="2028-01-09 14:52:16.14726613 +0000 UTC"
Jun 09 15:40:46.536934 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.536882    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13895h11m29.610386998s"
Jun 09 15:40:46.537070 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.537054    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 09 15:40:46.537137 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.537118    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 15:40:46.537328 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.537314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:46.537398 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.537379    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:40:46.538181 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.538163    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 09 15:40:46.538266 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.538193    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 09 15:40:46.538266 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.538245    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dxl7f\""
Jun 09 15:40:46.538663 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.538647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.539922 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.539904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.540783 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.540763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 09 15:40:46.540987 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.540852    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 09 15:40:46.540987 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.540973    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 09 15:40:46.540987 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.541009    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 15:40:46.541246 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.541126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m78wv\""
Jun 09 15:40:46.541341 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.541327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.541401 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.541384    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:40:46.541925 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.541910    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 09 15:40:46.542212 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.542193    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 09 15:40:46.542295 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.542221    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 09 15:40:46.542295 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.542243    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-869mc\""
Jun 09 15:40:46.542949 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.542931    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal"]
Jun 09 15:40:46.543066 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.543016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.543464 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.543423    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 09 15:40:46.543464 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.543456    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 09 15:40:46.543617 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.543470    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 09 15:40:46.545222 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.545204    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal"]
Jun 09 15:40:46.545310 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.545226    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 15:40:46.545509 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.545492    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 09 15:40:46.545564 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.545492    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 09 15:40:46.545564 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.545497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jgp26\""
Jun 09 15:40:46.560568 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.560550    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b8cxk"
Jun 09 15:40:46.571175 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.569910    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b8cxk"
Jun 09 15:40:46.596315 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.596271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" event={"ID":"58267d6e6471fb16c1b68a4f6cfaa490","Type":"ContainerStarted","Data":"42475a4588659daabdd3bff72cca57b96bea6b196b41156d97458391011d3719"}
Jun 09 15:40:46.597584 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.597567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerStarted","Data":"a0a6ba645ca195fc2680f345d503bd3e8d5ef98d9fb660d4a52ab3d23970eca3"}
Jun 09 15:40:46.624904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.624884    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 09 15:40:46.628877 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.628859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-registration-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.628968 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.628884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-var-lib-kubelet\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.628968 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.628901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-kubelet\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.628968 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.628917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-cni-netd\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629097 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.628965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-run-netns\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629097 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-var-lib-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629097 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvpks\" (UniqueName: \"kubernetes.io/projected/63bf53bd-bef5-451d-9734-72dca9a94d3b-kube-api-access-rvpks\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.629097 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-lib-modules\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.629097 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae26fb92-feca-4d63-a19e-ce77734afdab-agent-certs\") pod \"konnectivity-agent-nzm45\" (UID: \"ae26fb92-feca-4d63-a19e-ce77734afdab\") " pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.629262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629109    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.629262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-device-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.629262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-run\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.629262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:46.629262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-node-log\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdz8h\" (UniqueName: \"kubernetes.io/projected/199ed6cb-f5f5-4bdd-a422-80c88c583c12-kube-api-access-jdz8h\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac3118e2-7a36-4774-b806-b274334aed61-tmp\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rn7\" (UniqueName: \"kubernetes.io/projected/3157c15f-0b54-4002-b43c-863bdfcd6861-kube-api-access-22rn7\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-dbus\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-cnibin\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-netns\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-host\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-cni-bin\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrptk\" (UniqueName: \"kubernetes.io/projected/a0ffaf55-4375-4ffe-b009-e07a43e281b7-kube-api-access-wrptk\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.629470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbddm\" (UniqueName: \"kubernetes.io/projected/678d5149-004b-438d-80ed-6785d48fa41e-kube-api-access-pbddm\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovnkube-config\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-kubelet\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-socket-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-sys-fs\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-systemd\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-system-cni-dir\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-socket-dir-parent\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae26fb92-feca-4d63-a19e-ce77734afdab-konnectivity-ca\") pod \"konnectivity-agent-nzm45\" (UID: \"ae26fb92-feca-4d63-a19e-ce77734afdab\") " pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysctl-conf\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-sys\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac3118e2-7a36-4774-b806-b274334aed61-etc-tuned\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3157c15f-0b54-4002-b43c-863bdfcd6861-host\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.629804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-etc-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-cni-multus\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-multus-certs\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysconfig\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629913    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysctl-d\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-systemd-units\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.629977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-daemon-config\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovn-node-metrics-cert\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qkjb\" (UniqueName: \"kubernetes.io/projected/75782ece-32fd-45d1-9d86-38283259fd4e-kube-api-access-8qkjb\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-iptables-alerter-script\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-os-release\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-os-release\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de628c55-ab74-4e39-bfe1-e8267fba5d14-cni-binary-copy\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.630458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-host-slash\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-modprobe-d\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-system-cni-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-k8s-cni-cncf-io\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-hostroot\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-conf-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630337    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-systemd\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/678d5149-004b-438d-80ed-6785d48fa41e-tmp-dir\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-log-socket\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-cni-bin\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovnkube-script-lib\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-etc-kubernetes\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czk5q\" (UniqueName: \"kubernetes.io/projected/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-kube-api-access-czk5q\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-kubernetes\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5lfr\" (UniqueName: \"kubernetes.io/projected/ac3118e2-7a36-4774-b806-b274334aed61-kube-api-access-r5lfr\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3157c15f-0b54-4002-b43c-863bdfcd6861-serviceca\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.631057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/678d5149-004b-438d-80ed-6785d48fa41e-hosts-file\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.631538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-slash\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.631538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-env-overrides\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.631538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-kubelet-config\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.631538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-ovn\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.631538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-cnibin\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.631538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-cni-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.631538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.630730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhtzb\" (UniqueName: \"kubernetes.io/projected/de628c55-ab74-4e39-bfe1-e8267fba5d14-kube-api-access-qhtzb\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.731104 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-systemd\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.731275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-system-cni-dir\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.731275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.731275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731186    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-systemd\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.731275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-system-cni-dir\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.731275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-socket-dir-parent\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.731275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae26fb92-feca-4d63-a19e-ce77734afdab-konnectivity-ca\") pod \"konnectivity-agent-nzm45\" (UID: \"ae26fb92-feca-4d63-a19e-ce77734afdab\") " pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysctl-conf\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-sys\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac3118e2-7a36-4774-b806-b274334aed61-etc-tuned\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3157c15f-0b54-4002-b43c-863bdfcd6861-host\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-socket-dir-parent\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-etc-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731385    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-sys\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731395    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3157c15f-0b54-4002-b43c-863bdfcd6861-host\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-cni-multus\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-multus-certs\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731454    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-etc-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731469    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysctl-conf\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysconfig\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731499    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-multus-certs\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysctl-d\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-systemd-units\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.731567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-daemon-config\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731579    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-cni-multus\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovn-node-metrics-cert\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731609    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysctl-d\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731622    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-systemd-units\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qkjb\" (UniqueName: \"kubernetes.io/projected/75782ece-32fd-45d1-9d86-38283259fd4e-kube-api-access-8qkjb\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731657    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-sysconfig\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-iptables-alerter-script\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-os-release\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-os-release\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de628c55-ab74-4e39-bfe1-e8267fba5d14-cni-binary-copy\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-host-slash\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-modprobe-d\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-system-cni-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-k8s-cni-cncf-io\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.732414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-hostroot\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732054    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732068    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-conf-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-run-ovn-kubernetes\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-systemd\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732161    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-os-release\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732167    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-k8s-cni-cncf-io\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732123    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae26fb92-feca-4d63-a19e-ce77734afdab-konnectivity-ca\") pod \"konnectivity-agent-nzm45\" (UID: \"ae26fb92-feca-4d63-a19e-ce77734afdab\") " pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/678d5149-004b-438d-80ed-6785d48fa41e-tmp-dir\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-log-socket\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732217    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-os-release\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732225    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-host-slash\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-cni-bin\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732217    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-hostroot\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732253    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-daemon-config\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.733206 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-system-cni-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.731723    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732272    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-conf-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732274    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-log-socket\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732287    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-iptables-alerter-script\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732304    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-cni-bin\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.732304    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732358    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-systemd\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.732385    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:40:47.232364559 +0000 UTC m=+2.111144472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732394    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-modprobe-d\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovnkube-script-lib\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-etc-kubernetes\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czk5q\" (UniqueName: \"kubernetes.io/projected/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-kube-api-access-czk5q\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732619    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-etc-kubernetes\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-kubernetes\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/678d5149-004b-438d-80ed-6785d48fa41e-tmp-dir\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5lfr\" (UniqueName: \"kubernetes.io/projected/ac3118e2-7a36-4774-b806-b274334aed61-kube-api-access-r5lfr\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732705    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-etc-kubernetes\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.737311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3157c15f-0b54-4002-b43c-863bdfcd6861-serviceca\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/678d5149-004b-438d-80ed-6785d48fa41e-hosts-file\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-slash\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732788    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de628c55-ab74-4e39-bfe1-e8267fba5d14-cni-binary-copy\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-env-overrides\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-kubelet-config\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.732852    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-slash\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-ovn\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-cnibin\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-cni-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhtzb\" (UniqueName: \"kubernetes.io/projected/de628c55-ab74-4e39-bfe1-e8267fba5d14-kube-api-access-qhtzb\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-registration-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-var-lib-kubelet\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-kubelet\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-cni-netd\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733444    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/678d5149-004b-438d-80ed-6785d48fa41e-hosts-file\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-run-netns\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733473    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovnkube-script-lib\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.738238 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733450    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-kubelet-config\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733492    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-run-netns\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733529    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-run-ovn\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733558    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-cnibin\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733597    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-kubelet\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-var-lib-kubelet\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733669    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-multus-cni-dir\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-var-lib-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733722    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-cni-netd\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733745    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3157c15f-0b54-4002-b43c-863bdfcd6861-serviceca\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733772    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-var-lib-openvswitch\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.733799    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-registration-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.734046    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-env-overrides\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.735807    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac3118e2-7a36-4774-b806-b274334aed61-etc-tuned\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvpks\" (UniqueName: \"kubernetes.io/projected/63bf53bd-bef5-451d-9734-72dca9a94d3b-kube-api-access-rvpks\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-lib-modules\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae26fb92-feca-4d63-a19e-ce77734afdab-agent-certs\") pod \"konnectivity-agent-nzm45\" (UID: \"ae26fb92-feca-4d63-a19e-ce77734afdab\") " pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.739118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-device-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-run\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736937    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-device-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736957    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-run\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.736986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-node-log\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737012    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-lib-modules\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz8h\" (UniqueName: \"kubernetes.io/projected/199ed6cb-f5f5-4bdd-a422-80c88c583c12-kube-api-access-jdz8h\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737040    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-node-log\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac3118e2-7a36-4774-b806-b274334aed61-tmp\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rn7\" (UniqueName: \"kubernetes.io/projected/3157c15f-0b54-4002-b43c-863bdfcd6861-kube-api-access-22rn7\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-dbus\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-cnibin\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.739904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-netns\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-host\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737761    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac3118e2-7a36-4774-b806-b274334aed61-host\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737768    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-dbus\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737829    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-cnibin\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737833    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovn-node-metrics-cert\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-cni-bin\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-cni-bin\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.737947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrptk\" (UniqueName: \"kubernetes.io/projected/a0ffaf55-4375-4ffe-b009-e07a43e281b7-kube-api-access-wrptk\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbddm\" (UniqueName: \"kubernetes.io/projected/678d5149-004b-438d-80ed-6785d48fa41e-kube-api-access-pbddm\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738061    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-run-netns\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738062    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63bf53bd-bef5-451d-9734-72dca9a94d3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.738201    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovnkube-config\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-kubelet\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.740736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738319    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63bf53bd-bef5-451d-9734-72dca9a94d3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.738378    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret podName:1d865fb0-6977-4e46-bcd7-8d98da5ee9b9 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:47.238318664 +0000 UTC m=+2.117098588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret") pod "global-pull-secret-syncer-6d92b" (UID: "1d865fb0-6977-4e46-bcd7-8d98da5ee9b9") : object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738418    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/de628c55-ab74-4e39-bfe1-e8267fba5d14-host-var-lib-kubelet\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-socket-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738542    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-socket-dir\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-sys-fs\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/199ed6cb-f5f5-4bdd-a422-80c88c583c12-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738764    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a0ffaf55-4375-4ffe-b009-e07a43e281b7-sys-fs\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.738755    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/199ed6cb-f5f5-4bdd-a422-80c88c583c12-ovnkube-config\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.739689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae26fb92-feca-4d63-a19e-ce77734afdab-agent-certs\") pod \"konnectivity-agent-nzm45\" (UID: \"ae26fb92-feca-4d63-a19e-ce77734afdab\") " pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.741574 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.740816    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac3118e2-7a36-4774-b806-b274334aed61-tmp\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.742183 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.741602    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qkjb\" (UniqueName: \"kubernetes.io/projected/75782ece-32fd-45d1-9d86-38283259fd4e-kube-api-access-8qkjb\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:46.742183 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.742135    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czk5q\" (UniqueName: \"kubernetes.io/projected/6bf7f958-f112-4bd3-951d-082cbc9e8f2e-kube-api-access-czk5q\") pod \"iptables-alerter-7rflf\" (UID: \"6bf7f958-f112-4bd3-951d-082cbc9e8f2e\") " pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.743255 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.743233    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhtzb\" (UniqueName: \"kubernetes.io/projected/de628c55-ab74-4e39-bfe1-e8267fba5d14-kube-api-access-qhtzb\") pod \"multus-h7slj\" (UID: \"de628c55-ab74-4e39-bfe1-e8267fba5d14\") " pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.743321 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.743233    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5lfr\" (UniqueName: \"kubernetes.io/projected/ac3118e2-7a36-4774-b806-b274334aed61-kube-api-access-r5lfr\") pod \"tuned-668ct\" (UID: \"ac3118e2-7a36-4774-b806-b274334aed61\") " pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.745921 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.745901    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 15:40:46.745921 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.745924    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 15:40:46.746104 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.745935    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tlfc4 for pod openshift-network-diagnostics/network-check-target-82cm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:46.746104 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:46.746016    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4 podName:f31e5939-6be3-4e77-8de7-d83b57d22461 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:47.245985308 +0000 UTC m=+2.124765220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tlfc4" (UniqueName: "kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4") pod "network-check-target-82cm9" (UID: "f31e5939-6be3-4e77-8de7-d83b57d22461") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:46.747880 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.747854    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbddm\" (UniqueName: \"kubernetes.io/projected/678d5149-004b-438d-80ed-6785d48fa41e-kube-api-access-pbddm\") pod \"node-resolver-nvsms\" (UID: \"678d5149-004b-438d-80ed-6785d48fa41e\") " pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.747984 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.747899    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rn7\" (UniqueName: \"kubernetes.io/projected/3157c15f-0b54-4002-b43c-863bdfcd6861-kube-api-access-22rn7\") pod \"node-ca-qf9f5\" (UID: \"3157c15f-0b54-4002-b43c-863bdfcd6861\") " pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.748319 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.748296    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdz8h\" (UniqueName: \"kubernetes.io/projected/199ed6cb-f5f5-4bdd-a422-80c88c583c12-kube-api-access-jdz8h\") pod \"ovnkube-node-pqzgm\" (UID: \"199ed6cb-f5f5-4bdd-a422-80c88c583c12\") " pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.748517 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.748501    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrptk\" (UniqueName: \"kubernetes.io/projected/a0ffaf55-4375-4ffe-b009-e07a43e281b7-kube-api-access-wrptk\") pod \"aws-ebs-csi-driver-node-s8wc7\" (UID: \"a0ffaf55-4375-4ffe-b009-e07a43e281b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.748892 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.748873    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvpks\" (UniqueName: \"kubernetes.io/projected/63bf53bd-bef5-451d-9734-72dca9a94d3b-kube-api-access-rvpks\") pod \"multus-additional-cni-plugins-jrv58\" (UID: \"63bf53bd-bef5-451d-9734-72dca9a94d3b\") " pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.837840 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.837765    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qf9f5"
Jun 09 15:40:46.844731 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.844708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jrv58"
Jun 09 15:40:46.845625 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.845594    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3157c15f_0b54_4002_b43c_863bdfcd6861.slice/crio-357c575d2672336d866b02c95acd6877b93e473752aa657d78c02913504f66be WatchSource:0}: Error finding container 357c575d2672336d866b02c95acd6877b93e473752aa657d78c02913504f66be: Status 404 returned error can't find the container with id 357c575d2672336d866b02c95acd6877b93e473752aa657d78c02913504f66be
Jun 09 15:40:46.851183 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.851160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h7slj"
Jun 09 15:40:46.854890 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.854867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:40:46.855037 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.855008    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bf53bd_bef5_451d_9734_72dca9a94d3b.slice/crio-8c10ec4fa82a009b8ed85f44337d6346b18ebcce5f2e74ab8a492aba84a2c3ba WatchSource:0}: Error finding container 8c10ec4fa82a009b8ed85f44337d6346b18ebcce5f2e74ab8a492aba84a2c3ba: Status 404 returned error can't find the container with id 8c10ec4fa82a009b8ed85f44337d6346b18ebcce5f2e74ab8a492aba84a2c3ba
Jun 09 15:40:46.860772 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.860749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7"
Jun 09 15:40:46.861547 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.861520    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde628c55_ab74_4e39_bfe1_e8267fba5d14.slice/crio-9c845c681ea26193331b48d4a535ebae244d793a561c85a67ff49fe8c7a486c6 WatchSource:0}: Error finding container 9c845c681ea26193331b48d4a535ebae244d793a561c85a67ff49fe8c7a486c6: Status 404 returned error can't find the container with id 9c845c681ea26193331b48d4a535ebae244d793a561c85a67ff49fe8c7a486c6
Jun 09 15:40:46.864255 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.864228    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae26fb92_feca_4d63_a19e_ce77734afdab.slice/crio-337ff2d1fb538666d8a5be41cc0bfbb5536e863bf9e9edfd6c18ee7e34da8f65 WatchSource:0}: Error finding container 337ff2d1fb538666d8a5be41cc0bfbb5536e863bf9e9edfd6c18ee7e34da8f65: Status 404 returned error can't find the container with id 337ff2d1fb538666d8a5be41cc0bfbb5536e863bf9e9edfd6c18ee7e34da8f65
Jun 09 15:40:46.865540 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.865513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nvsms"
Jun 09 15:40:46.869691 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.869668    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ffaf55_4375_4ffe_b009_e07a43e281b7.slice/crio-7f5f099eaaa84b27e53813e29bf17cd09745e750c9ddb44a6091f77adbe973f8 WatchSource:0}: Error finding container 7f5f099eaaa84b27e53813e29bf17cd09745e750c9ddb44a6091f77adbe973f8: Status 404 returned error can't find the container with id 7f5f099eaaa84b27e53813e29bf17cd09745e750c9ddb44a6091f77adbe973f8
Jun 09 15:40:46.873612 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.873467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rflf"
Jun 09 15:40:46.873783 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.873740    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678d5149_004b_438d_80ed_6785d48fa41e.slice/crio-b0cd63124d2abbdcd81dcd78b0db6f0eb6c847bcab3452f7544aa3ec53f8b5fb WatchSource:0}: Error finding container b0cd63124d2abbdcd81dcd78b0db6f0eb6c847bcab3452f7544aa3ec53f8b5fb: Status 404 returned error can't find the container with id b0cd63124d2abbdcd81dcd78b0db6f0eb6c847bcab3452f7544aa3ec53f8b5fb
Jun 09 15:40:46.878270 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.878251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:40:46.880052 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.880030    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 15:40:46.882977 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:46.882958    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-668ct"
Jun 09 15:40:46.883197 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.883169    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf7f958_f112_4bd3_951d_082cbc9e8f2e.slice/crio-2cc405e7b59c61e32a2c953acd639b19dc1240765ef8927be3ffc11ce578c6ba WatchSource:0}: Error finding container 2cc405e7b59c61e32a2c953acd639b19dc1240765ef8927be3ffc11ce578c6ba: Status 404 returned error can't find the container with id 2cc405e7b59c61e32a2c953acd639b19dc1240765ef8927be3ffc11ce578c6ba
Jun 09 15:40:46.889320 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.889299    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199ed6cb_f5f5_4bdd_a422_80c88c583c12.slice/crio-86c4d093248f25bf077504e6f8a5bb60ab6f0f745873d7a0005f48983c0ee952 WatchSource:0}: Error finding container 86c4d093248f25bf077504e6f8a5bb60ab6f0f745873d7a0005f48983c0ee952: Status 404 returned error can't find the container with id 86c4d093248f25bf077504e6f8a5bb60ab6f0f745873d7a0005f48983c0ee952
Jun 09 15:40:46.892825 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:40:46.892807    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3118e2_7a36_4774_b806_b274334aed61.slice/crio-2f1422993ebd3fb935955c96c329e4586e318d8bb1e93fd955fee44c7b094dd9 WatchSource:0}: Error finding container 2f1422993ebd3fb935955c96c329e4586e318d8bb1e93fd955fee44c7b094dd9: Status 404 returned error can't find the container with id 2f1422993ebd3fb935955c96c329e4586e318d8bb1e93fd955fee44c7b094dd9
Jun 09 15:40:47.242367 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.242027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:47.242367 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.242114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:47.242367 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.242234    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:47.242367 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.242252    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:47.242367 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.242315    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:40:48.242293996 +0000 UTC m=+3.121073921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:47.242367 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.242360    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret podName:1d865fb0-6977-4e46-bcd7-8d98da5ee9b9 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:48.242325679 +0000 UTC m=+3.121105594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret") pod "global-pull-secret-syncer-6d92b" (UID: "1d865fb0-6977-4e46-bcd7-8d98da5ee9b9") : object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:47.272366 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.272335    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 15:40:47.342893 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.342858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:47.343170 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.343148    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 15:40:47.343253 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.343182    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 15:40:47.343253 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.343196    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tlfc4 for pod openshift-network-diagnostics/network-check-target-82cm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:47.343356 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.343267    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4 podName:f31e5939-6be3-4e77-8de7-d83b57d22461 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:48.343235119 +0000 UTC m=+3.222015048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlfc4" (UniqueName: "kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4") pod "network-check-target-82cm9" (UID: "f31e5939-6be3-4e77-8de7-d83b57d22461") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:47.575080 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.573226    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:35:46 +0000 UTC" deadline="2028-03-07 14:36:34.769019512 +0000 UTC"
Jun 09 15:40:47.575080 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.573264    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15286h55m47.195759595s"
Jun 09 15:40:47.594143 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.593689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:47.594143 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:47.593824    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:40:47.623720 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.623646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rflf" event={"ID":"6bf7f958-f112-4bd3-951d-082cbc9e8f2e","Type":"ContainerStarted","Data":"2cc405e7b59c61e32a2c953acd639b19dc1240765ef8927be3ffc11ce578c6ba"}
Jun 09 15:40:47.627077 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.627046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nvsms" event={"ID":"678d5149-004b-438d-80ed-6785d48fa41e","Type":"ContainerStarted","Data":"b0cd63124d2abbdcd81dcd78b0db6f0eb6c847bcab3452f7544aa3ec53f8b5fb"}
Jun 09 15:40:47.633693 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.633609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nzm45" event={"ID":"ae26fb92-feca-4d63-a19e-ce77734afdab","Type":"ContainerStarted","Data":"337ff2d1fb538666d8a5be41cc0bfbb5536e863bf9e9edfd6c18ee7e34da8f65"}
Jun 09 15:40:47.645647 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.645608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerStarted","Data":"8c10ec4fa82a009b8ed85f44337d6346b18ebcce5f2e74ab8a492aba84a2c3ba"}
Jun 09 15:40:47.660221 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.660163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qf9f5" event={"ID":"3157c15f-0b54-4002-b43c-863bdfcd6861","Type":"ContainerStarted","Data":"357c575d2672336d866b02c95acd6877b93e473752aa657d78c02913504f66be"}
Jun 09 15:40:47.671981 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.671908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-668ct" event={"ID":"ac3118e2-7a36-4774-b806-b274334aed61","Type":"ContainerStarted","Data":"2f1422993ebd3fb935955c96c329e4586e318d8bb1e93fd955fee44c7b094dd9"}
Jun 09 15:40:47.680073 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.680039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"86c4d093248f25bf077504e6f8a5bb60ab6f0f745873d7a0005f48983c0ee952"}
Jun 09 15:40:47.689440 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.689407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7" event={"ID":"a0ffaf55-4375-4ffe-b009-e07a43e281b7","Type":"ContainerStarted","Data":"7f5f099eaaa84b27e53813e29bf17cd09745e750c9ddb44a6091f77adbe973f8"}
Jun 09 15:40:47.695850 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:47.695820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h7slj" event={"ID":"de628c55-ab74-4e39-bfe1-e8267fba5d14","Type":"ContainerStarted","Data":"9c845c681ea26193331b48d4a535ebae244d793a561c85a67ff49fe8c7a486c6"}
Jun 09 15:40:48.250013 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.249961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:48.250241 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.250050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:48.250241 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.250208    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:48.250384 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.250271    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:40:50.25025296 +0000 UTC m=+5.129032875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:48.250693 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.250654    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:48.250772 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.250712    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret podName:1d865fb0-6977-4e46-bcd7-8d98da5ee9b9 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:50.250695989 +0000 UTC m=+5.129475905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret") pod "global-pull-secret-syncer-6d92b" (UID: "1d865fb0-6977-4e46-bcd7-8d98da5ee9b9") : object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:48.351159 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.350515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:48.351159 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.350688    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 15:40:48.351159 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.350716    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 15:40:48.351159 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.350737    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tlfc4 for pod openshift-network-diagnostics/network-check-target-82cm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:48.351159 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.350799    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4 podName:f31e5939-6be3-4e77-8de7-d83b57d22461 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:50.350781231 +0000 UTC m=+5.229561166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlfc4" (UniqueName: "kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4") pod "network-check-target-82cm9" (UID: "f31e5939-6be3-4e77-8de7-d83b57d22461") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:48.573703 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.573605    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:35:46 +0000 UTC" deadline="2028-01-14 22:09:29.076205112 +0000 UTC"
Jun 09 15:40:48.573703 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.573651    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14022h28m40.502559498s"
Jun 09 15:40:48.594035 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.593986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:48.594515 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.594161    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:40:48.594660 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.594589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:48.594721 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:48.594687    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:40:48.964214 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:48.964143    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 15:40:49.594388 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:49.594341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:49.594832 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:49.594470    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:40:50.270004 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:50.269944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:50.270192 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:50.270057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:50.270258 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.270203    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:50.270309 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.270267    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret podName:1d865fb0-6977-4e46-bcd7-8d98da5ee9b9 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:54.270247732 +0000 UTC m=+9.149027658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret") pod "global-pull-secret-syncer-6d92b" (UID: "1d865fb0-6977-4e46-bcd7-8d98da5ee9b9") : object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:50.270485 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.270457    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:50.270618 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.270517    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:40:54.270501388 +0000 UTC m=+9.149281305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:50.371687 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:50.371038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:50.371687 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.371193    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 15:40:50.371687 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.371211    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 15:40:50.371687 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.371223    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tlfc4 for pod openshift-network-diagnostics/network-check-target-82cm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:50.371687 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.371285    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4 podName:f31e5939-6be3-4e77-8de7-d83b57d22461 nodeName:}" failed. No retries permitted until 2026-06-09 15:40:54.371266478 +0000 UTC m=+9.250046399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlfc4" (UniqueName: "kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4") pod "network-check-target-82cm9" (UID: "f31e5939-6be3-4e77-8de7-d83b57d22461") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:50.594029 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:50.593420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:50.594029 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.593571    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:40:50.594029 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:50.593801    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:50.594029 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:50.593926    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:40:51.594082 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:51.594048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:51.594538 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:51.594185    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:40:52.593892 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:52.593859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:52.593892 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:52.593885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:52.594152 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:52.594062    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:40:52.594152 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:52.594110    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:40:53.594363 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:53.594329    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:53.594819 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:53.594543    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:40:54.304116 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:54.303390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:54.304116 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:54.303496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:54.304116 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.303640    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:54.304116 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.303709    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:02.303689069 +0000 UTC m=+17.182468987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:40:54.304116 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.303640    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:54.304116 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.304089    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret podName:1d865fb0-6977-4e46-bcd7-8d98da5ee9b9 nodeName:}" failed. No retries permitted until 2026-06-09 15:41:02.304072533 +0000 UTC m=+17.182852449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret") pod "global-pull-secret-syncer-6d92b" (UID: "1d865fb0-6977-4e46-bcd7-8d98da5ee9b9") : object "kube-system"/"original-pull-secret" not registered
Jun 09 15:40:54.404439 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:54.404368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:54.404616 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.404542    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 15:40:54.404616 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.404561    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 15:40:54.404616 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.404573    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tlfc4 for pod openshift-network-diagnostics/network-check-target-82cm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:54.404786 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.404631    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4 podName:f31e5939-6be3-4e77-8de7-d83b57d22461 nodeName:}" failed. No retries permitted until 2026-06-09 15:41:02.40461263 +0000 UTC m=+17.283392545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlfc4" (UniqueName: "kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4") pod "network-check-target-82cm9" (UID: "f31e5939-6be3-4e77-8de7-d83b57d22461") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:40:54.593849 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:54.593761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:54.594036 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:54.593761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:54.594036 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.593905    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:40:54.594167 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:54.594030    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:40:55.594798 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:55.594761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:55.595408 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:55.594875    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:40:56.594322 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:56.594057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:56.594322 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:56.594211    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:40:56.594544 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:56.594057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:56.594703 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:56.594652    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:40:57.596460 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:57.596429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:57.596856 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:57.596527    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:40:58.593699 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:58.593617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:40:58.593868 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:58.593749    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:40:58.593868 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:58.593816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:40:58.594009 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:58.593967    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:40:59.593715 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:40:59.593680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:40:59.594256 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:40:59.593807    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:00.593537 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:00.593497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:00.593688 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:00.593513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:00.593688 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:00.593623    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:00.593777 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:00.593719    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:01.596853 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:01.596820    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:01.597342 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:01.596938    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:02.362310 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:02.362225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:02.362310 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:02.362303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:02.362572 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.362380    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:41:02.362572 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.362403    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 15:41:02.362572 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.362452    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:18.362434512 +0000 UTC m=+33.241214432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:41:02.362572 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.362467    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret podName:1d865fb0-6977-4e46-bcd7-8d98da5ee9b9 nodeName:}" failed. No retries permitted until 2026-06-09 15:41:18.362461165 +0000 UTC m=+33.241241082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret") pod "global-pull-secret-syncer-6d92b" (UID: "1d865fb0-6977-4e46-bcd7-8d98da5ee9b9") : object "kube-system"/"original-pull-secret" not registered
Jun 09 15:41:02.462957 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:02.462924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:02.463170 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.463125    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 15:41:02.463170 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.463152    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 15:41:02.463170 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.463165    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tlfc4 for pod openshift-network-diagnostics/network-check-target-82cm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:41:02.463334 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.463233    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4 podName:f31e5939-6be3-4e77-8de7-d83b57d22461 nodeName:}" failed. No retries permitted until 2026-06-09 15:41:18.463214809 +0000 UTC m=+33.341994741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlfc4" (UniqueName: "kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4") pod "network-check-target-82cm9" (UID: "f31e5939-6be3-4e77-8de7-d83b57d22461") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:41:02.594054 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:02.594012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:02.594054 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:02.594044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:02.594346 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.594168    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:02.594346 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:02.594271    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:03.593843 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:03.593778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:03.594353 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:03.593944    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:04.594115 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:04.593958    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:04.594115 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:04.594028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:04.594528 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:04.594125    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:04.594528 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:04.594227    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:05.595002 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:05.594966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:05.595488 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:05.595098    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:06.594032 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:06.593848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:06.594132 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:06.593876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:06.594182 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:06.594132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:06.594229 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:06.594209    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:07.594272 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.594243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:07.594825 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:07.594392    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:07.736309 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.736270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nvsms" event={"ID":"678d5149-004b-438d-80ed-6785d48fa41e","Type":"ContainerStarted","Data":"134b54b52a7c916e9c699507aee4010f2fdfa9ffdd0bccde3b8a0d4666cf5dd3"}
Jun 09 15:41:07.737651 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.737623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nzm45" event={"ID":"ae26fb92-feca-4d63-a19e-ce77734afdab","Type":"ContainerStarted","Data":"dbf3cc2caf6f1d8429f5bb9637a513c8eefd45deb21eabfb9635f8a2dfd2a57f"}
Jun 09 15:41:07.739057 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.739034    2576 generic.go:356] "Generic (PLEG): container finished" podID="63bf53bd-bef5-451d-9734-72dca9a94d3b" containerID="73a103f3e2fcf21b6e4b05771eed3ae8d9e58c51e3e5b03fb13004b03ee1b1c6" exitCode=0
Jun 09 15:41:07.739152 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.739110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerDied","Data":"73a103f3e2fcf21b6e4b05771eed3ae8d9e58c51e3e5b03fb13004b03ee1b1c6"}
Jun 09 15:41:07.740527 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.740506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qf9f5" event={"ID":"3157c15f-0b54-4002-b43c-863bdfcd6861","Type":"ContainerStarted","Data":"27023a8d4d21299004914bed73defbedb9f83547204e955c72bb9b0543c7f516"}
Jun 09 15:41:07.742045 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.742020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" event={"ID":"58267d6e6471fb16c1b68a4f6cfaa490","Type":"ContainerStarted","Data":"fc059f0eff247bfd399aa66e3c72afb8ef3eb01f5dc7aef9c13d3d37863d65c2"}
Jun 09 15:41:07.743437 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.743394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-668ct" event={"ID":"ac3118e2-7a36-4774-b806-b274334aed61","Type":"ContainerStarted","Data":"98b56377f2290b7d23e94b4c3fe1235b00167b192b08cab4137fa10400e11177"}
Jun 09 15:41:07.746119 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746103    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:41:07.746439 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746417    2576 generic.go:356] "Generic (PLEG): container finished" podID="199ed6cb-f5f5-4bdd-a422-80c88c583c12" containerID="43f2d2cf69739e157ebb8023634ad11c26ddc89b96feaa77eb0aa276cfe015f0" exitCode=1
Jun 09 15:41:07.746517 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"09b4f740abb727e57055efc58655d92a0e799cbf7bd5b0c09b6cac007df86659"}
Jun 09 15:41:07.746573 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"cabdf6f864ed62427a46e1cafc31103d5f65ba08f6b00e0883c5c51cdf3a7f7b"}
Jun 09 15:41:07.746573 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"9ab6f3311ff9fe039605ff3b400298c594b6fab9dc69a910a413c88b29c47379"}
Jun 09 15:41:07.746659 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746591    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"3198601b02d3461be48855b26dad3954547004a7b5b143fee512ca1499e78e4a"}
Jun 09 15:41:07.746659 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerDied","Data":"43f2d2cf69739e157ebb8023634ad11c26ddc89b96feaa77eb0aa276cfe015f0"}
Jun 09 15:41:07.746752 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.746658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"d7325b4e73d3097648ecc99e5b8b4c692da8d9800d7bb9b68e81f947d9e6dd0d"}
Jun 09 15:41:07.747748 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.747730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7" event={"ID":"a0ffaf55-4375-4ffe-b009-e07a43e281b7","Type":"ContainerStarted","Data":"68633b0cb2aeb5f971502b8bc6ae9a70dd58816eb67d0be85dcfcb88fb5c319e"}
Jun 09 15:41:07.749034 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.749017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h7slj" event={"ID":"de628c55-ab74-4e39-bfe1-e8267fba5d14","Type":"ContainerStarted","Data":"2df70cf5240fda57434f3ac92c4d5221466577fcaaf9ddd954ac5bac72d947b1"}
Jun 09 15:41:07.750402 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.750381    2576 generic.go:356] "Generic (PLEG): container finished" podID="fa226fc2d2c5f842f452b30ccab5b919" containerID="a59bbd33d862a0e71ee721b856e37dddbb0beac5ad8572988f60f28865956e5c" exitCode=0
Jun 09 15:41:07.750498 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.750412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerDied","Data":"a59bbd33d862a0e71ee721b856e37dddbb0beac5ad8572988f60f28865956e5c"}
Jun 09 15:41:07.755664 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.755625    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nvsms" podStartSLOduration=3.133829572 podStartE2EDuration="22.755613328s" totalImagesPullingTime="19.621783756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:07.755076159 +0000 UTC m=+22.633856084" watchObservedRunningTime="2026-06-09 15:41:07.755613328 +0000 UTC m=+22.634393262"
Jun 09 15:41:07.774290 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.774250    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-668ct" podStartSLOduration=3.146869406 podStartE2EDuration="22.774238658s" totalImagesPullingTime="19.627369252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:07.774146613 +0000 UTC m=+22.652926548" watchObservedRunningTime="2026-06-09 15:41:07.774238658 +0000 UTC m=+22.653018592"
Jun 09 15:41:07.800650 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.800608    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-73.ec2.internal" podStartSLOduration=21.80059103 podStartE2EDuration="21.80059103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:07.800266301 +0000 UTC m=+22.679046245" watchObservedRunningTime="2026-06-09 15:41:07.80059103 +0000 UTC m=+22.679370965"
Jun 09 15:41:07.843305 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.843077    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h7slj" podStartSLOduration=2.9365232949999998 podStartE2EDuration="22.843060698s" totalImagesPullingTime="19.906537403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:07.842520376 +0000 UTC m=+22.721300312" watchObservedRunningTime="2026-06-09 15:41:07.843060698 +0000 UTC m=+22.721840631"
Jun 09 15:41:07.856068 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:07.856022    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nzm45" podStartSLOduration=3.238162477 podStartE2EDuration="22.855981934s" totalImagesPullingTime="19.617819457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:07.855933022 +0000 UTC m=+22.734712968" watchObservedRunningTime="2026-06-09 15:41:07.855981934 +0000 UTC m=+22.734761869"
Jun 09 15:41:08.593679 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.593636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:08.593935 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:08.593772    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:08.593935 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.593833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:08.594080 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:08.593967    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:08.755082 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.755045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rflf" event={"ID":"6bf7f958-f112-4bd3-951d-082cbc9e8f2e","Type":"ContainerStarted","Data":"2bc3efa817f718a5f80a18b494c87c4db8fa3d510df86c9d6e4b522782c43217"}
Jun 09 15:41:08.758386 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.758306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" event={"ID":"fa226fc2d2c5f842f452b30ccab5b919","Type":"ContainerStarted","Data":"ed860da003e076c1e8266d5b173c0802821a446c323cb012a849c689688f1f0d"}
Jun 09 15:41:08.769363 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.769305    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7rflf" podStartSLOduration=4.157233405 podStartE2EDuration="23.769287142s" totalImagesPullingTime="19.612053737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:08.769136957 +0000 UTC m=+23.647916891" watchObservedRunningTime="2026-06-09 15:41:08.769287142 +0000 UTC m=+23.648067077"
Jun 09 15:41:08.769773 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.769736    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qf9f5" podStartSLOduration=4.134075716 podStartE2EDuration="23.769726105s" totalImagesPullingTime="19.635650389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:07.870130834 +0000 UTC m=+22.748910779" watchObservedRunningTime="2026-06-09 15:41:08.769726105 +0000 UTC m=+23.648506040"
Jun 09 15:41:08.786820 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.786776    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-73.ec2.internal" podStartSLOduration=22.786764412 podStartE2EDuration="22.786764412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:08.786765506 +0000 UTC m=+23.665545491" watchObservedRunningTime="2026-06-09 15:41:08.786764412 +0000 UTC m=+23.665544346"
Jun 09 15:41:08.828067 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:08.828041    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 09 15:41:09.560094 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.560041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:41:09.560714 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.560689    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:41:09.594204 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.594054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:09.594204 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:09.594190    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:09.612805 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.612695    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:41:08.828062722Z","UUID":"b2d0d65d-0751-402f-9215-48d45f21c254","Handler":null,"Name":"","Endpoint":""}
Jun 09 15:41:09.614538 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.614514    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 09 15:41:09.614684 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.614565    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 09 15:41:09.764780 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.764699    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:41:09.766066 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.766034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"804a56771726f3df364640413acc881e9f3f0f047315abd2d9947c440ff1f776"}
Jun 09 15:41:09.768618 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.768516    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7" event={"ID":"a0ffaf55-4375-4ffe-b009-e07a43e281b7","Type":"ContainerStarted","Data":"17d220a0bff505f9245407e49281b6d68d8c372be92b4b90e94fbc4b2baad9bc"}
Jun 09 15:41:09.769262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.769226    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:41:09.769572 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:09.769553    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nzm45"
Jun 09 15:41:10.593415 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:10.593381    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:10.593612 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:10.593500    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:10.593612 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:10.593571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:10.593740 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:10.593700    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:10.773121 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:10.773079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7" event={"ID":"a0ffaf55-4375-4ffe-b009-e07a43e281b7","Type":"ContainerStarted","Data":"75145f2da2d08058a367f067c0aedbcaf30b5cb464207537412d39f1c13c1e19"}
Jun 09 15:41:10.790802 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:10.790745    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s8wc7" podStartSLOduration=3.854456493 podStartE2EDuration="25.790724578s" totalImagesPullingTime="21.936268085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:10.790301909 +0000 UTC m=+25.669081844" watchObservedRunningTime="2026-06-09 15:41:10.790724578 +0000 UTC m=+25.669504513"
Jun 09 15:41:11.593573 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:11.593534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:11.593761 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:11.593706    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:11.782116 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:11.781944    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:41:11.782533 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:11.782512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"a502dc5520ceed73dad6f23b4902e3b7eeb0110ed02aa5d17942607158ffc547"}
Jun 09 15:41:11.783094 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:11.783078    2576 scope.go:117] "RemoveContainer" containerID="43f2d2cf69739e157ebb8023634ad11c26ddc89b96feaa77eb0aa276cfe015f0"
Jun 09 15:41:12.593576 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.593547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:12.593576 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.593586    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:12.593788 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:12.593677    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:12.593831 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:12.593794    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:12.786528 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.786496    2576 generic.go:356] "Generic (PLEG): container finished" podID="63bf53bd-bef5-451d-9734-72dca9a94d3b" containerID="022eeb4e33598cf810d38b5b94fa901dc7146c09a7089954a7536c72bb5bfa97" exitCode=0
Jun 09 15:41:12.787234 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.786588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerDied","Data":"022eeb4e33598cf810d38b5b94fa901dc7146c09a7089954a7536c72bb5bfa97"}
Jun 09 15:41:12.792602 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.792586    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:41:12.792967 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.792934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" event={"ID":"199ed6cb-f5f5-4bdd-a422-80c88c583c12","Type":"ContainerStarted","Data":"fbadd2d3a1f018d48e6c3f66913326936a82bf2c410d398165626ee734ec9f4c"}
Jun 09 15:41:12.793079 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.793062    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 09 15:41:12.793284 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.793269    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:41:12.793388 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.793331    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:41:12.808486 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.808452    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:41:12.808629 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.808589    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:41:12.831564 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:12.831513    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" podStartSLOduration=8.151855291 podStartE2EDuration="27.831496903s" totalImagesPullingTime="19.679641612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:12.829853073 +0000 UTC m=+27.708633008" watchObservedRunningTime="2026-06-09 15:41:12.831496903 +0000 UTC m=+27.710276855"
Jun 09 15:41:13.594233 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.594203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:13.594459 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:13.594314    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:13.795716 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.795517    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 09 15:41:13.886875 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.886848    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v69vq"]
Jun 09 15:41:13.887035 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.886970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:13.887103 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:13.887082    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:13.887563 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.887546    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-82cm9"]
Jun 09 15:41:13.887649 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.887619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:13.887708 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:13.887686    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:13.888107 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.888082    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6d92b"]
Jun 09 15:41:13.888217 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:13.888170    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:13.888287 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:13.888239    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:14.799486 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:14.799442    2576 generic.go:356] "Generic (PLEG): container finished" podID="63bf53bd-bef5-451d-9734-72dca9a94d3b" containerID="7b150ad38fa1a665926679b531dcc080e9c98b3568c64f30461c982ca0dfa8a3" exitCode=0
Jun 09 15:41:14.800027 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:14.799560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerDied","Data":"7b150ad38fa1a665926679b531dcc080e9c98b3568c64f30461c982ca0dfa8a3"}
Jun 09 15:41:14.800027 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:14.799634    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 09 15:41:15.594396 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:15.594373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:15.594518 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:15.594466    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:15.594581 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:15.594507    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:15.594581 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:15.594530    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:15.594581 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:15.594540    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:15.594715 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:15.594690    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:16.351576 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:16.351544    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:41:16.352055 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:16.351810    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 09 15:41:16.368805 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:16.368753    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" podUID="199ed6cb-f5f5-4bdd-a422-80c88c583c12" containerName="ovnkube-controller" probeResult="failure" output=""
Jun 09 15:41:16.377244 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:16.377213    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm" podUID="199ed6cb-f5f5-4bdd-a422-80c88c583c12" containerName="ovnkube-controller" probeResult="failure" output=""
Jun 09 15:41:16.806415 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:16.806332    2576 generic.go:356] "Generic (PLEG): container finished" podID="63bf53bd-bef5-451d-9734-72dca9a94d3b" containerID="8ed812a03e861d0c8ea13db01acca10ab898faf97e2d236fc425eff83c7fad1d" exitCode=0
Jun 09 15:41:16.806415 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:16.806373    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerDied","Data":"8ed812a03e861d0c8ea13db01acca10ab898faf97e2d236fc425eff83c7fad1d"}
Jun 09 15:41:17.593826 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:17.593790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:17.594316 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:17.593935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:17.594316 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:17.593946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:17.594316 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:17.593934    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d92b" podUID="1d865fb0-6977-4e46-bcd7-8d98da5ee9b9"
Jun 09 15:41:17.594316 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:17.594073    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:41:17.594316 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:17.594163    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-82cm9" podUID="f31e5939-6be3-4e77-8de7-d83b57d22461"
Jun 09 15:41:18.377862 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:18.377826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:18.378080 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:18.377908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:18.378080 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.377941    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:41:18.378080 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.378023    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:50.377986109 +0000 UTC m=+65.256766047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 15:41:18.378080 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.378034    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 15:41:18.378080 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.378073    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret podName:1d865fb0-6977-4e46-bcd7-8d98da5ee9b9 nodeName:}" failed. No retries permitted until 2026-06-09 15:41:50.378060028 +0000 UTC m=+65.256839940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret") pod "global-pull-secret-syncer-6d92b" (UID: "1d865fb0-6977-4e46-bcd7-8d98da5ee9b9") : object "kube-system"/"original-pull-secret" not registered
Jun 09 15:41:18.479046 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:18.478876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:18.479230 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.479094    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 15:41:18.479230 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.479121    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 15:41:18.479230 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.479135    2576 projected.go:196] Error preparing data for projected volume kube-api-access-tlfc4 for pod openshift-network-diagnostics/network-check-target-82cm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:41:18.479230 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:18.479198    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4 podName:f31e5939-6be3-4e77-8de7-d83b57d22461 nodeName:}" failed. No retries permitted until 2026-06-09 15:41:50.479179059 +0000 UTC m=+65.357958987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tlfc4" (UniqueName: "kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4") pod "network-check-target-82cm9" (UID: "f31e5939-6be3-4e77-8de7-d83b57d22461") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 15:41:19.396759 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.396547    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-73.ec2.internal" event="NodeReady"
Jun 09 15:41:19.397220 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.396882    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 09 15:41:19.440332 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.440247    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nsq8t"]
Jun 09 15:41:19.468092 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.468057    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n5592"]
Jun 09 15:41:19.468259 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.468196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.470974 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.470952    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vp9z4\""
Jun 09 15:41:19.470974 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.470969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 09 15:41:19.471161 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.471014    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 09 15:41:19.487450 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.487425    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nsq8t"]
Jun 09 15:41:19.487570 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.487474    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5592"]
Jun 09 15:41:19.487612 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.487570    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:19.489979 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.489949    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 09 15:41:19.490101 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.490014    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 09 15:41:19.490173 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.489947    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mk4hd\""
Jun 09 15:41:19.490289 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.490270    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 09 15:41:19.585501 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.585464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.585501 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.585506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/426f746c-696c-4582-a3b4-1c78ec6f4349-cert\") pod \"ingress-canary-n5592\" (UID: \"426f746c-696c-4582-a3b4-1c78ec6f4349\") " pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:19.585730 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.585648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54ef7652-cfab-491a-9be5-1f278316e88e-config-volume\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.585777 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.585723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj7xk\" (UniqueName: \"kubernetes.io/projected/54ef7652-cfab-491a-9be5-1f278316e88e-kube-api-access-nj7xk\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.585777 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.585751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ef7652-cfab-491a-9be5-1f278316e88e-tmp-dir\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.585777 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.585767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnsvt\" (UniqueName: \"kubernetes.io/projected/426f746c-696c-4582-a3b4-1c78ec6f4349-kube-api-access-tnsvt\") pod \"ingress-canary-n5592\" (UID: \"426f746c-696c-4582-a3b4-1c78ec6f4349\") " pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:19.593616 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.593588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:19.593761 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.593625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:19.593761 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.593588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:19.596683 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.596468    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 15:41:19.596683 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.596469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8pxvs\""
Jun 09 15:41:19.596683 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.596528    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 15:41:19.596683 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.596536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 15:41:19.596683 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.596529    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mb7d4\""
Jun 09 15:41:19.596683 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.596579    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 15:41:19.687089 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.687050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj7xk\" (UniqueName: \"kubernetes.io/projected/54ef7652-cfab-491a-9be5-1f278316e88e-kube-api-access-nj7xk\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.687285 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.687099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ef7652-cfab-491a-9be5-1f278316e88e-tmp-dir\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.687285 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.687129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnsvt\" (UniqueName: \"kubernetes.io/projected/426f746c-696c-4582-a3b4-1c78ec6f4349-kube-api-access-tnsvt\") pod \"ingress-canary-n5592\" (UID: \"426f746c-696c-4582-a3b4-1c78ec6f4349\") " pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:19.687452 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.687418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.687581 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.687465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/426f746c-696c-4582-a3b4-1c78ec6f4349-cert\") pod \"ingress-canary-n5592\" (UID: \"426f746c-696c-4582-a3b4-1c78ec6f4349\") " pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:19.687581 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.687534    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54ef7652-cfab-491a-9be5-1f278316e88e-tmp-dir\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.687696 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:19.687541    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:41:19.687696 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.687641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54ef7652-cfab-491a-9be5-1f278316e88e-config-volume\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.687792 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:19.687710    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:20.187685333 +0000 UTC m=+35.066465263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:41:19.688235 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.688210    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54ef7652-cfab-491a-9be5-1f278316e88e-config-volume\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.693040 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.692965    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/426f746c-696c-4582-a3b4-1c78ec6f4349-cert\") pod \"ingress-canary-n5592\" (UID: \"426f746c-696c-4582-a3b4-1c78ec6f4349\") " pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:19.695665 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.695618    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj7xk\" (UniqueName: \"kubernetes.io/projected/54ef7652-cfab-491a-9be5-1f278316e88e-kube-api-access-nj7xk\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:19.696030 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.695987    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnsvt\" (UniqueName: \"kubernetes.io/projected/426f746c-696c-4582-a3b4-1c78ec6f4349-kube-api-access-tnsvt\") pod \"ingress-canary-n5592\" (UID: \"426f746c-696c-4582-a3b4-1c78ec6f4349\") " pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:19.796856 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:19.796814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n5592"
Jun 09 15:41:20.191967 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:20.191886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:20.192125 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:20.192075    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:41:20.192179 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:20.192169    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:21.192148082 +0000 UTC m=+36.070928002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:41:21.024379 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:21.024350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n5592"]
Jun 09 15:41:21.073584 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:41:21.073540    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426f746c_696c_4582_a3b4_1c78ec6f4349.slice/crio-40689de1de04f9e0d96831b073019574f8fac783aafc0c63af085887def9ec6d WatchSource:0}: Error finding container 40689de1de04f9e0d96831b073019574f8fac783aafc0c63af085887def9ec6d: Status 404 returned error can't find the container with id 40689de1de04f9e0d96831b073019574f8fac783aafc0c63af085887def9ec6d
Jun 09 15:41:21.200368 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:21.200173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:21.200531 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:21.200290    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:41:21.200531 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:21.200465    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:23.200448975 +0000 UTC m=+38.079228887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:41:21.823197 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:21.823162    2576 generic.go:356] "Generic (PLEG): container finished" podID="63bf53bd-bef5-451d-9734-72dca9a94d3b" containerID="6069d188ed126f9d692752bff5944512779cb347d70db21bc8090b243cdacd91" exitCode=0
Jun 09 15:41:21.823427 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:21.823252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerDied","Data":"6069d188ed126f9d692752bff5944512779cb347d70db21bc8090b243cdacd91"}
Jun 09 15:41:21.824317 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:21.824297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5592" event={"ID":"426f746c-696c-4582-a3b4-1c78ec6f4349","Type":"ContainerStarted","Data":"40689de1de04f9e0d96831b073019574f8fac783aafc0c63af085887def9ec6d"}
Jun 09 15:41:22.831070 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:22.831026    2576 generic.go:356] "Generic (PLEG): container finished" podID="63bf53bd-bef5-451d-9734-72dca9a94d3b" containerID="86f2db3eef09e8b0f1ffe74e439b31c0e69557b19f3aa82e8c5274ef8801a837" exitCode=0
Jun 09 15:41:22.831547 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:22.831083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerDied","Data":"86f2db3eef09e8b0f1ffe74e439b31c0e69557b19f3aa82e8c5274ef8801a837"}
Jun 09 15:41:23.216890 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:23.216858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:23.217078 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:23.216982    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:41:23.217078 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:23.217073    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:27.217057996 +0000 UTC m=+42.095837908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:41:23.837141 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:23.837106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jrv58" event={"ID":"63bf53bd-bef5-451d-9734-72dca9a94d3b","Type":"ContainerStarted","Data":"a4b519c21302f702a927be8a04590f0781f060a4742c3f00d251aec44b196f15"}
Jun 09 15:41:23.839006 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:23.838964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n5592" event={"ID":"426f746c-696c-4582-a3b4-1c78ec6f4349","Type":"ContainerStarted","Data":"45731dfc6647dd651935915ab5ed060b8a8921a97b0e51434ae9f8ca02a6e34a"}
Jun 09 15:41:23.860525 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:23.860428    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jrv58" podStartSLOduration=8.946856802 podStartE2EDuration="38.8604084s" totalImagesPullingTime="29.913551598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:23.859171167 +0000 UTC m=+38.737951102" watchObservedRunningTime="2026-06-09 15:41:23.8604084 +0000 UTC m=+38.739188336"
Jun 09 15:41:23.875666 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:23.875611    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n5592" podStartSLOduration=2.966025795 podStartE2EDuration="4.87559555s" totalImagesPullingTime="1.909569755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:23.875068443 +0000 UTC m=+38.753848379" watchObservedRunningTime="2026-06-09 15:41:23.87559555 +0000 UTC m=+38.754375507"
Jun 09 15:41:27.246539 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:27.246498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:27.246962 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:27.246655    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:41:27.246962 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:27.246719    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:35.246705092 +0000 UTC m=+50.125485007 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:41:31.676504 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.676470    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"]
Jun 09 15:41:31.710490 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.710460    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"]
Jun 09 15:41:31.710659 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.710565    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.713310 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.713286    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 09 15:41:31.713466 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.713344    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 09 15:41:31.714228 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.714211    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 09 15:41:31.714343 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.714251    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 09 15:41:31.879456 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.879423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73795a71-51d1-425f-9dae-6bdc59852fde-tmp\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.879635 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.879477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/73795a71-51d1-425f-9dae-6bdc59852fde-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.879635 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.879555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gbq5\" (UniqueName: \"kubernetes.io/projected/73795a71-51d1-425f-9dae-6bdc59852fde-kube-api-access-2gbq5\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.980337 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.980291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gbq5\" (UniqueName: \"kubernetes.io/projected/73795a71-51d1-425f-9dae-6bdc59852fde-kube-api-access-2gbq5\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.980504 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.980383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73795a71-51d1-425f-9dae-6bdc59852fde-tmp\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.980504 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.980425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/73795a71-51d1-425f-9dae-6bdc59852fde-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.980779 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.980760    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73795a71-51d1-425f-9dae-6bdc59852fde-tmp\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.984343 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.984326    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/73795a71-51d1-425f-9dae-6bdc59852fde-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:31.988567 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:31.988545    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gbq5\" (UniqueName: \"kubernetes.io/projected/73795a71-51d1-425f-9dae-6bdc59852fde-kube-api-access-2gbq5\") pod \"klusterlet-addon-workmgr-5c89b5c9c9-4bcx2\" (UID: \"73795a71-51d1-425f-9dae-6bdc59852fde\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:32.020297 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:32.020266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:32.172367 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:32.172261    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"]
Jun 09 15:41:32.175125 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:41:32.175097    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73795a71_51d1_425f_9dae_6bdc59852fde.slice/crio-3e280fa05779d38058fdd1383afe3cecd7ab4244d3286db8ce219ea757639f28 WatchSource:0}: Error finding container 3e280fa05779d38058fdd1383afe3cecd7ab4244d3286db8ce219ea757639f28: Status 404 returned error can't find the container with id 3e280fa05779d38058fdd1383afe3cecd7ab4244d3286db8ce219ea757639f28
Jun 09 15:41:32.861025 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:32.860973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2" event={"ID":"73795a71-51d1-425f-9dae-6bdc59852fde","Type":"ContainerStarted","Data":"3e280fa05779d38058fdd1383afe3cecd7ab4244d3286db8ce219ea757639f28"}
Jun 09 15:41:35.304927 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:35.304881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:35.305380 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:35.305067    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:41:35.305380 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:35.305148    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:41:51.305126219 +0000 UTC m=+66.183906154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:41:37.876162 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:37.876125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2" event={"ID":"73795a71-51d1-425f-9dae-6bdc59852fde","Type":"ContainerStarted","Data":"7697d46674e3b270458943b60095b61c8c7ad05dc42718091c77ee87cd1a3164"}
Jun 09 15:41:37.876587 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:37.876347    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:37.877927 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:37.877906    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:41:37.895548 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:37.895500    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2" podStartSLOduration=1.979764463 podStartE2EDuration="6.895486479s" totalImagesPullingTime="4.915722016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:37.894666045 +0000 UTC m=+52.773445990" watchObservedRunningTime="2026-06-09 15:41:37.895486479 +0000 UTC m=+52.774266412"
Jun 09 15:41:46.378949 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:46.378911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pqzgm"
Jun 09 15:41:50.415981 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.415933    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:50.416435 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.416031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:41:50.419376 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.419355    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 15:41:50.419763 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.419746    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 15:41:50.426757 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:50.426736    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 15:41:50.426856 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:50.426828    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:42:54.426813233 +0000 UTC m=+129.305593146 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : secret "metrics-daemon-secret" not found
Jun 09 15:41:50.428945 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.428923    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d865fb0-6977-4e46-bcd7-8d98da5ee9b9-original-pull-secret\") pod \"global-pull-secret-syncer-6d92b\" (UID: \"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9\") " pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:50.512802 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.512758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d92b"
Jun 09 15:41:50.517294 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.517274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:50.520051 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.520027    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 15:41:50.530442 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.530423    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 15:41:50.540932 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.540902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlfc4\" (UniqueName: \"kubernetes.io/projected/f31e5939-6be3-4e77-8de7-d83b57d22461-kube-api-access-tlfc4\") pod \"network-check-target-82cm9\" (UID: \"f31e5939-6be3-4e77-8de7-d83b57d22461\") " pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:50.647931 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.647898    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6d92b"]
Jun 09 15:41:50.650664 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:41:50.650634    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d865fb0_6977_4e46_bcd7_8d98da5ee9b9.slice/crio-0d44bcbde204318a36b42c546922ec61bbdee16b4b0cec2e5bf786e754301522 WatchSource:0}: Error finding container 0d44bcbde204318a36b42c546922ec61bbdee16b4b0cec2e5bf786e754301522: Status 404 returned error can't find the container with id 0d44bcbde204318a36b42c546922ec61bbdee16b4b0cec2e5bf786e754301522
Jun 09 15:41:50.807742 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.807710    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8pxvs\""
Jun 09 15:41:50.815850 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.815831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:50.913343 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.913308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6d92b" event={"ID":"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9","Type":"ContainerStarted","Data":"0d44bcbde204318a36b42c546922ec61bbdee16b4b0cec2e5bf786e754301522"}
Jun 09 15:41:50.936516 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:50.936484    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-82cm9"]
Jun 09 15:41:50.939811 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:41:50.939786    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf31e5939_6be3_4e77_8de7_d83b57d22461.slice/crio-f25e317cbf352ffdfc44ccbdf74f701aa49d6b5c2b8f127a5f88df0672c1c542 WatchSource:0}: Error finding container f25e317cbf352ffdfc44ccbdf74f701aa49d6b5c2b8f127a5f88df0672c1c542: Status 404 returned error can't find the container with id f25e317cbf352ffdfc44ccbdf74f701aa49d6b5c2b8f127a5f88df0672c1c542
Jun 09 15:41:51.321982 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:51.321942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:41:51.322182 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:51.322125    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:41:51.322260 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:41:51.322220    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:42:23.322197609 +0000 UTC m=+98.200977526 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:41:51.918579 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:51.918508    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-82cm9" event={"ID":"f31e5939-6be3-4e77-8de7-d83b57d22461","Type":"ContainerStarted","Data":"f25e317cbf352ffdfc44ccbdf74f701aa49d6b5c2b8f127a5f88df0672c1c542"}
Jun 09 15:41:55.930016 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:55.929882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6d92b" event={"ID":"1d865fb0-6977-4e46-bcd7-8d98da5ee9b9","Type":"ContainerStarted","Data":"4bbb0c4f331c0268003317f7c5de5ca5c9eed4008b04dbcf0e19863eecea189f"}
Jun 09 15:41:55.931459 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:55.931436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-82cm9" event={"ID":"f31e5939-6be3-4e77-8de7-d83b57d22461","Type":"ContainerStarted","Data":"727e8872f43469d7dfe6d099aa7a95457f971a441ce541ebc32e41b4b78fc3e2"}
Jun 09 15:41:55.931558 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:55.931491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:41:55.945284 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:55.945226    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6d92b" podStartSLOduration=66.136796436 podStartE2EDuration="1m10.945210734s" totalImagesPullingTime="4.808414298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:55.944910567 +0000 UTC m=+70.823690502" watchObservedRunningTime="2026-06-09 15:41:55.945210734 +0000 UTC m=+70.823990668"
Jun 09 15:41:55.958815 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:41:55.958761    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-82cm9" podStartSLOduration=66.449934596 podStartE2EDuration="1m10.958745346s" totalImagesPullingTime="4.50881075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:41:55.958576661 +0000 UTC m=+70.837356596" watchObservedRunningTime="2026-06-09 15:41:55.958745346 +0000 UTC m=+70.837525280"
Jun 09 15:42:23.342888 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:42:23.342851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:42:23.343261 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:42:23.342979    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:42:23.343261 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:42:23.343052    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:43:27.343036762 +0000 UTC m=+162.221816674 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:42:26.937304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:42:26.937268    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-82cm9"
Jun 09 15:42:54.452657 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:42:54.452621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:42:54.453239 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:42:54.452752    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 15:42:54.453239 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:42:54.452833    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs podName:75782ece-32fd-45d1-9d86-38283259fd4e nodeName:}" failed. No retries permitted until 2026-06-09 15:44:56.452811662 +0000 UTC m=+251.331591582 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs") pod "network-metrics-daemon-v69vq" (UID: "75782ece-32fd-45d1-9d86-38283259fd4e") : secret "metrics-daemon-secret" not found
Jun 09 15:43:22.479123 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:22.479055    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nsq8t" podUID="54ef7652-cfab-491a-9be5-1f278316e88e"
Jun 09 15:43:22.618482 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:22.618442    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v69vq" podUID="75782ece-32fd-45d1-9d86-38283259fd4e"
Jun 09 15:43:23.141423 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:23.141392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:43:27.378268 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:27.378212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:43:27.378684 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:27.378374    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 15:43:27.378684 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:27.378442    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls podName:54ef7652-cfab-491a-9be5-1f278316e88e nodeName:}" failed. No retries permitted until 2026-06-09 15:45:29.378425913 +0000 UTC m=+284.257205825 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls") pod "dns-default-nsq8t" (UID: "54ef7652-cfab-491a-9be5-1f278316e88e") : secret "dns-default-metrics-tls" not found
Jun 09 15:43:33.593638 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:33.593549    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:43:37.877589 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:37.877541    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2" podUID="73795a71-51d1-425f-9dae-6bdc59852fde" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jun 09 15:43:38.177162 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:38.177070    2576 generic.go:356] "Generic (PLEG): container finished" podID="73795a71-51d1-425f-9dae-6bdc59852fde" containerID="7697d46674e3b270458943b60095b61c8c7ad05dc42718091c77ee87cd1a3164" exitCode=1
Jun 09 15:43:38.177162 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:38.177150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2" event={"ID":"73795a71-51d1-425f-9dae-6bdc59852fde","Type":"ContainerDied","Data":"7697d46674e3b270458943b60095b61c8c7ad05dc42718091c77ee87cd1a3164"}
Jun 09 15:43:38.177507 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:38.177492    2576 scope.go:117] "RemoveContainer" containerID="7697d46674e3b270458943b60095b61c8c7ad05dc42718091c77ee87cd1a3164"
Jun 09 15:43:39.181276 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:39.181238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2" event={"ID":"73795a71-51d1-425f-9dae-6bdc59852fde","Type":"ContainerStarted","Data":"2ea270671c5ee8accef0fb359d2f3f5cce9ebd6a9feca633ade0cc4bd29f13f0"}
Jun 09 15:43:39.181788 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:39.181526    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:43:39.182181 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:39.182165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c89b5c9c9-4bcx2"
Jun 09 15:43:48.164790 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.164754    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-868d757bc6-nj9zw"]
Jun 09 15:43:48.167649 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.167629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.171072 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.171050    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 09 15:43:48.171573 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.171553    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-twc2n\""
Jun 09 15:43:48.172473 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.172454    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 09 15:43:48.172791 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.172772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 09 15:43:48.190872 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.190835    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 09 15:43:48.204064 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.204030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-868d757bc6-nj9zw"]
Jun 09 15:43:48.247825 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.247787    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"]
Jun 09 15:43:48.250583 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.250560    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"]
Jun 09 15:43:48.250706 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.250689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.253100 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.253080    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 09 15:43:48.253375 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.253353    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 09 15:43:48.253626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.253610    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 09 15:43:48.253715 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.253671    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 09 15:43:48.253779 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.253725    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ztftq\""
Jun 09 15:43:48.254016 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.253986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:48.256269 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.256225    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fxt7v\""
Jun 09 15:43:48.256269 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.256237    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 09 15:43:48.257128 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.257098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 09 15:43:48.260912 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.260888    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"]
Jun 09 15:43:48.275770 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.275743    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"]
Jun 09 15:43:48.320448 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-image-registry-private-configuration\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.320448 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-trusted-ca\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.320682 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-installation-pull-secrets\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.320682 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.320682 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-ca-trust-extracted\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.320682 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-certificates\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.320682 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-bound-sa-token\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.320857 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.320683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgnkw\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-kube-api-access-bgnkw\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.344967 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.344929    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"]
Jun 09 15:43:48.349194 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.349172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.351438 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.351417    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 09 15:43:48.351581 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.351419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 09 15:43:48.351829 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.351815    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 09 15:43:48.353225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.353207    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 09 15:43:48.353225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.353221    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bwbwb\""
Jun 09 15:43:48.356978 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.356958    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"]
Jun 09 15:43:48.421915 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.421827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-ca-trust-extracted\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.421915 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.421868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46c596e3-7815-4b6e-a479-acf7f667a7f3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:48.421915 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.421905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-certificates\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.421924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-bound-sa-token\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.421942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.421961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/760bb045-5532-42f6-96fa-eb27892063d2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.421983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgnkw\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-kube-api-access-bgnkw\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8hz8\" (UniqueName: \"kubernetes.io/projected/760bb045-5532-42f6-96fa-eb27892063d2-kube-api-access-b8hz8\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-image-registry-private-configuration\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-trusted-ca\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-installation-pull-secrets\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/760bb045-5532-42f6-96fa-eb27892063d2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.422215 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422686 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422294    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-ca-trust-extracted\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.422686 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.422310    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 15:43:48.422686 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.422325    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868d757bc6-nj9zw: secret "image-registry-tls" not found
Jun 09 15:43:48.422686 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.422378    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls podName:cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d nodeName:}" failed. No retries permitted until 2026-06-09 15:43:48.922360795 +0000 UTC m=+183.801140725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls") pod "image-registry-868d757bc6-nj9zw" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d") : secret "image-registry-tls" not found
Jun 09 15:43:48.422890 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.422739    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-certificates\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.423087 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.423068    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-trusted-ca\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.424608 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.424586    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-image-registry-private-configuration\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.424707 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.424687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-installation-pull-secrets\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.430756 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.430730    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgnkw\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-kube-api-access-bgnkw\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.430853 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.430837    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-bound-sa-token\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.523102 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:48.523102 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/760bb045-5532-42f6-96fa-eb27892063d2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.523299 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8hz8\" (UniqueName: \"kubernetes.io/projected/760bb045-5532-42f6-96fa-eb27892063d2-kube-api-access-b8hz8\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.523299 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6j6k\" (UniqueName: \"kubernetes.io/projected/062c33bf-1a1f-4d12-a100-26e631b4bc0c-kube-api-access-n6j6k\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.523299 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/760bb045-5532-42f6-96fa-eb27892063d2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.523299 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.523210    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 09 15:43:48.523299 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46c596e3-7815-4b6e-a479-acf7f667a7f3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:48.523299 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.523297    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert podName:46c596e3-7815-4b6e-a479-acf7f667a7f3 nodeName:}" failed. No retries permitted until 2026-06-09 15:43:49.023276513 +0000 UTC m=+183.902056444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-f5xjv" (UID: "46c596e3-7815-4b6e-a479-acf7f667a7f3") : secret "networking-console-plugin-cert" not found
Jun 09 15:43:48.523559 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/062c33bf-1a1f-4d12-a100-26e631b4bc0c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.523559 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.523811 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523778    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/760bb045-5532-42f6-96fa-eb27892063d2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.523921 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.523868    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/46c596e3-7815-4b6e-a479-acf7f667a7f3-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:48.525398 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.525378    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/760bb045-5532-42f6-96fa-eb27892063d2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.530953 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.530931    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8hz8\" (UniqueName: \"kubernetes.io/projected/760bb045-5532-42f6-96fa-eb27892063d2-kube-api-access-b8hz8\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-5nkcs\" (UID: \"760bb045-5532-42f6-96fa-eb27892063d2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.562050 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.562017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"
Jun 09 15:43:48.625056 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.624652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/062c33bf-1a1f-4d12-a100-26e631b4bc0c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.625056 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.624701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.625056 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.624795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6j6k\" (UniqueName: \"kubernetes.io/projected/062c33bf-1a1f-4d12-a100-26e631b4bc0c-kube-api-access-n6j6k\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.625347 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.625115    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:48.625347 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.625225    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls podName:062c33bf-1a1f-4d12-a100-26e631b4bc0c nodeName:}" failed. No retries permitted until 2026-06-09 15:43:49.125202107 +0000 UTC m=+184.003982020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s4xmr" (UID: "062c33bf-1a1f-4d12-a100-26e631b4bc0c") : secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:48.625867 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.625845    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/062c33bf-1a1f-4d12-a100-26e631b4bc0c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.632975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.632944    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6j6k\" (UniqueName: \"kubernetes.io/projected/062c33bf-1a1f-4d12-a100-26e631b4bc0c-kube-api-access-n6j6k\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:48.684384 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.684339    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs"]
Jun 09 15:43:48.686731 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:43:48.686696    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760bb045_5532_42f6_96fa_eb27892063d2.slice/crio-cbca08a1830bafdfaf607778afaac39f4b4fe2b2813a02cf4c65f018d5c660a0 WatchSource:0}: Error finding container cbca08a1830bafdfaf607778afaac39f4b4fe2b2813a02cf4c65f018d5c660a0: Status 404 returned error can't find the container with id cbca08a1830bafdfaf607778afaac39f4b4fe2b2813a02cf4c65f018d5c660a0
Jun 09 15:43:48.927937 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:48.927893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:48.928131 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.928084    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 15:43:48.928131 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.928104    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868d757bc6-nj9zw: secret "image-registry-tls" not found
Jun 09 15:43:48.928208 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:48.928164    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls podName:cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d nodeName:}" failed. No retries permitted until 2026-06-09 15:43:49.928147455 +0000 UTC m=+184.806927367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls") pod "image-registry-868d757bc6-nj9zw" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d") : secret "image-registry-tls" not found
Jun 09 15:43:49.029212 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:49.029157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:49.029390 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:49.029291    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 09 15:43:49.029390 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:49.029344    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert podName:46c596e3-7815-4b6e-a479-acf7f667a7f3 nodeName:}" failed. No retries permitted until 2026-06-09 15:43:50.029330729 +0000 UTC m=+184.908110642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-f5xjv" (UID: "46c596e3-7815-4b6e-a479-acf7f667a7f3") : secret "networking-console-plugin-cert" not found
Jun 09 15:43:49.129971 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:49.129922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:49.130160 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:49.130096    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:49.130245 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:49.130168    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls podName:062c33bf-1a1f-4d12-a100-26e631b4bc0c nodeName:}" failed. No retries permitted until 2026-06-09 15:43:50.130148161 +0000 UTC m=+185.008928078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s4xmr" (UID: "062c33bf-1a1f-4d12-a100-26e631b4bc0c") : secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:49.210475 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:49.210428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs" event={"ID":"760bb045-5532-42f6-96fa-eb27892063d2","Type":"ContainerStarted","Data":"cbca08a1830bafdfaf607778afaac39f4b4fe2b2813a02cf4c65f018d5c660a0"}
Jun 09 15:43:49.938130 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:49.938084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:49.938317 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:49.938263    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 15:43:49.938317 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:49.938287    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868d757bc6-nj9zw: secret "image-registry-tls" not found
Jun 09 15:43:49.938401 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:49.938360    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls podName:cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d nodeName:}" failed. No retries permitted until 2026-06-09 15:43:51.938338037 +0000 UTC m=+186.817117952 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls") pod "image-registry-868d757bc6-nj9zw" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d") : secret "image-registry-tls" not found
Jun 09 15:43:50.038848 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:50.038803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:50.039052 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:50.038962    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 09 15:43:50.039123 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:50.039063    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert podName:46c596e3-7815-4b6e-a479-acf7f667a7f3 nodeName:}" failed. No retries permitted until 2026-06-09 15:43:52.039042626 +0000 UTC m=+186.917822550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-f5xjv" (UID: "46c596e3-7815-4b6e-a479-acf7f667a7f3") : secret "networking-console-plugin-cert" not found
Jun 09 15:43:50.139686 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:50.139655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:50.139849 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:50.139817    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:50.139910 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:50.139899    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls podName:062c33bf-1a1f-4d12-a100-26e631b4bc0c nodeName:}" failed. No retries permitted until 2026-06-09 15:43:52.139882218 +0000 UTC m=+187.018662133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s4xmr" (UID: "062c33bf-1a1f-4d12-a100-26e631b4bc0c") : secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:51.218316 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:51.218274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs" event={"ID":"760bb045-5532-42f6-96fa-eb27892063d2","Type":"ContainerStarted","Data":"81981e46f3d1ef1ba7d26fe8b7a1984347f45ab28c1ff6561aaf724ff4177995"}
Jun 09 15:43:51.235488 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:51.235434    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs" podStartSLOduration=1.119964868 podStartE2EDuration="3.235417248s" totalImagesPullingTime="2.11545238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:43:51.234238787 +0000 UTC m=+186.113018732" watchObservedRunningTime="2026-06-09 15:43:51.235417248 +0000 UTC m=+186.114197182"
Jun 09 15:43:51.956253 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:51.956210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:51.956436 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:51.956362    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 15:43:51.956436 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:51.956384    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868d757bc6-nj9zw: secret "image-registry-tls" not found
Jun 09 15:43:51.956516 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:51.956441    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls podName:cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d nodeName:}" failed. No retries permitted until 2026-06-09 15:43:55.95642563 +0000 UTC m=+190.835205542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls") pod "image-registry-868d757bc6-nj9zw" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d") : secret "image-registry-tls" not found
Jun 09 15:43:52.057506 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:52.057462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:52.057680 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:52.057627    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 09 15:43:52.057727 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:52.057701    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert podName:46c596e3-7815-4b6e-a479-acf7f667a7f3 nodeName:}" failed. No retries permitted until 2026-06-09 15:43:56.057684474 +0000 UTC m=+190.936464391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-f5xjv" (UID: "46c596e3-7815-4b6e-a479-acf7f667a7f3") : secret "networking-console-plugin-cert" not found
Jun 09 15:43:52.158374 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:52.158333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:52.158550 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:52.158510    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:52.158615 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:52.158592    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls podName:062c33bf-1a1f-4d12-a100-26e631b4bc0c nodeName:}" failed. No retries permitted until 2026-06-09 15:43:56.158570207 +0000 UTC m=+191.037350120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s4xmr" (UID: "062c33bf-1a1f-4d12-a100-26e631b4bc0c") : secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:53.473400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.473362    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"]
Jun 09 15:43:53.476563 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.476538    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"
Jun 09 15:43:53.479408 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.479357    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 09 15:43:53.479408 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.479362    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 09 15:43:53.480352 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.480333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ckq6q\""
Jun 09 15:43:53.483772 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.483743    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"]
Jun 09 15:43:53.671273 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.671230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpjg\" (UniqueName: \"kubernetes.io/projected/d7529792-d9a4-4380-96b1-f4af1122c15c-kube-api-access-dtpjg\") pod \"migrator-955ffdf5f-8k9l6\" (UID: \"d7529792-d9a4-4380-96b1-f4af1122c15c\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"
Jun 09 15:43:53.772061 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.771961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpjg\" (UniqueName: \"kubernetes.io/projected/d7529792-d9a4-4380-96b1-f4af1122c15c-kube-api-access-dtpjg\") pod \"migrator-955ffdf5f-8k9l6\" (UID: \"d7529792-d9a4-4380-96b1-f4af1122c15c\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"
Jun 09 15:43:53.780865 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.780833    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpjg\" (UniqueName: \"kubernetes.io/projected/d7529792-d9a4-4380-96b1-f4af1122c15c-kube-api-access-dtpjg\") pod \"migrator-955ffdf5f-8k9l6\" (UID: \"d7529792-d9a4-4380-96b1-f4af1122c15c\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"
Jun 09 15:43:53.785708 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.785686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"
Jun 09 15:43:53.908019 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:53.907916    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6"]
Jun 09 15:43:53.910542 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:43:53.910512    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7529792_d9a4_4380_96b1_f4af1122c15c.slice/crio-d7c823601609b8b5b145372a452cf10adff01293160be689469360d854c9d600 WatchSource:0}: Error finding container d7c823601609b8b5b145372a452cf10adff01293160be689469360d854c9d600: Status 404 returned error can't find the container with id d7c823601609b8b5b145372a452cf10adff01293160be689469360d854c9d600
Jun 09 15:43:54.232314 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:54.232274    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6" event={"ID":"d7529792-d9a4-4380-96b1-f4af1122c15c","Type":"ContainerStarted","Data":"d7c823601609b8b5b145372a452cf10adff01293160be689469360d854c9d600"}
Jun 09 15:43:55.087282 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:55.087247    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nvsms_678d5149-004b-438d-80ed-6785d48fa41e/dns-node-resolver/0.log"
Jun 09 15:43:55.236878 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:55.236843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6" event={"ID":"d7529792-d9a4-4380-96b1-f4af1122c15c","Type":"ContainerStarted","Data":"969e2c2f72e8cfd06be9a499f6aea8adca5113e2e36e8a207c5312a34e630693"}
Jun 09 15:43:55.237078 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:55.236908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6" event={"ID":"d7529792-d9a4-4380-96b1-f4af1122c15c","Type":"ContainerStarted","Data":"41160d592933cd6992c7c99daf51af57af139741eb76bcc58de4f5a633dcf041"}
Jun 09 15:43:55.253690 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:55.253632    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8k9l6" podStartSLOduration=1.074314403 podStartE2EDuration="2.253615832s" totalImagesPullingTime="1.179301429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:43:55.252708918 +0000 UTC m=+190.131488854" watchObservedRunningTime="2026-06-09 15:43:55.253615832 +0000 UTC m=+190.132395766"
Jun 09 15:43:55.986686 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:55.986653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:43:55.986855 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:55.986782    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 15:43:55.986855 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:55.986796    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-868d757bc6-nj9zw: secret "image-registry-tls" not found
Jun 09 15:43:55.986855 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:55.986838    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls podName:cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d nodeName:}" failed. No retries permitted until 2026-06-09 15:44:03.986824716 +0000 UTC m=+198.865604627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls") pod "image-registry-868d757bc6-nj9zw" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d") : secret "image-registry-tls" not found
Jun 09 15:43:56.088081 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:56.088022    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:43:56.088452 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:56.088157    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 09 15:43:56.088452 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:56.088226    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert podName:46c596e3-7815-4b6e-a479-acf7f667a7f3 nodeName:}" failed. No retries permitted until 2026-06-09 15:44:04.088208398 +0000 UTC m=+198.966988310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-f5xjv" (UID: "46c596e3-7815-4b6e-a479-acf7f667a7f3") : secret "networking-console-plugin-cert" not found
Jun 09 15:43:56.188937 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:56.188876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:43:56.189159 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:56.189055    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:56.189159 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:43:56.189116    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls podName:062c33bf-1a1f-4d12-a100-26e631b4bc0c nodeName:}" failed. No retries permitted until 2026-06-09 15:44:04.189101365 +0000 UTC m=+199.067881277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-s4xmr" (UID: "062c33bf-1a1f-4d12-a100-26e631b4bc0c") : secret "cluster-monitoring-operator-tls" not found
Jun 09 15:43:56.488531 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:56.488504    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qf9f5_3157c15f-0b54-4002-b43c-863bdfcd6861/node-ca/0.log"
Jun 09 15:43:56.887185 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:43:56.887075    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5592_426f746c-696c-4582-a3b4-1c78ec6f4349/serve-healthcheck-canary/0.log"
Jun 09 15:44:04.047848 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.047791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:44:04.050163 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.050141    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"image-registry-868d757bc6-nj9zw\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") " pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:44:04.076095 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.076054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:44:04.148327 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.148298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:44:04.148478 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:44:04.148414    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 09 15:44:04.148478 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:44:04.148475    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert podName:46c596e3-7815-4b6e-a479-acf7f667a7f3 nodeName:}" failed. No retries permitted until 2026-06-09 15:44:20.148458119 +0000 UTC m=+215.027238032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-f5xjv" (UID: "46c596e3-7815-4b6e-a479-acf7f667a7f3") : secret "networking-console-plugin-cert" not found
Jun 09 15:44:04.198393 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.198363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-868d757bc6-nj9zw"]
Jun 09 15:44:04.201566 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:04.201530    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf42a012_d6fb_4a3a_8f11_ebb7b8a0d16d.slice/crio-f1223f38df893ef4777cecac36646bab302a012ac094b054d1a3d49e1c65d8b6 WatchSource:0}: Error finding container f1223f38df893ef4777cecac36646bab302a012ac094b054d1a3d49e1c65d8b6: Status 404 returned error can't find the container with id f1223f38df893ef4777cecac36646bab302a012ac094b054d1a3d49e1c65d8b6
Jun 09 15:44:04.249592 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.249565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:44:04.251702 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.251681    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/062c33bf-1a1f-4d12-a100-26e631b4bc0c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-s4xmr\" (UID: \"062c33bf-1a1f-4d12-a100-26e631b4bc0c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:44:04.258306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.258292    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"
Jun 09 15:44:04.264201 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.264174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" event={"ID":"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d","Type":"ContainerStarted","Data":"9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd"}
Jun 09 15:44:04.264282 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.264228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" event={"ID":"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d","Type":"ContainerStarted","Data":"f1223f38df893ef4777cecac36646bab302a012ac094b054d1a3d49e1c65d8b6"}
Jun 09 15:44:04.264352 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.264283    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:44:04.281652 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.281593    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" podStartSLOduration=16.281571935 podStartE2EDuration="16.281571935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:04.28120228 +0000 UTC m=+199.159982214" watchObservedRunningTime="2026-06-09 15:44:04.281571935 +0000 UTC m=+199.160351870"
Jun 09 15:44:04.381480 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:04.381451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr"]
Jun 09 15:44:04.385108 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:04.385074    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062c33bf_1a1f_4d12_a100_26e631b4bc0c.slice/crio-5bca0ce6b658a61d26370ce6e57d15d407fd53a2fcbc3bc39beca3c4d27b9a5c WatchSource:0}: Error finding container 5bca0ce6b658a61d26370ce6e57d15d407fd53a2fcbc3bc39beca3c4d27b9a5c: Status 404 returned error can't find the container with id 5bca0ce6b658a61d26370ce6e57d15d407fd53a2fcbc3bc39beca3c4d27b9a5c
Jun 09 15:44:05.269030 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:05.268982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr" event={"ID":"062c33bf-1a1f-4d12-a100-26e631b4bc0c","Type":"ContainerStarted","Data":"5bca0ce6b658a61d26370ce6e57d15d407fd53a2fcbc3bc39beca3c4d27b9a5c"}
Jun 09 15:44:06.273519 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:06.273479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr" event={"ID":"062c33bf-1a1f-4d12-a100-26e631b4bc0c","Type":"ContainerStarted","Data":"10021b0a2d36cebb995ef4a83263c7c41a28dd5079634e83ddaa4187f2237f2b"}
Jun 09 15:44:06.291233 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:06.291182    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-s4xmr" podStartSLOduration=16.552833346 podStartE2EDuration="18.291167103s" totalImagesPullingTime="1.738333757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:06.290189621 +0000 UTC m=+201.168969570" watchObservedRunningTime="2026-06-09 15:44:06.291167103 +0000 UTC m=+201.169947037"
Jun 09 15:44:13.948006 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.947947    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-868d757bc6-nj9zw"]
Jun 09 15:44:13.952727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.952690    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"]
Jun 09 15:44:13.958713 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.958690    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2dmfq"]
Jun 09 15:44:13.959073 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.959048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"
Jun 09 15:44:13.961942 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.961921    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 09 15:44:13.962078 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.961921    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k46j5\""
Jun 09 15:44:13.963104 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.963086    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"]
Jun 09 15:44:13.963200 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.963164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:13.965699 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.965677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 09 15:44:13.965907 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.965884    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 09 15:44:13.966026 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.965968    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4kn8z\""
Jun 09 15:44:13.966091 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.966024    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 09 15:44:13.966375 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.966352    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 09 15:44:13.974013 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.973971    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2dmfq"]
Jun 09 15:44:13.992563 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.992539    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b5c897d58-br47x"]
Jun 09 15:44:13.996444 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:13.996423    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.008744 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.008721    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5c897d58-br47x"]
Jun 09 15:44:14.024315 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c38b47d9-51a4-42e9-a19f-53e0397435b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.024414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c38b47d9-51a4-42e9-a19f-53e0397435b3-data-volume\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.024414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c43c75b-9f9a-4f67-84f0-546d0d82938a-ca-trust-extracted\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.024486 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c43c75b-9f9a-4f67-84f0-546d0d82938a-trusted-ca\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.024525 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-bound-sa-token\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.024558 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c43c75b-9f9a-4f67-84f0-546d0d82938a-image-registry-private-configuration\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.024558 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjvf\" (UniqueName: \"kubernetes.io/projected/c38b47d9-51a4-42e9-a19f-53e0397435b3-kube-api-access-xmjvf\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.024620 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/750c929b-6a0c-45ea-966e-c79fbd15d20a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m759z\" (UID: \"750c929b-6a0c-45ea-966e-c79fbd15d20a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"
Jun 09 15:44:14.024620 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-registry-tls\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.024680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbqmk\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-kube-api-access-qbqmk\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.024680 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c38b47d9-51a4-42e9-a19f-53e0397435b3-crio-socket\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.024736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c43c75b-9f9a-4f67-84f0-546d0d82938a-registry-certificates\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.024736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c38b47d9-51a4-42e9-a19f-53e0397435b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.024736 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.024721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c43c75b-9f9a-4f67-84f0-546d0d82938a-installation-pull-secrets\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125059 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c43c75b-9f9a-4f67-84f0-546d0d82938a-image-registry-private-configuration\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125059 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjvf\" (UniqueName: \"kubernetes.io/projected/c38b47d9-51a4-42e9-a19f-53e0397435b3-kube-api-access-xmjvf\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/750c929b-6a0c-45ea-966e-c79fbd15d20a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m759z\" (UID: \"750c929b-6a0c-45ea-966e-c79fbd15d20a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-registry-tls\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqmk\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-kube-api-access-qbqmk\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c38b47d9-51a4-42e9-a19f-53e0397435b3-crio-socket\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c43c75b-9f9a-4f67-84f0-546d0d82938a-registry-certificates\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c38b47d9-51a4-42e9-a19f-53e0397435b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c43c75b-9f9a-4f67-84f0-546d0d82938a-installation-pull-secrets\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c38b47d9-51a4-42e9-a19f-53e0397435b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.125306 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c38b47d9-51a4-42e9-a19f-53e0397435b3-data-volume\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.125755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c43c75b-9f9a-4f67-84f0-546d0d82938a-ca-trust-extracted\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c43c75b-9f9a-4f67-84f0-546d0d82938a-trusted-ca\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-bound-sa-token\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.125755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125290    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c38b47d9-51a4-42e9-a19f-53e0397435b3-crio-socket\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.125961 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125937    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c43c75b-9f9a-4f67-84f0-546d0d82938a-ca-trust-extracted\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.126040 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.125976    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c38b47d9-51a4-42e9-a19f-53e0397435b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.126245 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.126217    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c43c75b-9f9a-4f67-84f0-546d0d82938a-registry-certificates\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.126553 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.126530    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c38b47d9-51a4-42e9-a19f-53e0397435b3-data-volume\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.127099 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.127074    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c43c75b-9f9a-4f67-84f0-546d0d82938a-trusted-ca\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.127952 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.127928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c43c75b-9f9a-4f67-84f0-546d0d82938a-image-registry-private-configuration\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.128069 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.127928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c43c75b-9f9a-4f67-84f0-546d0d82938a-installation-pull-secrets\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.128129 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.128075    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-registry-tls\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.128592 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.128568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c38b47d9-51a4-42e9-a19f-53e0397435b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.128681 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.128664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/750c929b-6a0c-45ea-966e-c79fbd15d20a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-m759z\" (UID: \"750c929b-6a0c-45ea-966e-c79fbd15d20a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"
Jun 09 15:44:14.136364 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.136329    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-bound-sa-token\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.136785 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.136767    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbqmk\" (UniqueName: \"kubernetes.io/projected/3c43c75b-9f9a-4f67-84f0-546d0d82938a-kube-api-access-qbqmk\") pod \"image-registry-b5c897d58-br47x\" (UID: \"3c43c75b-9f9a-4f67-84f0-546d0d82938a\") " pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.137061 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.137039    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjvf\" (UniqueName: \"kubernetes.io/projected/c38b47d9-51a4-42e9-a19f-53e0397435b3-kube-api-access-xmjvf\") pod \"insights-runtime-extractor-2dmfq\" (UID: \"c38b47d9-51a4-42e9-a19f-53e0397435b3\") " pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.270499 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.270414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"
Jun 09 15:44:14.275543 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.275514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2dmfq"
Jun 09 15:44:14.304900 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.304867    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:14.449761 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.449736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5c897d58-br47x"]
Jun 09 15:44:14.452133 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:14.452106    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c43c75b_9f9a_4f67_84f0_546d0d82938a.slice/crio-bb0c4dbf1981c3532270e614741bd2061ee3aa3a2df822b04a42bf5af697aa76 WatchSource:0}: Error finding container bb0c4dbf1981c3532270e614741bd2061ee3aa3a2df822b04a42bf5af697aa76: Status 404 returned error can't find the container with id bb0c4dbf1981c3532270e614741bd2061ee3aa3a2df822b04a42bf5af697aa76
Jun 09 15:44:14.626262 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.626196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"]
Jun 09 15:44:14.629171 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:14.629142    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750c929b_6a0c_45ea_966e_c79fbd15d20a.slice/crio-b7ff0ca342317d07cd6cc3e16584a98563db0fb14e10923ea78c2476114b09d5 WatchSource:0}: Error finding container b7ff0ca342317d07cd6cc3e16584a98563db0fb14e10923ea78c2476114b09d5: Status 404 returned error can't find the container with id b7ff0ca342317d07cd6cc3e16584a98563db0fb14e10923ea78c2476114b09d5
Jun 09 15:44:14.629550 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:14.629525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2dmfq"]
Jun 09 15:44:14.632445 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:14.632420    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38b47d9_51a4_42e9_a19f_53e0397435b3.slice/crio-9859b70f6e51c545baf5f1703b95a40d99e3b0d46ad598fce61a8c1e66382353 WatchSource:0}: Error finding container 9859b70f6e51c545baf5f1703b95a40d99e3b0d46ad598fce61a8c1e66382353: Status 404 returned error can't find the container with id 9859b70f6e51c545baf5f1703b95a40d99e3b0d46ad598fce61a8c1e66382353
Jun 09 15:44:15.304707 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.304663    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dmfq" event={"ID":"c38b47d9-51a4-42e9-a19f-53e0397435b3","Type":"ContainerStarted","Data":"d86a06d4ebe0f8f23c3a05bac7ce0ee780864b5b2500c99055e3d1741090a064"}
Jun 09 15:44:15.305177 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.304744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dmfq" event={"ID":"c38b47d9-51a4-42e9-a19f-53e0397435b3","Type":"ContainerStarted","Data":"c941c41d30bb57bab112cfbd9ca9ae4703a1973a3f9e561d54a6ef3515224d8f"}
Jun 09 15:44:15.305177 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.304777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dmfq" event={"ID":"c38b47d9-51a4-42e9-a19f-53e0397435b3","Type":"ContainerStarted","Data":"9859b70f6e51c545baf5f1703b95a40d99e3b0d46ad598fce61a8c1e66382353"}
Jun 09 15:44:15.306111 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.306079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z" event={"ID":"750c929b-6a0c-45ea-966e-c79fbd15d20a","Type":"ContainerStarted","Data":"b7ff0ca342317d07cd6cc3e16584a98563db0fb14e10923ea78c2476114b09d5"}
Jun 09 15:44:15.307536 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.307505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5c897d58-br47x" event={"ID":"3c43c75b-9f9a-4f67-84f0-546d0d82938a","Type":"ContainerStarted","Data":"885729358edd64530fdc0cca32e6b8aec17336759d210bd637b8cf1edc9998fb"}
Jun 09 15:44:15.307650 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.307551    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5c897d58-br47x" event={"ID":"3c43c75b-9f9a-4f67-84f0-546d0d82938a","Type":"ContainerStarted","Data":"bb0c4dbf1981c3532270e614741bd2061ee3aa3a2df822b04a42bf5af697aa76"}
Jun 09 15:44:15.307650 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.307611    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:15.327338 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:15.327280    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podStartSLOduration=2.32726193 podStartE2EDuration="2.32726193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:15.326134448 +0000 UTC m=+210.204914384" watchObservedRunningTime="2026-06-09 15:44:15.32726193 +0000 UTC m=+210.206041841"
Jun 09 15:44:16.313166 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.313118    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z" event={"ID":"750c929b-6a0c-45ea-966e-c79fbd15d20a","Type":"ContainerStarted","Data":"e3b15769b8c882d6dc7f3a17abced81a01f1affd26de7edfb4f97f0acd95a23b"}
Jun 09 15:44:16.313623 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.313217    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"
Jun 09 15:44:16.318381 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.318355    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z"
Jun 09 15:44:16.327737 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.327680    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-m759z" podStartSLOduration=2.358505909 podStartE2EDuration="3.32766487s" totalImagesPullingTime="969.158961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:16.326749855 +0000 UTC m=+211.205529790" watchObservedRunningTime="2026-06-09 15:44:16.32766487 +0000 UTC m=+211.206444844"
Jun 09 15:44:16.671460 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.671381    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"]
Jun 09 15:44:16.674422 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.674407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.677933 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.677905    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 09 15:44:16.678064 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.677908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2j45x\""
Jun 09 15:44:16.678064 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.677913    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 09 15:44:16.678064 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.677917    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 09 15:44:16.682827 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.682801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"]
Jun 09 15:44:16.749740 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.749709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5jjm\" (UniqueName: \"kubernetes.io/projected/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-kube-api-access-s5jjm\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.749852 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.749742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.749852 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.749770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.749920 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.749857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.851056 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.851012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.851235 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.851113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5jjm\" (UniqueName: \"kubernetes.io/projected/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-kube-api-access-s5jjm\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.851235 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.851136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.851235 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.851161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.851235 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:44:16.851163    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 09 15:44:16.851381 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:44:16.851261    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-tls podName:1d4f592a-7167-4a89-8927-6c4ba23d5a6c nodeName:}" failed. No retries permitted until 2026-06-09 15:44:17.351242128 +0000 UTC m=+212.230022042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-pvc9q" (UID: "1d4f592a-7167-4a89-8927-6c4ba23d5a6c") : secret "prometheus-operator-tls" not found
Jun 09 15:44:16.851776 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.851754    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.853533 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.853516    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:16.859845 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:16.859822    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5jjm\" (UniqueName: \"kubernetes.io/projected/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-kube-api-access-s5jjm\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:17.318650 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:17.318611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dmfq" event={"ID":"c38b47d9-51a4-42e9-a19f-53e0397435b3","Type":"ContainerStarted","Data":"e3cf132c7c491bb6eb235d92bd72800252d61423afc6b36dc3b0e1bafd6208db"}
Jun 09 15:44:17.335309 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:17.335261    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2dmfq" podStartSLOduration=2.386794799 podStartE2EDuration="4.335246892s" totalImagesPullingTime="1.948452093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:44:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:17.334227121 +0000 UTC m=+212.213007056" watchObservedRunningTime="2026-06-09 15:44:17.335246892 +0000 UTC m=+212.214026827"
Jun 09 15:44:17.356398 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:17.356372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:17.358762 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:17.358738    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1d4f592a-7167-4a89-8927-6c4ba23d5a6c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pvc9q\" (UID: \"1d4f592a-7167-4a89-8927-6c4ba23d5a6c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:17.584260 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:17.584164    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"
Jun 09 15:44:17.710770 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:17.710741    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q"]
Jun 09 15:44:17.713085 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:17.713055    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4f592a_7167_4a89_8927_6c4ba23d5a6c.slice/crio-3bf2f70a7ede5fff7e91f648df81052bff87b42e1ac2cb9c232f353014b3dba0 WatchSource:0}: Error finding container 3bf2f70a7ede5fff7e91f648df81052bff87b42e1ac2cb9c232f353014b3dba0: Status 404 returned error can't find the container with id 3bf2f70a7ede5fff7e91f648df81052bff87b42e1ac2cb9c232f353014b3dba0
Jun 09 15:44:18.323685 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:18.323641    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q" event={"ID":"1d4f592a-7167-4a89-8927-6c4ba23d5a6c","Type":"ContainerStarted","Data":"3bf2f70a7ede5fff7e91f648df81052bff87b42e1ac2cb9c232f353014b3dba0"}
Jun 09 15:44:20.180834 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:20.180800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:44:20.183341 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:20.183310    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46c596e3-7815-4b6e-a479-acf7f667a7f3-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-f5xjv\" (UID: \"46c596e3-7815-4b6e-a479-acf7f667a7f3\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:44:20.331809 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:20.331771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q" event={"ID":"1d4f592a-7167-4a89-8927-6c4ba23d5a6c","Type":"ContainerStarted","Data":"385d3037a3ee88df296c373103a2e3616e096ca39dd0fb5e4ebed0643d768e3b"}
Jun 09 15:44:20.331980 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:20.331823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q" event={"ID":"1d4f592a-7167-4a89-8927-6c4ba23d5a6c","Type":"ContainerStarted","Data":"7375b52d679a6a1a584bb299424890ed447f2f0043ca12fbff7159e70d146807"}
Jun 09 15:44:20.347875 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:20.347825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pvc9q" podStartSLOduration=2.772886525 podStartE2EDuration="4.347807624s" totalImagesPullingTime="1.574921099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:20.346857213 +0000 UTC m=+215.225637147" watchObservedRunningTime="2026-06-09 15:44:20.347807624 +0000 UTC m=+215.226587558"
Jun 09 15:44:20.368123 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:20.368093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"
Jun 09 15:44:20.503586 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:20.503552    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv"]
Jun 09 15:44:20.506829 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:20.506800    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c596e3_7815_4b6e_a479_acf7f667a7f3.slice/crio-0714cb0a22e15ac49f61437c8391aa116c0246cae1ad4e8880fac74b8b29ae46 WatchSource:0}: Error finding container 0714cb0a22e15ac49f61437c8391aa116c0246cae1ad4e8880fac74b8b29ae46: Status 404 returned error can't find the container with id 0714cb0a22e15ac49f61437c8391aa116c0246cae1ad4e8880fac74b8b29ae46
Jun 09 15:44:21.336843 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:21.336807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv" event={"ID":"46c596e3-7815-4b6e-a479-acf7f667a7f3","Type":"ContainerStarted","Data":"0714cb0a22e15ac49f61437c8391aa116c0246cae1ad4e8880fac74b8b29ae46"}
Jun 09 15:44:22.035313 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.035282    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8dqxh"]
Jun 09 15:44:22.039051 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.039034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.041355 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.041331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 09 15:44:22.041830 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.041803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lsfjc\""
Jun 09 15:44:22.042207 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.042100    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 09 15:44:22.043628 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.043609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 09 15:44:22.096741 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zh79\" (UniqueName: \"kubernetes.io/projected/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-kube-api-access-9zh79\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096741 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-metrics-client-ca\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096741 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-textfile\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096971 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096971 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-root\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096971 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096971 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-sys\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096971 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-tls\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.096971 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.096938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-wtmp\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.197679 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-metrics-client-ca\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.197887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-textfile\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.197887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.197887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-root\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.197887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197812    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.197887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-sys\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.197887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-tls\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-wtmp\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zh79\" (UniqueName: \"kubernetes.io/projected/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-kube-api-access-9zh79\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.197972    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-root\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.198069    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-sys\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:44:22.198011    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.198134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-wtmp\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:44:22.198154    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-tls podName:235572fd-a4ef-425a-a42a-d0a86f8ec2d2 nodeName:}" failed. No retries permitted until 2026-06-09 15:44:22.698134439 +0000 UTC m=+217.576914351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-tls") pod "node-exporter-8dqxh" (UID: "235572fd-a4ef-425a-a42a-d0a86f8ec2d2") : secret "node-exporter-tls" not found
Jun 09 15:44:22.198219 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.198179    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-textfile\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198543 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.198384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-metrics-client-ca\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.198543 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.198394    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.200172 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.200149    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.207872 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.207848    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zh79\" (UniqueName: \"kubernetes.io/projected/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-kube-api-access-9zh79\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.342226 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.342184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv" event={"ID":"46c596e3-7815-4b6e-a479-acf7f667a7f3","Type":"ContainerStarted","Data":"d98009e67da568331657743080e75e94462b29089677dee2f8dc83bd8db0231c"}
Jun 09 15:44:22.357562 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.357454    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-f5xjv" podStartSLOduration=33.043196355 podStartE2EDuration="34.357437816s" totalImagesPullingTime="1.314241461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:22.356149393 +0000 UTC m=+217.234929327" watchObservedRunningTime="2026-06-09 15:44:22.357437816 +0000 UTC m=+217.236217769"
Jun 09 15:44:22.702487 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.702451    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-tls\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.704727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.704698    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/235572fd-a4ef-425a-a42a-d0a86f8ec2d2-node-exporter-tls\") pod \"node-exporter-8dqxh\" (UID: \"235572fd-a4ef-425a-a42a-d0a86f8ec2d2\") " pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.949355 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:22.949313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dqxh"
Jun 09 15:44:22.960960 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:22.960928    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235572fd_a4ef_425a_a42a_d0a86f8ec2d2.slice/crio-156f12480d80e63878eddda80364028e26591e2455e09add9e9c1f5b52ceb0cd WatchSource:0}: Error finding container 156f12480d80e63878eddda80364028e26591e2455e09add9e9c1f5b52ceb0cd: Status 404 returned error can't find the container with id 156f12480d80e63878eddda80364028e26591e2455e09add9e9c1f5b52ceb0cd
Jun 09 15:44:23.355314 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:23.355266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dqxh" event={"ID":"235572fd-a4ef-425a-a42a-d0a86f8ec2d2","Type":"ContainerStarted","Data":"156f12480d80e63878eddda80364028e26591e2455e09add9e9c1f5b52ceb0cd"}
Jun 09 15:44:23.954457 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:23.954432    2576 patch_prober.go:28] interesting pod/image-registry-868d757bc6-nj9zw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:23.954536 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:23.954478    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" podUID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:24.359982 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:24.359895    2576 generic.go:356] "Generic (PLEG): container finished" podID="235572fd-a4ef-425a-a42a-d0a86f8ec2d2" containerID="b90851dc6f03de4b6b5a652bf8efcec5db070bff0a775e9b0e4dea0281aef898" exitCode=0
Jun 09 15:44:24.359982 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:24.359944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dqxh" event={"ID":"235572fd-a4ef-425a-a42a-d0a86f8ec2d2","Type":"ContainerDied","Data":"b90851dc6f03de4b6b5a652bf8efcec5db070bff0a775e9b0e4dea0281aef898"}
Jun 09 15:44:25.365218 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:25.365183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dqxh" event={"ID":"235572fd-a4ef-425a-a42a-d0a86f8ec2d2","Type":"ContainerStarted","Data":"98dad11f56825da52b2c523d815bd46e541af9c21527eea98a6d157ed38ccfa9"}
Jun 09 15:44:25.365608 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:25.365236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dqxh" event={"ID":"235572fd-a4ef-425a-a42a-d0a86f8ec2d2","Type":"ContainerStarted","Data":"64ba8a10f96e0dc07430d97cce70dd35d2596a4d379b3f2cfa5309dce67d0683"}
Jun 09 15:44:25.388650 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:25.388599    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8dqxh" podStartSLOduration=2.340484252 podStartE2EDuration="3.388583129s" totalImagesPullingTime="983.357524ms" totalInitContainerRuntime="64.741353ms" isStatefulPod=true podCreationTimestamp="2026-06-09 15:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:25.386742515 +0000 UTC m=+220.265522448" watchObservedRunningTime="2026-06-09 15:44:25.388583129 +0000 UTC m=+220.267363095"
Jun 09 15:44:32.030887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.030853    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554cc84ff6-zhkpx"]
Jun 09 15:44:32.033937 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.033920    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.037630 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037602    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 09 15:44:32.037630 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037625    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 09 15:44:32.037829 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037610    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 09 15:44:32.037829 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037644    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 09 15:44:32.037829 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037694    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 09 15:44:32.037829 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037702    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 09 15:44:32.037829 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037629    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8gzl\""
Jun 09 15:44:32.038014 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.037980    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 09 15:44:32.041575 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.041554    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 09 15:44:32.045735 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.045714    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554cc84ff6-zhkpx"]
Jun 09 15:44:32.181552 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.181497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-trusted-ca-bundle\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.181552 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.181548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-oauth-config\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.181552 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.181569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g59w4\" (UniqueName: \"kubernetes.io/projected/7595ca88-f108-4655-9d47-1c0a8c1715d5-kube-api-access-g59w4\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.181834 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.181671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-config\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.181834 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.181720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-service-ca\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.181834 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.181745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-oauth-serving-cert\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.181834 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.181782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-serving-cert\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.282871 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.282770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-config\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.282871 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.282838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-service-ca\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.282871 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.282864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-oauth-serving-cert\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283181 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.282898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-serving-cert\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283181 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.283061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-trusted-ca-bundle\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283181 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.283094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-oauth-config\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283181 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.283121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g59w4\" (UniqueName: \"kubernetes.io/projected/7595ca88-f108-4655-9d47-1c0a8c1715d5-kube-api-access-g59w4\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283587 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.283557    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-config\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283701 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.283650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-oauth-serving-cert\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283701 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.283650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-service-ca\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.283880 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.283861    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-trusted-ca-bundle\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.285831 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.285806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-oauth-config\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.285948 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.285931    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-serving-cert\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.290606 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.290585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g59w4\" (UniqueName: \"kubernetes.io/projected/7595ca88-f108-4655-9d47-1c0a8c1715d5-kube-api-access-g59w4\") pod \"console-554cc84ff6-zhkpx\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") " pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.343347 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.343312    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:32.468174 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:32.468141    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554cc84ff6-zhkpx"]
Jun 09 15:44:32.471150 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:32.471118    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7595ca88_f108_4655_9d47_1c0a8c1715d5.slice/crio-3fdefc8ad51c617239d97712a2f17b287a3639a18fc6a85c95a5279af837f4f2 WatchSource:0}: Error finding container 3fdefc8ad51c617239d97712a2f17b287a3639a18fc6a85c95a5279af837f4f2: Status 404 returned error can't find the container with id 3fdefc8ad51c617239d97712a2f17b287a3639a18fc6a85c95a5279af837f4f2
Jun 09 15:44:33.393028 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:33.392973    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cc84ff6-zhkpx" event={"ID":"7595ca88-f108-4655-9d47-1c0a8c1715d5","Type":"ContainerStarted","Data":"3fdefc8ad51c617239d97712a2f17b287a3639a18fc6a85c95a5279af837f4f2"}
Jun 09 15:44:33.954386 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:33.954347    2576 patch_prober.go:28] interesting pod/image-registry-868d757bc6-nj9zw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:33.954546 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:33.954409    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" podUID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:34.310479 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:34.310391    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:34.310479 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:34.310449    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:35.401273 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:35.401185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cc84ff6-zhkpx" event={"ID":"7595ca88-f108-4655-9d47-1c0a8c1715d5","Type":"ContainerStarted","Data":"e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd"}
Jun 09 15:44:35.417889 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:35.417834    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554cc84ff6-zhkpx" podStartSLOduration=0.805273501 podStartE2EDuration="3.417817707s" totalImagesPullingTime="2.612544206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:35.416510244 +0000 UTC m=+230.295290179" watchObservedRunningTime="2026-06-09 15:44:35.417817707 +0000 UTC m=+230.296597640"
Jun 09 15:44:36.317595 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:36.317555    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:36.317792 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:36.317621    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:38.971173 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:38.971117    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" podUID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" containerName="registry" containerID="cri-o://9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd" gracePeriod=30
Jun 09 15:44:39.213411 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.213387    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:44:39.340138 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340038    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-bound-sa-token\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340138 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340107    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-image-registry-private-configuration\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340138 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340140    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340364 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgnkw\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-kube-api-access-bgnkw\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340364 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340239    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-trusted-ca\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340364 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340265    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-ca-trust-extracted\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340504 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340387    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-installation-pull-secrets\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340504 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-certificates\") pod \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\" (UID: \"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d\") "
Jun 09 15:44:39.340839 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.340809    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:44:39.341182 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.341153    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:44:39.342672 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.342619    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-kube-api-access-bgnkw" (OuterVolumeSpecName: "kube-api-access-bgnkw") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "kube-api-access-bgnkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:44:39.342759 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.342662    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:44:39.342759 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.342676    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:44:39.342910 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.342884    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:44:39.342910 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.342900    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:44:39.348775 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.348752    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" (UID: "cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 15:44:39.417774 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.417736    2576 generic.go:356] "Generic (PLEG): container finished" podID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" containerID="9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd" exitCode=0
Jun 09 15:44:39.417922 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.417782    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw"
Jun 09 15:44:39.417922 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.417824    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" event={"ID":"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d","Type":"ContainerDied","Data":"9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd"}
Jun 09 15:44:39.417922 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.417901    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868d757bc6-nj9zw" event={"ID":"cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d","Type":"ContainerDied","Data":"f1223f38df893ef4777cecac36646bab302a012ac094b054d1a3d49e1c65d8b6"}
Jun 09 15:44:39.417922 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.417922    2576 scope.go:117] "RemoveContainer" containerID="9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd"
Jun 09 15:44:39.425938 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.425921    2576 scope.go:117] "RemoveContainer" containerID="9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd"
Jun 09 15:44:39.426230 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:44:39.426211    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd\": container with ID starting with 9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd not found: ID does not exist" containerID="9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd"
Jun 09 15:44:39.426278 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.426239    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd"} err="failed to get container status \"9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd\": rpc error: code = NotFound desc = could not find container \"9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd\": container with ID starting with 9f31919b8d4a17f855404730274bd2aaa6913775e01d1ae3d144ac38a52ceabd not found: ID does not exist"
Jun 09 15:44:39.437286 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.437265    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-868d757bc6-nj9zw"]
Jun 09 15:44:39.441425 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441401    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-868d757bc6-nj9zw"]
Jun 09 15:44:39.441555 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441535    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-bound-sa-token\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.441630 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441562    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-image-registry-private-configuration\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.441630 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441579    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.441630 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441592    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgnkw\" (UniqueName: \"kubernetes.io/projected/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-kube-api-access-bgnkw\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.441630 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441606    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-trusted-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.441630 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441620    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-ca-trust-extracted\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.441788 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441633    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-installation-pull-secrets\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.441788 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.441646    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d-registry-certificates\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:44:39.598152 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:39.598064    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" path="/var/lib/kubelet/pods/cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d/volumes"
Jun 09 15:44:42.343804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:42.343764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:42.344324 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:42.343830    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:44:42.345192 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:42.345171    2576 patch_prober.go:28] interesting pod/console-554cc84ff6-zhkpx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body=
Jun 09 15:44:42.345264 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:42.345215    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-554cc84ff6-zhkpx" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused"
Jun 09 15:44:44.309925 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:44.309888    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:44.310352 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:44.309967    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:46.317256 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:46.317219    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:46.317716 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:46.317276    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:52.343987 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:52.343949    2576 patch_prober.go:28] interesting pod/console-554cc84ff6-zhkpx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body=
Jun 09 15:44:52.344400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:52.344046    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-554cc84ff6-zhkpx" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused"
Jun 09 15:44:54.309626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:54.309590    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:54.310051 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:54.309641    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:54.310051 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:54.309679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:44:54.310188 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:54.310114    2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"885729358edd64530fdc0cca32e6b8aec17336759d210bd637b8cf1edc9998fb"} pod="openshift-image-registry/image-registry-b5c897d58-br47x" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 09 15:44:54.313654 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:54.313631    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:44:54.313774 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:54.313681    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:44:56.479952 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:56.479918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:44:56.482639 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:56.482605    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75782ece-32fd-45d1-9d86-38283259fd4e-metrics-certs\") pod \"network-metrics-daemon-v69vq\" (UID: \"75782ece-32fd-45d1-9d86-38283259fd4e\") " pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:44:56.697406 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:56.697367    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mb7d4\""
Jun 09 15:44:56.705261 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:56.705227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v69vq"
Jun 09 15:44:56.832054 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:56.832022    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v69vq"]
Jun 09 15:44:56.835359 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:44:56.835330    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75782ece_32fd_45d1_9d86_38283259fd4e.slice/crio-59acf0eb39ce2392468191cdada87d6e09f8efe9d8adae2ae75969d6646b92c1 WatchSource:0}: Error finding container 59acf0eb39ce2392468191cdada87d6e09f8efe9d8adae2ae75969d6646b92c1: Status 404 returned error can't find the container with id 59acf0eb39ce2392468191cdada87d6e09f8efe9d8adae2ae75969d6646b92c1
Jun 09 15:44:57.480112 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:57.480069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v69vq" event={"ID":"75782ece-32fd-45d1-9d86-38283259fd4e","Type":"ContainerStarted","Data":"59acf0eb39ce2392468191cdada87d6e09f8efe9d8adae2ae75969d6646b92c1"}
Jun 09 15:44:58.485458 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:58.485422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v69vq" event={"ID":"75782ece-32fd-45d1-9d86-38283259fd4e","Type":"ContainerStarted","Data":"4f56cf1a39c765457ebd1feac94dccfed29cba975890f3b53e01feedb816373e"}
Jun 09 15:44:58.485839 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:58.485474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v69vq" event={"ID":"75782ece-32fd-45d1-9d86-38283259fd4e","Type":"ContainerStarted","Data":"ff4a1460d4dd05e41608a6c48069304857ef3aeebeb6d280174a48f29481048f"}
Jun 09 15:44:58.501916 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:44:58.501862    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v69vq" podStartSLOduration=252.580262405 podStartE2EDuration="4m13.501846371s" totalImagesPullingTime="921.583966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:44:58.500217821 +0000 UTC m=+253.378997754" watchObservedRunningTime="2026-06-09 15:44:58.501846371 +0000 UTC m=+253.380626313"
Jun 09 15:45:02.344683 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:02.344641    2576 patch_prober.go:28] interesting pod/console-554cc84ff6-zhkpx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body=
Jun 09 15:45:02.345119 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:02.344699    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-554cc84ff6-zhkpx" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused"
Jun 09 15:45:04.313884 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:04.313841    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:45:04.314291 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:04.313902    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:45:06.514069 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:06.514031    2576 generic.go:356] "Generic (PLEG): container finished" podID="760bb045-5532-42f6-96fa-eb27892063d2" containerID="81981e46f3d1ef1ba7d26fe8b7a1984347f45ab28c1ff6561aaf724ff4177995" exitCode=0
Jun 09 15:45:06.514439 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:06.514108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs" event={"ID":"760bb045-5532-42f6-96fa-eb27892063d2","Type":"ContainerDied","Data":"81981e46f3d1ef1ba7d26fe8b7a1984347f45ab28c1ff6561aaf724ff4177995"}
Jun 09 15:45:06.514480 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:06.514447    2576 scope.go:117] "RemoveContainer" containerID="81981e46f3d1ef1ba7d26fe8b7a1984347f45ab28c1ff6561aaf724ff4177995"
Jun 09 15:45:07.520842 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:07.520807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-5nkcs" event={"ID":"760bb045-5532-42f6-96fa-eb27892063d2","Type":"ContainerStarted","Data":"41ab3f76616e0df09dd9bd590baeb15bf393717ddd418a3d032c294c463cf149"}
Jun 09 15:45:12.344392 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:12.344356    2576 patch_prober.go:28] interesting pod/console-554cc84ff6-zhkpx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body=
Jun 09 15:45:12.344795 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:12.344412    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-554cc84ff6-zhkpx" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused"
Jun 09 15:45:14.314729 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:14.314697    2576 patch_prober.go:28] interesting pod/image-registry-b5c897d58-br47x container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 15:45:14.315107 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:14.314751    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 15:45:19.328599 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:19.328550    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b5c897d58-br47x" podUID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerName="registry" containerID="cri-o://885729358edd64530fdc0cca32e6b8aec17336759d210bd637b8cf1edc9998fb" gracePeriod=30
Jun 09 15:45:20.569799 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:20.569760    2576 generic.go:356] "Generic (PLEG): container finished" podID="3c43c75b-9f9a-4f67-84f0-546d0d82938a" containerID="885729358edd64530fdc0cca32e6b8aec17336759d210bd637b8cf1edc9998fb" exitCode=0
Jun 09 15:45:20.569799 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:20.569778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5c897d58-br47x" event={"ID":"3c43c75b-9f9a-4f67-84f0-546d0d82938a","Type":"ContainerDied","Data":"885729358edd64530fdc0cca32e6b8aec17336759d210bd637b8cf1edc9998fb"}
Jun 09 15:45:20.570242 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:20.569833    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5c897d58-br47x" event={"ID":"3c43c75b-9f9a-4f67-84f0-546d0d82938a","Type":"ContainerStarted","Data":"2bc3e335ca49fec5c548538d5357cf36ff46252c0144e5f2e81c3af7cc6a0e2d"}
Jun 09 15:45:20.570242 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:20.569862    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:45:22.343886 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:22.343834    2576 patch_prober.go:28] interesting pod/console-554cc84ff6-zhkpx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body=
Jun 09 15:45:22.344307 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:22.343907    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-554cc84ff6-zhkpx" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused"
Jun 09 15:45:26.142209 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:45:26.142155    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nsq8t" podUID="54ef7652-cfab-491a-9be5-1f278316e88e"
Jun 09 15:45:26.593351 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:26.593322    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:45:27.097098 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:27.097068    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-s4xmr_062c33bf-1a1f-4d12-a100-26e631b4bc0c/cluster-monitoring-operator/0.log"
Jun 09 15:45:28.285154 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:28.285120    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dqxh_235572fd-a4ef-425a-a42a-d0a86f8ec2d2/init-textfile/0.log"
Jun 09 15:45:28.486776 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:28.486739    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dqxh_235572fd-a4ef-425a-a42a-d0a86f8ec2d2/node-exporter/0.log"
Jun 09 15:45:28.687494 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:28.687396    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dqxh_235572fd-a4ef-425a-a42a-d0a86f8ec2d2/kube-rbac-proxy/0.log"
Jun 09 15:45:29.454664 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:29.454628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:45:29.456935 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:29.456911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54ef7652-cfab-491a-9be5-1f278316e88e-metrics-tls\") pod \"dns-default-nsq8t\" (UID: \"54ef7652-cfab-491a-9be5-1f278316e88e\") " pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:45:29.596835 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:29.596807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vp9z4\""
Jun 09 15:45:29.604673 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:29.604653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:45:29.729474 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:29.729397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nsq8t"]
Jun 09 15:45:29.732509 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:45:29.732482    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ef7652_cfab_491a_9be5_1f278316e88e.slice/crio-e0007446beaddab7004826f142a1ab7421cc74e291fac452a31f83eabc858cb3 WatchSource:0}: Error finding container e0007446beaddab7004826f142a1ab7421cc74e291fac452a31f83eabc858cb3: Status 404 returned error can't find the container with id e0007446beaddab7004826f142a1ab7421cc74e291fac452a31f83eabc858cb3
Jun 09 15:45:30.609785 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:30.609744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsq8t" event={"ID":"54ef7652-cfab-491a-9be5-1f278316e88e","Type":"ContainerStarted","Data":"e0007446beaddab7004826f142a1ab7421cc74e291fac452a31f83eabc858cb3"}
Jun 09 15:45:31.615232 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:31.615144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsq8t" event={"ID":"54ef7652-cfab-491a-9be5-1f278316e88e","Type":"ContainerStarted","Data":"d3a99d979f963ecdde28f4eb34bbb159158deaf974b3a6f85ee2d2b993a8820b"}
Jun 09 15:45:31.615232 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:31.615206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nsq8t" event={"ID":"54ef7652-cfab-491a-9be5-1f278316e88e","Type":"ContainerStarted","Data":"8f240dd6109563ba0609355e6bfea8c70c71c0ed04fbf5e191b8c1b496df5c31"}
Jun 09 15:45:31.615617 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:31.615328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:45:31.632639 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:31.632595    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nsq8t" podStartSLOduration=251.021570811 podStartE2EDuration="4m12.632580866s" totalImagesPullingTime="1.611010055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:45:31.631544746 +0000 UTC m=+286.510324680" watchObservedRunningTime="2026-06-09 15:45:31.632580866 +0000 UTC m=+286.511360799"
Jun 09 15:45:32.086964 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:32.086932    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pvc9q_1d4f592a-7167-4a89-8927-6c4ba23d5a6c/prometheus-operator/0.log"
Jun 09 15:45:32.284958 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:32.284924    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pvc9q_1d4f592a-7167-4a89-8927-6c4ba23d5a6c/kube-rbac-proxy/0.log"
Jun 09 15:45:32.347911 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:32.347838    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:45:32.351552 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:32.351531    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:45:32.484600 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:32.484574    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-m759z_750c929b-6a0c-45ea-966e-c79fbd15d20a/prometheus-operator-admission-webhook/0.log"
Jun 09 15:45:33.885816 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:33.885782    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-f5xjv_46c596e3-7815-4b6e-a479-acf7f667a7f3/networking-console-plugin/0.log"
Jun 09 15:45:34.485470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:34.485433    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-554cc84ff6-zhkpx_7595ca88-f108-4655-9d47-1c0a8c1715d5/console/0.log"
Jun 09 15:45:35.885420 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:35.885375    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsq8t_54ef7652-cfab-491a-9be5-1f278316e88e/dns/0.log"
Jun 09 15:45:36.085751 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:36.085721    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsq8t_54ef7652-cfab-491a-9be5-1f278316e88e/kube-rbac-proxy/0.log"
Jun 09 15:45:36.285540 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:36.285508    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nvsms_678d5149-004b-438d-80ed-6785d48fa41e/dns-node-resolver/0.log"
Jun 09 15:45:37.087569 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:37.087532    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b5c897d58-br47x_3c43c75b-9f9a-4f67-84f0-546d0d82938a/registry/0.log"
Jun 09 15:45:37.285275 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:37.285242    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b5c897d58-br47x_3c43c75b-9f9a-4f67-84f0-546d0d82938a/registry/1.log"
Jun 09 15:45:37.884984 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:37.884950    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qf9f5_3157c15f-0b54-4002-b43c-863bdfcd6861/node-ca/0.log"
Jun 09 15:45:38.285443 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:38.285416    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5592_426f746c-696c-4582-a3b4-1c78ec6f4349/serve-healthcheck-canary/0.log"
Jun 09 15:45:41.581217 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:41.581187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b5c897d58-br47x"
Jun 09 15:45:41.622439 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:41.622408    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nsq8t"
Jun 09 15:45:45.542635 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:45.542600    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:45:45.544940 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:45.544916    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:45:45.552021 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:45.551976    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jun 09 15:45:49.521712 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.521662    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f8d9bc6c-rvbwk"]
Jun 09 15:45:49.524344 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.522273    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" containerName="registry"
Jun 09 15:45:49.524344 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.522293    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" containerName="registry"
Jun 09 15:45:49.524344 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.522431    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf42a012-d6fb-4a3a-8f11-ebb7b8a0d16d" containerName="registry"
Jun 09 15:45:49.525891 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.525869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.552416 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.552378    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f8d9bc6c-rvbwk"]
Jun 09 15:45:49.618960 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.618927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-oauth-config\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.619163 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.618983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-oauth-serving-cert\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.619163 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.619046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-serving-cert\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.619163 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.619103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-console-config\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.619163 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.619148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4fq\" (UniqueName: \"kubernetes.io/projected/48495d0b-da6b-471d-952b-cb6ee1d01302-kube-api-access-jh4fq\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.619298 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.619177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-service-ca\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.619298 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.619209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-trusted-ca-bundle\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.719960 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.719920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-oauth-config\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.719960 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.719969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-oauth-serving-cert\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.720307 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.720119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-serving-cert\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.720307 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.720166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-console-config\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.720307 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.720201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4fq\" (UniqueName: \"kubernetes.io/projected/48495d0b-da6b-471d-952b-cb6ee1d01302-kube-api-access-jh4fq\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.720307 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.720249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-service-ca\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.720307 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.720297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-trusted-ca-bundle\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.720833 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.720797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-oauth-serving-cert\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.720968 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.720907    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-console-config\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.721353 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.721328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-trusted-ca-bundle\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.721454 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.721328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-service-ca\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.722529 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.722508    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-oauth-config\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.722678 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.722656    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-serving-cert\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.728287 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.728268    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4fq\" (UniqueName: \"kubernetes.io/projected/48495d0b-da6b-471d-952b-cb6ee1d01302-kube-api-access-jh4fq\") pod \"console-85f8d9bc6c-rvbwk\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") " pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.835259 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.835146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:49.979290 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:49.979254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f8d9bc6c-rvbwk"]
Jun 09 15:45:49.982821 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:45:49.982792    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48495d0b_da6b_471d_952b_cb6ee1d01302.slice/crio-a3ff18d7bfc9de0b32e6c2567f6c793afe682628aef4543637c58f18d96cba0c WatchSource:0}: Error finding container a3ff18d7bfc9de0b32e6c2567f6c793afe682628aef4543637c58f18d96cba0c: Status 404 returned error can't find the container with id a3ff18d7bfc9de0b32e6c2567f6c793afe682628aef4543637c58f18d96cba0c
Jun 09 15:45:50.690660 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:50.690618    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f8d9bc6c-rvbwk" event={"ID":"48495d0b-da6b-471d-952b-cb6ee1d01302","Type":"ContainerStarted","Data":"08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f"}
Jun 09 15:45:50.691178 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:50.690672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f8d9bc6c-rvbwk" event={"ID":"48495d0b-da6b-471d-952b-cb6ee1d01302","Type":"ContainerStarted","Data":"a3ff18d7bfc9de0b32e6c2567f6c793afe682628aef4543637c58f18d96cba0c"}
Jun 09 15:45:50.708550 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:50.708493    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f8d9bc6c-rvbwk" podStartSLOduration=1.7084760829999999 podStartE2EDuration="1.708476083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:45:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:45:50.70689921 +0000 UTC m=+305.585679144" watchObservedRunningTime="2026-06-09 15:45:50.708476083 +0000 UTC m=+305.587256017"
Jun 09 15:45:59.835920 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:59.835880    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:59.836379 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:59.835952    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:45:59.840837 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:45:59.840814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:46:00.733018 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:00.732963    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:46:00.779598 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:00.779567    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554cc84ff6-zhkpx"]
Jun 09 15:46:25.800444 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:25.800401    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-554cc84ff6-zhkpx" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console" containerID="cri-o://e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd" gracePeriod=15
Jun 09 15:46:26.053632 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.053570    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:46:26.102279 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102248    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-trusted-ca-bundle\") pod \"7595ca88-f108-4655-9d47-1c0a8c1715d5\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") "
Jun 09 15:46:26.102461 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102313    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-oauth-serving-cert\") pod \"7595ca88-f108-4655-9d47-1c0a8c1715d5\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") "
Jun 09 15:46:26.102461 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102337    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g59w4\" (UniqueName: \"kubernetes.io/projected/7595ca88-f108-4655-9d47-1c0a8c1715d5-kube-api-access-g59w4\") pod \"7595ca88-f108-4655-9d47-1c0a8c1715d5\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") "
Jun 09 15:46:26.102461 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-service-ca\") pod \"7595ca88-f108-4655-9d47-1c0a8c1715d5\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") "
Jun 09 15:46:26.102461 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102394    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-serving-cert\") pod \"7595ca88-f108-4655-9d47-1c0a8c1715d5\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") "
Jun 09 15:46:26.102461 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102421    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-oauth-config\") pod \"7595ca88-f108-4655-9d47-1c0a8c1715d5\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") "
Jun 09 15:46:26.102461 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102452    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-config\") pod \"7595ca88-f108-4655-9d47-1c0a8c1715d5\" (UID: \"7595ca88-f108-4655-9d47-1c0a8c1715d5\") "
Jun 09 15:46:26.102868 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102834    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7595ca88-f108-4655-9d47-1c0a8c1715d5" (UID: "7595ca88-f108-4655-9d47-1c0a8c1715d5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:46:26.102983 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102860    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7595ca88-f108-4655-9d47-1c0a8c1715d5" (UID: "7595ca88-f108-4655-9d47-1c0a8c1715d5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:46:26.102983 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102873    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-service-ca" (OuterVolumeSpecName: "service-ca") pod "7595ca88-f108-4655-9d47-1c0a8c1715d5" (UID: "7595ca88-f108-4655-9d47-1c0a8c1715d5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:46:26.102983 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.102973    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-config" (OuterVolumeSpecName: "console-config") pod "7595ca88-f108-4655-9d47-1c0a8c1715d5" (UID: "7595ca88-f108-4655-9d47-1c0a8c1715d5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:46:26.104815 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.104788    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7595ca88-f108-4655-9d47-1c0a8c1715d5" (UID: "7595ca88-f108-4655-9d47-1c0a8c1715d5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:46:26.105117 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.105085    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7595ca88-f108-4655-9d47-1c0a8c1715d5" (UID: "7595ca88-f108-4655-9d47-1c0a8c1715d5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:46:26.105117 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.105097    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7595ca88-f108-4655-9d47-1c0a8c1715d5-kube-api-access-g59w4" (OuterVolumeSpecName: "kube-api-access-g59w4") pod "7595ca88-f108-4655-9d47-1c0a8c1715d5" (UID: "7595ca88-f108-4655-9d47-1c0a8c1715d5"). InnerVolumeSpecName "kube-api-access-g59w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:46:26.203691 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.203638    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:46:26.203691 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.203684    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-oauth-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:46:26.203691 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.203697    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-console-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:46:26.203691 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.203707    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:46:26.203983 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.203716    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-oauth-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:46:26.203983 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.203724    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g59w4\" (UniqueName: \"kubernetes.io/projected/7595ca88-f108-4655-9d47-1c0a8c1715d5-kube-api-access-g59w4\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:46:26.203983 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.203733    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7595ca88-f108-4655-9d47-1c0a8c1715d5-service-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:46:26.824607 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.824562    2576 generic.go:356] "Generic (PLEG): container finished" podID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerID="e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd" exitCode=0
Jun 09 15:46:26.825020 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.824613    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554cc84ff6-zhkpx"
Jun 09 15:46:26.825020 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.824626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cc84ff6-zhkpx" event={"ID":"7595ca88-f108-4655-9d47-1c0a8c1715d5","Type":"ContainerDied","Data":"e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd"}
Jun 09 15:46:26.825020 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.824673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554cc84ff6-zhkpx" event={"ID":"7595ca88-f108-4655-9d47-1c0a8c1715d5","Type":"ContainerDied","Data":"3fdefc8ad51c617239d97712a2f17b287a3639a18fc6a85c95a5279af837f4f2"}
Jun 09 15:46:26.825020 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.824697    2576 scope.go:117] "RemoveContainer" containerID="e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd"
Jun 09 15:46:26.833202 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.833185    2576 scope.go:117] "RemoveContainer" containerID="e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd"
Jun 09 15:46:26.833497 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:46:26.833477    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd\": container with ID starting with e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd not found: ID does not exist" containerID="e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd"
Jun 09 15:46:26.833564 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.833505    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd"} err="failed to get container status \"e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd\": rpc error: code = NotFound desc = could not find container \"e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd\": container with ID starting with e15fe5f0b206a5a4d900c5071308911df9a302786d37260eecbf6b64a34d48dd not found: ID does not exist"
Jun 09 15:46:26.845554 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.845522    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554cc84ff6-zhkpx"]
Jun 09 15:46:26.849263 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:26.849238    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554cc84ff6-zhkpx"]
Jun 09 15:46:27.597973 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:46:27.597935    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" path="/var/lib/kubelet/pods/7595ca88-f108-4655-9d47-1c0a8c1715d5/volumes"
Jun 09 15:47:07.333364 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.333318    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64464dd668-xhzp2"]
Jun 09 15:47:07.333981 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.333863    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console"
Jun 09 15:47:07.333981 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.333884    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console"
Jun 09 15:47:07.333981 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.333952    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7595ca88-f108-4655-9d47-1c0a8c1715d5" containerName="console"
Jun 09 15:47:07.336906 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.336883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.347557 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.347515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64464dd668-xhzp2"]
Jun 09 15:47:07.424951 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.424909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-config\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.424951 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.424946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-trusted-ca-bundle\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.425247 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.424966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smvxj\" (UniqueName: \"kubernetes.io/projected/46df66d5-9353-4152-bf4a-ff58a8ff8de6-kube-api-access-smvxj\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.425247 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.425111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-oauth-serving-cert\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.425247 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.425204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-serving-cert\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.425247 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.425236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-service-ca\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.425416 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.425280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-oauth-config\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526092 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-oauth-serving-cert\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-serving-cert\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-service-ca\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-oauth-config\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-config\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-trusted-ca-bundle\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smvxj\" (UniqueName: \"kubernetes.io/projected/46df66d5-9353-4152-bf4a-ff58a8ff8de6-kube-api-access-smvxj\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.526967 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-config\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.527109 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526986    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-service-ca\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.527109 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.526939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-oauth-serving-cert\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.527181 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.527155    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-trusted-ca-bundle\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.528875 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.528843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-serving-cert\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.528961 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.528843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-oauth-config\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.534365 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.534335    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smvxj\" (UniqueName: \"kubernetes.io/projected/46df66d5-9353-4152-bf4a-ff58a8ff8de6-kube-api-access-smvxj\") pod \"console-64464dd668-xhzp2\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") " pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.647670 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.647565    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:07.786164 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.786124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64464dd668-xhzp2"]
Jun 09 15:47:07.790197 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:47:07.790171    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46df66d5_9353_4152_bf4a_ff58a8ff8de6.slice/crio-a88755278fdeaea111a924b1704b001bf58c96db9296c7cccc5b03cf55819ec7 WatchSource:0}: Error finding container a88755278fdeaea111a924b1704b001bf58c96db9296c7cccc5b03cf55819ec7: Status 404 returned error can't find the container with id a88755278fdeaea111a924b1704b001bf58c96db9296c7cccc5b03cf55819ec7
Jun 09 15:47:07.975256 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.975215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64464dd668-xhzp2" event={"ID":"46df66d5-9353-4152-bf4a-ff58a8ff8de6","Type":"ContainerStarted","Data":"f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74"}
Jun 09 15:47:07.975446 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.975271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64464dd668-xhzp2" event={"ID":"46df66d5-9353-4152-bf4a-ff58a8ff8de6","Type":"ContainerStarted","Data":"a88755278fdeaea111a924b1704b001bf58c96db9296c7cccc5b03cf55819ec7"}
Jun 09 15:47:07.993135 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:07.993074    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64464dd668-xhzp2" podStartSLOduration=0.99305408 podStartE2EDuration="993.05408ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:47:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:47:07.990963485 +0000 UTC m=+382.869743419" watchObservedRunningTime="2026-06-09 15:47:07.99305408 +0000 UTC m=+382.871834015"
Jun 09 15:47:17.648498 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:17.648396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:17.648906 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:17.648534    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:17.653411 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:17.653383    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:18.022277 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:18.022246    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:47:18.067435 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:18.067399    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f8d9bc6c-rvbwk"]
Jun 09 15:47:43.087780 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.087732    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85f8d9bc6c-rvbwk" podUID="48495d0b-da6b-471d-952b-cb6ee1d01302" containerName="console" containerID="cri-o://08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f" gracePeriod=15
Jun 09 15:47:43.328134 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.328105    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:47:43.417171 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417078    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-service-ca\") pod \"48495d0b-da6b-471d-952b-cb6ee1d01302\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") "
Jun 09 15:47:43.417171 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417119    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-console-config\") pod \"48495d0b-da6b-471d-952b-cb6ee1d01302\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") "
Jun 09 15:47:43.417171 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-oauth-serving-cert\") pod \"48495d0b-da6b-471d-952b-cb6ee1d01302\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") "
Jun 09 15:47:43.417424 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417194    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh4fq\" (UniqueName: \"kubernetes.io/projected/48495d0b-da6b-471d-952b-cb6ee1d01302-kube-api-access-jh4fq\") pod \"48495d0b-da6b-471d-952b-cb6ee1d01302\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") "
Jun 09 15:47:43.417424 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417236    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-serving-cert\") pod \"48495d0b-da6b-471d-952b-cb6ee1d01302\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") "
Jun 09 15:47:43.417424 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417264    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-trusted-ca-bundle\") pod \"48495d0b-da6b-471d-952b-cb6ee1d01302\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") "
Jun 09 15:47:43.417424 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417298    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-oauth-config\") pod \"48495d0b-da6b-471d-952b-cb6ee1d01302\" (UID: \"48495d0b-da6b-471d-952b-cb6ee1d01302\") "
Jun 09 15:47:43.417634 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417505    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-service-ca" (OuterVolumeSpecName: "service-ca") pod "48495d0b-da6b-471d-952b-cb6ee1d01302" (UID: "48495d0b-da6b-471d-952b-cb6ee1d01302"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:47:43.417634 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417620    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48495d0b-da6b-471d-952b-cb6ee1d01302" (UID: "48495d0b-da6b-471d-952b-cb6ee1d01302"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:47:43.417804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417780    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-console-config" (OuterVolumeSpecName: "console-config") pod "48495d0b-da6b-471d-952b-cb6ee1d01302" (UID: "48495d0b-da6b-471d-952b-cb6ee1d01302"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:47:43.417873 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.417846    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "48495d0b-da6b-471d-952b-cb6ee1d01302" (UID: "48495d0b-da6b-471d-952b-cb6ee1d01302"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:47:43.419496 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.419465    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48495d0b-da6b-471d-952b-cb6ee1d01302" (UID: "48495d0b-da6b-471d-952b-cb6ee1d01302"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:47:43.419601 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.419501    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48495d0b-da6b-471d-952b-cb6ee1d01302-kube-api-access-jh4fq" (OuterVolumeSpecName: "kube-api-access-jh4fq") pod "48495d0b-da6b-471d-952b-cb6ee1d01302" (UID: "48495d0b-da6b-471d-952b-cb6ee1d01302"). InnerVolumeSpecName "kube-api-access-jh4fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:47:43.419639 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.419617    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48495d0b-da6b-471d-952b-cb6ee1d01302" (UID: "48495d0b-da6b-471d-952b-cb6ee1d01302"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:47:43.518509 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.518463    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh4fq\" (UniqueName: \"kubernetes.io/projected/48495d0b-da6b-471d-952b-cb6ee1d01302-kube-api-access-jh4fq\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:47:43.518509 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.518502    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:47:43.518509 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.518511    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:47:43.518509 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.518520    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48495d0b-da6b-471d-952b-cb6ee1d01302-console-oauth-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:47:43.518781 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.518530    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-service-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:47:43.518781 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.518538    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-console-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:47:43.518781 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:43.518545    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48495d0b-da6b-471d-952b-cb6ee1d01302-oauth-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:47:44.113100 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.113061    2576 generic.go:356] "Generic (PLEG): container finished" podID="48495d0b-da6b-471d-952b-cb6ee1d01302" containerID="08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f" exitCode=0
Jun 09 15:47:44.113604 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.113119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f8d9bc6c-rvbwk" event={"ID":"48495d0b-da6b-471d-952b-cb6ee1d01302","Type":"ContainerDied","Data":"08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f"}
Jun 09 15:47:44.113604 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.113134    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f8d9bc6c-rvbwk"
Jun 09 15:47:44.113604 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.113187    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f8d9bc6c-rvbwk" event={"ID":"48495d0b-da6b-471d-952b-cb6ee1d01302","Type":"ContainerDied","Data":"a3ff18d7bfc9de0b32e6c2567f6c793afe682628aef4543637c58f18d96cba0c"}
Jun 09 15:47:44.113604 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.113207    2576 scope.go:117] "RemoveContainer" containerID="08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f"
Jun 09 15:47:44.121425 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.121403    2576 scope.go:117] "RemoveContainer" containerID="08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f"
Jun 09 15:47:44.121745 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:47:44.121725    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f\": container with ID starting with 08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f not found: ID does not exist" containerID="08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f"
Jun 09 15:47:44.121808 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.121756    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f"} err="failed to get container status \"08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f\": rpc error: code = NotFound desc = could not find container \"08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f\": container with ID starting with 08e8fae0a3147bf67693404ada555ddc8217850c34c1cd3ab88565736204186f not found: ID does not exist"
Jun 09 15:47:44.127698 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.127666    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f8d9bc6c-rvbwk"]
Jun 09 15:47:44.130235 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:44.130206    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85f8d9bc6c-rvbwk"]
Jun 09 15:47:45.597936 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:47:45.597901    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48495d0b-da6b-471d-952b-cb6ee1d01302" path="/var/lib/kubelet/pods/48495d0b-da6b-471d-952b-cb6ee1d01302/volumes"
Jun 09 15:50:45.575617 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:45.575580    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:50:45.577480 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:45.577451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:50:58.370405 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.370319    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"]
Jun 09 15:50:58.372740 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.370582    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48495d0b-da6b-471d-952b-cb6ee1d01302" containerName="console"
Jun 09 15:50:58.372740 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.370592    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48495d0b-da6b-471d-952b-cb6ee1d01302" containerName="console"
Jun 09 15:50:58.372740 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.370652    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48495d0b-da6b-471d-952b-cb6ee1d01302" containerName="console"
Jun 09 15:50:58.373805 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.373787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.376334 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376305    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 09 15:50:58.376484 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376392    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 09 15:50:58.376484 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 09 15:50:58.376484 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376455    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 09 15:50:58.376484 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376455    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-hvwmh\""
Jun 09 15:50:58.376696 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376461    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 09 15:50:58.376696 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 09 15:50:58.376804 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.376768    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 09 15:50:58.386730 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.386693    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"]
Jun 09 15:50:58.499325 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.499281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.499325 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.499327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.499545 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.499429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxkpc\" (UniqueName: \"kubernetes.io/projected/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-kube-api-access-qxkpc\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.499545 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.499486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-feast-data\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.499545 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.499514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.499650 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.499540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.600512 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.600468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxkpc\" (UniqueName: \"kubernetes.io/projected/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-kube-api-access-qxkpc\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.600512 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.600513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-feast-data\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.600727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.600539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.600727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.600592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.600727 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:50:58.600618    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 15:50:58.600727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.600650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.600727 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:50:58.600683    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls podName:8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a nodeName:}" failed. No retries permitted until 2026-06-09 15:50:59.100664571 +0000 UTC m=+613.979444483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls") pod "feast-simple-feast-setup-9987ccc46-plncv" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 15:50:58.600727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.600715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.600977 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:50:58.600816    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 09 15:50:58.600977 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:50:58.600876    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls podName:8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a nodeName:}" failed. No retries permitted until 2026-06-09 15:50:59.100864496 +0000 UTC m=+613.979644409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls") pod "feast-simple-feast-setup-9987ccc46-plncv" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 09 15:50:58.601186 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.601162    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-feast-data\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.603142 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.603119    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.603263 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.603222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:58.611044 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:58.610984    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxkpc\" (UniqueName: \"kubernetes.io/projected/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-kube-api-access-qxkpc\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:59.105103 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.105055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:59.105314 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.105132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:59.107639 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.107609    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:59.107639 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.107641    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls\") pod \"feast-simple-feast-setup-9987ccc46-plncv\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:59.306816 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.306778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:50:59.447987 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.447955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"]
Jun 09 15:50:59.449706 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:50:59.449678    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ccfba87_ac5c_44c5_9b4e_d5b4fcce441a.slice/crio-1181ebc4e9d4962ba31bf7c2e3302fd7004aa14ae1356d699e15409ed89bdb48 WatchSource:0}: Error finding container 1181ebc4e9d4962ba31bf7c2e3302fd7004aa14ae1356d699e15409ed89bdb48: Status 404 returned error can't find the container with id 1181ebc4e9d4962ba31bf7c2e3302fd7004aa14ae1356d699e15409ed89bdb48
Jun 09 15:50:59.451575 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.451542    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 15:50:59.805048 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:50:59.805013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerStarted","Data":"1181ebc4e9d4962ba31bf7c2e3302fd7004aa14ae1356d699e15409ed89bdb48"}
Jun 09 15:51:09.920485 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:09.920441    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64464dd668-xhzp2"]
Jun 09 15:51:34.948570 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:34.948521    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64464dd668-xhzp2" podUID="46df66d5-9353-4152-bf4a-ff58a8ff8de6" containerName="console" containerID="cri-o://f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74" gracePeriod=15
Jun 09 15:51:36.420530 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.420502    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:51:36.526626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.526532    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-trusted-ca-bundle\") pod \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") "
Jun 09 15:51:36.526626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.526611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-serving-cert\") pod \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") "
Jun 09 15:51:36.526832 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.526640    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-service-ca\") pod \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") "
Jun 09 15:51:36.526832 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.526753    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-oauth-config\") pod \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") "
Jun 09 15:51:36.526832 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.526807    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smvxj\" (UniqueName: \"kubernetes.io/projected/46df66d5-9353-4152-bf4a-ff58a8ff8de6-kube-api-access-smvxj\") pod \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") "
Jun 09 15:51:36.526986 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.526839    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-oauth-serving-cert\") pod \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") "
Jun 09 15:51:36.526986 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.526876    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-config\") pod \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\" (UID: \"46df66d5-9353-4152-bf4a-ff58a8ff8de6\") "
Jun 09 15:51:36.527122 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.527049    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46df66d5-9353-4152-bf4a-ff58a8ff8de6" (UID: "46df66d5-9353-4152-bf4a-ff58a8ff8de6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:51:36.527122 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.527058    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-service-ca" (OuterVolumeSpecName: "service-ca") pod "46df66d5-9353-4152-bf4a-ff58a8ff8de6" (UID: "46df66d5-9353-4152-bf4a-ff58a8ff8de6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:51:36.527240 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.527167    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-service-ca\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:51:36.527240 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.527188    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-trusted-ca-bundle\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:51:36.527408 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.527386    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-config" (OuterVolumeSpecName: "console-config") pod "46df66d5-9353-4152-bf4a-ff58a8ff8de6" (UID: "46df66d5-9353-4152-bf4a-ff58a8ff8de6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:51:36.527494 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.527452    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46df66d5-9353-4152-bf4a-ff58a8ff8de6" (UID: "46df66d5-9353-4152-bf4a-ff58a8ff8de6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:51:36.529009 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.528970    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46df66d5-9353-4152-bf4a-ff58a8ff8de6" (UID: "46df66d5-9353-4152-bf4a-ff58a8ff8de6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:51:36.529123 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.529089    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46df66d5-9353-4152-bf4a-ff58a8ff8de6-kube-api-access-smvxj" (OuterVolumeSpecName: "kube-api-access-smvxj") pod "46df66d5-9353-4152-bf4a-ff58a8ff8de6" (UID: "46df66d5-9353-4152-bf4a-ff58a8ff8de6"). InnerVolumeSpecName "kube-api-access-smvxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:51:36.529311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.529296    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46df66d5-9353-4152-bf4a-ff58a8ff8de6" (UID: "46df66d5-9353-4152-bf4a-ff58a8ff8de6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:51:36.628459 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.628343    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:51:36.628459 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.628382    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-oauth-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:51:36.628459 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.628397    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smvxj\" (UniqueName: \"kubernetes.io/projected/46df66d5-9353-4152-bf4a-ff58a8ff8de6-kube-api-access-smvxj\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:51:36.628459 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.628412    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-oauth-serving-cert\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:51:36.628459 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.628426    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46df66d5-9353-4152-bf4a-ff58a8ff8de6-console-config\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:51:36.953124 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.953090    2576 generic.go:356] "Generic (PLEG): container finished" podID="46df66d5-9353-4152-bf4a-ff58a8ff8de6" containerID="f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74" exitCode=0
Jun 09 15:51:36.953304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.953146    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64464dd668-xhzp2"
Jun 09 15:51:36.953304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.953176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64464dd668-xhzp2" event={"ID":"46df66d5-9353-4152-bf4a-ff58a8ff8de6","Type":"ContainerDied","Data":"f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74"}
Jun 09 15:51:36.953304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.953239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64464dd668-xhzp2" event={"ID":"46df66d5-9353-4152-bf4a-ff58a8ff8de6","Type":"ContainerDied","Data":"a88755278fdeaea111a924b1704b001bf58c96db9296c7cccc5b03cf55819ec7"}
Jun 09 15:51:36.953304 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.953268    2576 scope.go:117] "RemoveContainer" containerID="f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74"
Jun 09 15:51:36.954943 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.954915    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerStarted","Data":"59591ecd8ae5e8b466437a69cf95240134c594fb74650c31d0a6b321621063db"}
Jun 09 15:51:36.962450 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.962427    2576 scope.go:117] "RemoveContainer" containerID="f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74"
Jun 09 15:51:36.962814 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:51:36.962794    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74\": container with ID starting with f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74 not found: ID does not exist" containerID="f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74"
Jun 09 15:51:36.962879 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:36.962825    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74"} err="failed to get container status \"f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74\": rpc error: code = NotFound desc = could not find container \"f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74\": container with ID starting with f3d9afaa8cc2dd8a2d59b6b1684a5c01f198976cab8c2372b4db2c0baa74bd74 not found: ID does not exist"
Jun 09 15:51:37.030301 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:37.030265    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64464dd668-xhzp2"]
Jun 09 15:51:37.035954 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:37.035921    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64464dd668-xhzp2"]
Jun 09 15:51:37.599265 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:37.599228    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46df66d5-9353-4152-bf4a-ff58a8ff8de6" path="/var/lib/kubelet/pods/46df66d5-9353-4152-bf4a-ff58a8ff8de6/volumes"
Jun 09 15:51:41.977563 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:41.977527    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerID="59591ecd8ae5e8b466437a69cf95240134c594fb74650c31d0a6b321621063db" exitCode=0
Jun 09 15:51:41.978008 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:41.977596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerDied","Data":"59591ecd8ae5e8b466437a69cf95240134c594fb74650c31d0a6b321621063db"}
Jun 09 15:51:42.983343 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:42.983309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerStarted","Data":"771097b5377db316a3719881160b413c7b1ae1e034bf61a1841ffe36364cc9b7"}
Jun 09 15:51:48.002369 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:48.002334    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerID="771097b5377db316a3719881160b413c7b1ae1e034bf61a1841ffe36364cc9b7" exitCode=0
Jun 09 15:51:48.002802 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:48.002390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerDied","Data":"771097b5377db316a3719881160b413c7b1ae1e034bf61a1841ffe36364cc9b7"}
Jun 09 15:51:48.007126 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:48.007101    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 09 15:51:49.013487 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.013440    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerStarted","Data":"76920fff967197a2dea6066aabe0c58d9267860369fd8a867f894534c8905a08"}
Jun 09 15:51:49.014018 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.013528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerStarted","Data":"b394ad402e226c4f1396e48124e2e009e0947c59dbe9519fb84470d6ebfce882"}
Jun 09 15:51:49.014018 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.013552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerStarted","Data":"30e8c9533c4bd9aa86faf97b21bfd70bfeb39bf283c239bb1cd792b8cbd01030"}
Jun 09 15:51:49.014018 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.013572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerStarted","Data":"82f75fee7e424bcd0f8c99fbbae215e8500bafd27ca60040dac3864b4892e9df"}
Jun 09 15:51:49.039113 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.038325    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podStartSLOduration=14.15069863 podStartE2EDuration="51.038299951s" totalImagesPullingTime="36.887601321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:51:49.037195478 +0000 UTC m=+663.915975429" watchObservedRunningTime="2026-06-09 15:51:49.038299951 +0000 UTC m=+663.917079885"
Jun 09 15:51:49.307164 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.307048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:49.307164 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.307120    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:49.307164 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.307140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:49.307164 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:49.307160    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:50.307487 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.307431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:50.308025 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.307502    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:50.308025 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.307524    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:50.308025 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.307670    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:50.310083 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.310039    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused"
Jun 09 15:51:50.310315 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.310066    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused"
Jun 09 15:51:50.310410 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.310091    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Jun 09 15:51:50.310410 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:50.310105    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Jun 09 15:51:53.307550 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:53.307485    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Jun 09 15:51:53.308190 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:53.307490    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused"
Jun 09 15:51:53.308190 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:53.307498    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Jun 09 15:51:53.308190 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:53.307484    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused"
Jun 09 15:51:56.308522 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:56.308489    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:56.309017 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:56.308619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:56.309017 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:56.308729    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:56.309905 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:56.309842    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:56.310050 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:56.309976    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:56.315064 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:56.315034    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:56.315363 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:56.315342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:51:57.054249 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:51:57.054208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:52:59.657693 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.657653    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"]
Jun 09 15:52:59.680159 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680127    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 09 15:52:59.680440 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680218    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 15:52:59.680440 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680444    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls podName:8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a nodeName:}" failed. No retries permitted until 2026-06-09 15:53:00.18042129 +0000 UTC m=+735.059201216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls") pod "feast-simple-feast-setup-9987ccc46-plncv" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 09 15:52:59.680654 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680294    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 09 15:52:59.680654 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680465    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls podName:8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a nodeName:}" failed. No retries permitted until 2026-06-09 15:53:00.180455078 +0000 UTC m=+735.059234990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls") pod "feast-simple-feast-setup-9987ccc46-plncv" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 15:52:59.680654 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680349    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 15:52:59.680654 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680484    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls podName:8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a nodeName:}" failed. No retries permitted until 2026-06-09 15:53:00.180473086 +0000 UTC m=+735.059253004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls") pod "feast-simple-feast-setup-9987ccc46-plncv" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a") : secret "feast-simple-feast-setup-online-tls" not found
Jun 09 15:52:59.680654 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:52:59.680545    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls podName:8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a nodeName:}" failed. No retries permitted until 2026-06-09 15:53:00.180523754 +0000 UTC m=+735.059303680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls") pod "feast-simple-feast-setup-9987ccc46-plncv" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 15:52:59.918738 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.918652    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"]
Jun 09 15:52:59.918974 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.918946    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46df66d5-9353-4152-bf4a-ff58a8ff8de6" containerName="console"
Jun 09 15:52:59.919043 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.918975    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46df66d5-9353-4152-bf4a-ff58a8ff8de6" containerName="console"
Jun 09 15:52:59.919079 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.919055    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46df66d5-9353-4152-bf4a-ff58a8ff8de6" containerName="console"
Jun 09 15:52:59.922290 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.922270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:52:59.924976 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.924953    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-j9drb\""
Jun 09 15:52:59.936595 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:52:59.936568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"]
Jun 09 15:53:00.083657 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.083616    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pblpk\" (UniqueName: \"kubernetes.io/projected/61d8a415-9f5b-4c05-9534-485c80bbd935-kube-api-access-pblpk\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.083852 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.083686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-registry-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.083852 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.083743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-online-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.083852 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.083768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61d8a415-9f5b-4c05-9534-485c80bbd935-feast-data\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.083852 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.083819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-ui-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.084078 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.083867    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-offline-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.184949 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.184852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-ui-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.184949 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.184888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-offline-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.184949 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.184912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pblpk\" (UniqueName: \"kubernetes.io/projected/61d8a415-9f5b-4c05-9534-485c80bbd935-kube-api-access-pblpk\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.185252 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.185109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-registry-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.185252 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.185185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-online-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.185252 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.185220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61d8a415-9f5b-4c05-9534-485c80bbd935-feast-data\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.185933 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.185901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61d8a415-9f5b-4c05-9534-485c80bbd935-feast-data\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.187733 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.187698    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-registry-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.187733 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.187724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-ui-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.187885 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.187755    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-offline-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.187885 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.187781    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-online-tls\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.192578 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.192548    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pblpk\" (UniqueName: \"kubernetes.io/projected/61d8a415-9f5b-4c05-9534-485c80bbd935-kube-api-access-pblpk\") pod \"feast-simple-feast-setup-9987ccc46-6gk98\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") " pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.231648 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.231602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:00.289727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.289685    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="registry" containerID="cri-o://82f75fee7e424bcd0f8c99fbbae215e8500bafd27ca60040dac3864b4892e9df" gracePeriod=30
Jun 09 15:53:00.289905 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.289791    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="offline" containerID="cri-o://b394ad402e226c4f1396e48124e2e009e0947c59dbe9519fb84470d6ebfce882" gracePeriod=30
Jun 09 15:53:00.289905 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.289806    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online" containerID="cri-o://30e8c9533c4bd9aa86faf97b21bfd70bfeb39bf283c239bb1cd792b8cbd01030" gracePeriod=30
Jun 09 15:53:00.289905 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.289847    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui" containerID="cri-o://76920fff967197a2dea6066aabe0c58d9267860369fd8a867f894534c8905a08" gracePeriod=30
Jun 09 15:53:00.369950 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:00.369925    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"]
Jun 09 15:53:00.372181 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:53:00.372155    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61d8a415_9f5b_4c05_9534_485c80bbd935.slice/crio-678e71fd2c5f0e3f057f29da80979388ff17796e8977142bf0fbc9ecc28cad94 WatchSource:0}: Error finding container 678e71fd2c5f0e3f057f29da80979388ff17796e8977142bf0fbc9ecc28cad94: Status 404 returned error can't find the container with id 678e71fd2c5f0e3f057f29da80979388ff17796e8977142bf0fbc9ecc28cad94
Jun 09 15:53:01.295819 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:01.295777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerStarted","Data":"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"}
Jun 09 15:53:01.296320 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:01.295836    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerStarted","Data":"678e71fd2c5f0e3f057f29da80979388ff17796e8977142bf0fbc9ecc28cad94"}
Jun 09 15:53:01.299241 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:01.299204    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerID="76920fff967197a2dea6066aabe0c58d9267860369fd8a867f894534c8905a08" exitCode=0
Jun 09 15:53:01.299241 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:01.299242    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerID="30e8c9533c4bd9aa86faf97b21bfd70bfeb39bf283c239bb1cd792b8cbd01030" exitCode=0
Jun 09 15:53:01.299427 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:01.299267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerDied","Data":"76920fff967197a2dea6066aabe0c58d9267860369fd8a867f894534c8905a08"}
Jun 09 15:53:01.299427 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:01.299312    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerDied","Data":"30e8c9533c4bd9aa86faf97b21bfd70bfeb39bf283c239bb1cd792b8cbd01030"}
Jun 09 15:53:06.309173 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:06.309122    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Jun 09 15:53:06.320231 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:06.320197    2576 generic.go:356] "Generic (PLEG): container finished" podID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerID="248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960" exitCode=0
Jun 09 15:53:06.320414 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:06.320261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerDied","Data":"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"}
Jun 09 15:53:07.051430 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:07.051381    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Jun 09 15:53:07.325428 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:07.325335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerStarted","Data":"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"}
Jun 09 15:53:12.347024 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:12.346973    2576 generic.go:356] "Generic (PLEG): container finished" podID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerID="7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf" exitCode=0
Jun 09 15:53:12.347445 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:12.347045    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerDied","Data":"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"}
Jun 09 15:53:13.356967 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:13.356921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerStarted","Data":"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"}
Jun 09 15:53:13.357549 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:13.356988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerStarted","Data":"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"}
Jun 09 15:53:13.357549 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:13.357038    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerStarted","Data":"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"}
Jun 09 15:53:13.357549 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:13.357055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerStarted","Data":"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"}
Jun 09 15:53:13.383549 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:13.383470    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podStartSLOduration=14.383444833 podStartE2EDuration="14.383444833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:53:13.380261649 +0000 UTC m=+748.259041583" watchObservedRunningTime="2026-06-09 15:53:13.383444833 +0000 UTC m=+748.262224767"
Jun 09 15:53:15.232302 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.232229    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:15.232302 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.232296    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:15.232302 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.232315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:15.232924 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.232331    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:15.234035 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.233987    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 09 15:53:15.234285 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.234052    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
Jun 09 15:53:15.234371 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.234063    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 09 15:53:15.234371 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:15.234076    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
Jun 09 15:53:16.309809 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:16.309696    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Jun 09 15:53:17.051963 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:17.051897    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Jun 09 15:53:18.232480 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.232411    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 09 15:53:18.233050 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.233025    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.233382 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.233357    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.233686 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.233664    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.233780 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.233698    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.233854 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.233831    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.233960 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.233903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.261240 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.261208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.384221 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.384187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:18.387284 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:18.387265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:20.231842 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:20.231795    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:21.233277 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:21.233241    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:21.396119 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:21.396083    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:53:26.310108 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:26.310064    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Jun 09 15:53:26.310626 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:26.310188    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:53:27.051789 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:27.051742    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Jun 09 15:53:27.051973 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:27.051906    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:53:30.434488 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:30.434453    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerID="b394ad402e226c4f1396e48124e2e009e0947c59dbe9519fb84470d6ebfce882" exitCode=137
Jun 09 15:53:30.434488 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:30.434478    2576 generic.go:356] "Generic (PLEG): container finished" podID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerID="82f75fee7e424bcd0f8c99fbbae215e8500bafd27ca60040dac3864b4892e9df" exitCode=137
Jun 09 15:53:30.434910 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:30.434499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerDied","Data":"b394ad402e226c4f1396e48124e2e009e0947c59dbe9519fb84470d6ebfce882"}
Jun 09 15:53:30.434910 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:30.434531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerDied","Data":"82f75fee7e424bcd0f8c99fbbae215e8500bafd27ca60040dac3864b4892e9df"}
Jun 09 15:53:30.943006 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:30.942963    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:53:31.032293 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.032255    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls\") pod \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") "
Jun 09 15:53:31.032546 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.032313    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-feast-data\") pod \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") "
Jun 09 15:53:31.032546 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.032345    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls\") pod \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") "
Jun 09 15:53:31.032546 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.032428    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxkpc\" (UniqueName: \"kubernetes.io/projected/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-kube-api-access-qxkpc\") pod \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") "
Jun 09 15:53:31.032546 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.032485    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls\") pod \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") "
Jun 09 15:53:31.032546 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.032516    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls\") pod \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\" (UID: \"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a\") "
Jun 09 15:53:31.032914 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.032887    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-feast-data" (OuterVolumeSpecName: "feast-data") pod "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 15:53:31.034671 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.034621    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:53:31.034918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.034890    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-kube-api-access-qxkpc" (OuterVolumeSpecName: "kube-api-access-qxkpc") pod "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a"). InnerVolumeSpecName "kube-api-access-qxkpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:53:31.034918 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.034893    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:53:31.035081 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.034936    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls" (OuterVolumeSpecName: "online-tls") pod "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:53:31.035081 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.034962    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" (UID: "8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:53:31.133223 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.133127    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:53:31.133223 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.133158    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:53:31.133223 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.133170    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:53:31.133223 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.133181    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:53:31.133223 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.133190    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:53:31.133223 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.133201    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxkpc\" (UniqueName: \"kubernetes.io/projected/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a-kube-api-access-qxkpc\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:53:31.442114 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.442082    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv" event={"ID":"8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a","Type":"ContainerDied","Data":"1181ebc4e9d4962ba31bf7c2e3302fd7004aa14ae1356d699e15409ed89bdb48"}
Jun 09 15:53:31.442525 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.442134    2576 scope.go:117] "RemoveContainer" containerID="76920fff967197a2dea6066aabe0c58d9267860369fd8a867f894534c8905a08"
Jun 09 15:53:31.442525 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.442139    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"
Jun 09 15:53:31.451797 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.451776    2576 scope.go:117] "RemoveContainer" containerID="b394ad402e226c4f1396e48124e2e009e0947c59dbe9519fb84470d6ebfce882"
Jun 09 15:53:31.459129 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.459113    2576 scope.go:117] "RemoveContainer" containerID="30e8c9533c4bd9aa86faf97b21bfd70bfeb39bf283c239bb1cd792b8cbd01030"
Jun 09 15:53:31.464782 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.464762    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"]
Jun 09 15:53:31.466724 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.466691    2576 scope.go:117] "RemoveContainer" containerID="82f75fee7e424bcd0f8c99fbbae215e8500bafd27ca60040dac3864b4892e9df"
Jun 09 15:53:31.468149 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.468129    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-plncv"]
Jun 09 15:53:31.473969 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.473952    2576 scope.go:117] "RemoveContainer" containerID="771097b5377db316a3719881160b413c7b1ae1e034bf61a1841ffe36364cc9b7"
Jun 09 15:53:31.481194 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.481180    2576 scope.go:117] "RemoveContainer" containerID="59591ecd8ae5e8b466437a69cf95240134c594fb74650c31d0a6b321621063db"
Jun 09 15:53:31.603778 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:53:31.603739    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" path="/var/lib/kubelet/pods/8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a/volumes"
Jun 09 15:54:23.582498 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582462    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"]
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582710    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="feast-apply"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582719    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="feast-apply"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582734    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582740    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582746    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582751    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582763    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="registry"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582768    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="registry"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582776    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="feast-init"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582781    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="feast-init"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582788    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="offline"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582793    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="offline"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582837    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="registry"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582844    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="online"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582850    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="offline"
Jun 09 15:54:23.582975 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.582856    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ccfba87-ac5c-44c5-9b4e-d5b4fcce441a" containerName="ui"
Jun 09 15:54:23.586245 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.586228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.589192 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.589168    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 09 15:54:23.589192 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.589180    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 09 15:54:23.589355 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.589309    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-vsj2v\""
Jun 09 15:54:23.589438 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.589422    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 09 15:54:23.589480 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.589458    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 09 15:54:23.589779 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.589761    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 09 15:54:23.589873 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.589826    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 09 15:54:23.590505 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.590489    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 09 15:54:23.604598 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.604569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"]
Jun 09 15:54:23.730793 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.730757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kllp\" (UniqueName: \"kubernetes.io/projected/f9663b04-d2d4-41d0-bc4d-10170113050e-kube-api-access-9kllp\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.730962 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.730800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f9663b04-d2d4-41d0-bc4d-10170113050e-registry-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.730962 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.730827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-ui-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.730962 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.730869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.730962 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.730899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9663b04-d2d4-41d0-bc4d-10170113050e-feast-data\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.730962 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.730942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.831934 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.831889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kllp\" (UniqueName: \"kubernetes.io/projected/f9663b04-d2d4-41d0-bc4d-10170113050e-kube-api-access-9kllp\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.832151 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.831945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f9663b04-d2d4-41d0-bc4d-10170113050e-registry-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.832151 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.832015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-ui-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.832151 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.832049    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.832151 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.832074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9663b04-d2d4-41d0-bc4d-10170113050e-feast-data\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.832151 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.832121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.832362 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:54:23.832149    2576 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 09 15:54:23.832362 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:54:23.832221    2576 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 09 15:54:23.832362 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:54:23.832231    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls podName:f9663b04-d2d4-41d0-bc4d-10170113050e nodeName:}" failed. No retries permitted until 2026-06-09 15:54:24.332208843 +0000 UTC m=+819.210988756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls") pod "feast-simple-feast-remote-setup-84d8fc484d-vcxkn" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 09 15:54:23.832362 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:54:23.832284    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls podName:f9663b04-d2d4-41d0-bc4d-10170113050e nodeName:}" failed. No retries permitted until 2026-06-09 15:54:24.332265696 +0000 UTC m=+819.211045608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls") pod "feast-simple-feast-remote-setup-84d8fc484d-vcxkn" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 09 15:54:23.832564 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.832515    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9663b04-d2d4-41d0-bc4d-10170113050e-feast-data\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.832704 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.832683    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f9663b04-d2d4-41d0-bc4d-10170113050e-registry-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.834674 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.834657    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-ui-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:23.841089 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:23.841058    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kllp\" (UniqueName: \"kubernetes.io/projected/f9663b04-d2d4-41d0-bc4d-10170113050e-kube-api-access-9kllp\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:24.335531 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:24.335485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:24.335741 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:24.335541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:24.337904 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:24.337874    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:24.338028 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:24.337913    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls\") pod \"feast-simple-feast-remote-setup-84d8fc484d-vcxkn\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:24.496288 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:24.496245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:24.629665 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:24.629629    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"]
Jun 09 15:54:24.631166 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:54:24.631135    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9663b04_d2d4_41d0_bc4d_10170113050e.slice/crio-07f7202c13766402a720741466b4f9db4dd17d7491293d93635d51877b562137 WatchSource:0}: Error finding container 07f7202c13766402a720741466b4f9db4dd17d7491293d93635d51877b562137: Status 404 returned error can't find the container with id 07f7202c13766402a720741466b4f9db4dd17d7491293d93635d51877b562137
Jun 09 15:54:24.636805 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:24.636778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerStarted","Data":"07f7202c13766402a720741466b4f9db4dd17d7491293d93635d51877b562137"}
Jun 09 15:54:25.642080 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:25.642038    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerStarted","Data":"9c9636b77dc79caebda42beee4dbfd467b5ea4690da4901c2d9e2414d38c9b94"}
Jun 09 15:54:29.659595 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:29.659488    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerID="9c9636b77dc79caebda42beee4dbfd467b5ea4690da4901c2d9e2414d38c9b94" exitCode=0
Jun 09 15:54:29.659595 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:29.659565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerDied","Data":"9c9636b77dc79caebda42beee4dbfd467b5ea4690da4901c2d9e2414d38c9b94"}
Jun 09 15:54:30.665331 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:30.665293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerStarted","Data":"ae3547983dcaebb65923fcef0d137e86b0ad3f3421b327ff179b3db1057a1bb9"}
Jun 09 15:54:35.687317 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:35.687237    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerID="ae3547983dcaebb65923fcef0d137e86b0ad3f3421b327ff179b3db1057a1bb9" exitCode=0
Jun 09 15:54:35.687317 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:35.687281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerDied","Data":"ae3547983dcaebb65923fcef0d137e86b0ad3f3421b327ff179b3db1057a1bb9"}
Jun 09 15:54:36.695428 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:36.695382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerStarted","Data":"7f9f60b65c173e2a4c179438f07061e0abba36705d79a2c66a36ebdd2c2a3af6"}
Jun 09 15:54:36.695793 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:36.695457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerStarted","Data":"bd4ba132dc7f9156b6162fcc3737ec281424889301b8757fc74e22d3253ca069"}
Jun 09 15:54:36.695793 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:36.695481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerStarted","Data":"e4c0656f21459b6328ae05467a98cdea69b281d284f635b8cab708507c98e063"}
Jun 09 15:54:36.719351 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:36.719282    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podStartSLOduration=13.719257821 podStartE2EDuration="13.719257821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:54:36.716577676 +0000 UTC m=+831.595357651" watchObservedRunningTime="2026-06-09 15:54:36.719257821 +0000 UTC m=+831.598037756"
Jun 09 15:54:39.497252 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:39.497215    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:39.497732 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:39.497303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:39.497732 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:39.497325    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:39.499279 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:39.499240    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
Jun 09 15:54:39.499450 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:39.499299    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 09 15:54:39.499450 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:39.499241    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 09 15:54:42.498286 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.498253    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.498689 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.498364    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.498765 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.498699    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.498765 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.498735    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.498980 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.498959    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.499137 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.499118    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.502387 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.502370    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.722522 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.722490    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:54:42.725430 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:54:42.725404    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:55:44.919572 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:44.919532    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"]
Jun 09 15:55:44.920080 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:44.919843    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online" containerID="cri-o://e4c0656f21459b6328ae05467a98cdea69b281d284f635b8cab708507c98e063" gracePeriod=30
Jun 09 15:55:44.920080 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:44.919918    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="offline" containerID="cri-o://bd4ba132dc7f9156b6162fcc3737ec281424889301b8757fc74e22d3253ca069" gracePeriod=30
Jun 09 15:55:44.920080 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:44.919919    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui" containerID="cri-o://7f9f60b65c173e2a4c179438f07061e0abba36705d79a2c66a36ebdd2c2a3af6" gracePeriod=30
Jun 09 15:55:45.039586 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.039546    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"]
Jun 09 15:55:45.040036 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.039846    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="registry" containerID="cri-o://31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6" gracePeriod=30
Jun 09 15:55:45.040036 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.039877    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="offline" containerID="cri-o://30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb" gracePeriod=30
Jun 09 15:55:45.040036 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.039894    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online" containerID="cri-o://7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec" gracePeriod=30
Jun 09 15:55:45.040036 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.039919    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui" containerID="cri-o://333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2" gracePeriod=30
Jun 09 15:55:45.607121 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.607087    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:55:45.607672 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.607647    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 15:55:45.960463 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.960426    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerID="7f9f60b65c173e2a4c179438f07061e0abba36705d79a2c66a36ebdd2c2a3af6" exitCode=0
Jun 09 15:55:45.960463 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.960454    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerID="e4c0656f21459b6328ae05467a98cdea69b281d284f635b8cab708507c98e063" exitCode=0
Jun 09 15:55:45.960942 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.960486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerDied","Data":"7f9f60b65c173e2a4c179438f07061e0abba36705d79a2c66a36ebdd2c2a3af6"}
Jun 09 15:55:45.960942 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.960528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerDied","Data":"e4c0656f21459b6328ae05467a98cdea69b281d284f635b8cab708507c98e063"}
Jun 09 15:55:45.963497 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.963472    2576 generic.go:356] "Generic (PLEG): container finished" podID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerID="333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2" exitCode=0
Jun 09 15:55:45.963497 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.963493    2576 generic.go:356] "Generic (PLEG): container finished" podID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerID="7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec" exitCode=0
Jun 09 15:55:45.963658 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.963523    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerDied","Data":"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"}
Jun 09 15:55:45.963658 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:45.963552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerDied","Data":"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"}
Jun 09 15:55:48.384758 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:48.384709    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 09 15:55:51.395549 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:51.395491    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 09 15:55:52.499355 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:52.499305    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 09 15:55:52.723263 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:52.723211    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 09 15:55:58.384908 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:55:58.384773    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 09 15:56:01.396050 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:01.395977    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 09 15:56:02.499484 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:02.499431    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 09 15:56:02.723438 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:02.723382    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 09 15:56:08.385156 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:08.385102    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 09 15:56:08.385692 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:08.385261    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:56:11.396470 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:11.396420    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 09 15:56:11.396879 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:11.396607    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:56:12.499241 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:12.499192    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 09 15:56:12.499682 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:12.499364    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:56:12.723196 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:12.723147    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 09 15:56:12.723377 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:12.723273    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:56:15.081785 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.081751    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerID="bd4ba132dc7f9156b6162fcc3737ec281424889301b8757fc74e22d3253ca069" exitCode=137
Jun 09 15:56:15.082151 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.081819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerDied","Data":"bd4ba132dc7f9156b6162fcc3737ec281424889301b8757fc74e22d3253ca069"}
Jun 09 15:56:15.575813 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.575782    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:56:15.636465 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636430    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f9663b04-d2d4-41d0-bc4d-10170113050e-registry-tls\") pod \"f9663b04-d2d4-41d0-bc4d-10170113050e\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") "
Jun 09 15:56:15.636640 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9663b04-d2d4-41d0-bc4d-10170113050e-feast-data\") pod \"f9663b04-d2d4-41d0-bc4d-10170113050e\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") "
Jun 09 15:56:15.636640 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls\") pod \"f9663b04-d2d4-41d0-bc4d-10170113050e\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") "
Jun 09 15:56:15.636640 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636606    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-ui-tls\") pod \"f9663b04-d2d4-41d0-bc4d-10170113050e\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") "
Jun 09 15:56:15.636802 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636643    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls\") pod \"f9663b04-d2d4-41d0-bc4d-10170113050e\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") "
Jun 09 15:56:15.636802 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kllp\" (UniqueName: \"kubernetes.io/projected/f9663b04-d2d4-41d0-bc4d-10170113050e-kube-api-access-9kllp\") pod \"f9663b04-d2d4-41d0-bc4d-10170113050e\" (UID: \"f9663b04-d2d4-41d0-bc4d-10170113050e\") "
Jun 09 15:56:15.636910 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636819    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9663b04-d2d4-41d0-bc4d-10170113050e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f9663b04-d2d4-41d0-bc4d-10170113050e" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 15:56:15.636910 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.636893    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f9663b04-d2d4-41d0-bc4d-10170113050e-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.637089 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.637068    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9663b04-d2d4-41d0-bc4d-10170113050e-feast-data" (OuterVolumeSpecName: "feast-data") pod "f9663b04-d2d4-41d0-bc4d-10170113050e" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 15:56:15.639109 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.639078    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f9663b04-d2d4-41d0-bc4d-10170113050e" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:56:15.639339 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.639302    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9663b04-d2d4-41d0-bc4d-10170113050e-kube-api-access-9kllp" (OuterVolumeSpecName: "kube-api-access-9kllp") pod "f9663b04-d2d4-41d0-bc4d-10170113050e" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e"). InnerVolumeSpecName "kube-api-access-9kllp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:56:15.639422 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.639329    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls" (OuterVolumeSpecName: "online-tls") pod "f9663b04-d2d4-41d0-bc4d-10170113050e" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:56:15.639422 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.639314    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f9663b04-d2d4-41d0-bc4d-10170113050e" (UID: "f9663b04-d2d4-41d0-bc4d-10170113050e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:56:15.690366 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.690340    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:56:15.738248 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.738204    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.738248 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.738235    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.738248 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.738245    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9663b04-d2d4-41d0-bc4d-10170113050e-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.738248 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.738255    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kllp\" (UniqueName: \"kubernetes.io/projected/f9663b04-d2d4-41d0-bc4d-10170113050e-kube-api-access-9kllp\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.738549 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.738264    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9663b04-d2d4-41d0-bc4d-10170113050e-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.839540 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.839472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-offline-tls\") pod \"61d8a415-9f5b-4c05-9534-485c80bbd935\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") "
Jun 09 15:56:15.839739 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.839572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-registry-tls\") pod \"61d8a415-9f5b-4c05-9534-485c80bbd935\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") "
Jun 09 15:56:15.839793 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.839731    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-ui-tls\") pod \"61d8a415-9f5b-4c05-9534-485c80bbd935\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") "
Jun 09 15:56:15.839793 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.839765    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-online-tls\") pod \"61d8a415-9f5b-4c05-9534-485c80bbd935\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") "
Jun 09 15:56:15.839896 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.839802    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61d8a415-9f5b-4c05-9534-485c80bbd935-feast-data\") pod \"61d8a415-9f5b-4c05-9534-485c80bbd935\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") "
Jun 09 15:56:15.839896 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.839835    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pblpk\" (UniqueName: \"kubernetes.io/projected/61d8a415-9f5b-4c05-9534-485c80bbd935-kube-api-access-pblpk\") pod \"61d8a415-9f5b-4c05-9534-485c80bbd935\" (UID: \"61d8a415-9f5b-4c05-9534-485c80bbd935\") "
Jun 09 15:56:15.840393 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.840366    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61d8a415-9f5b-4c05-9534-485c80bbd935-feast-data" (OuterVolumeSpecName: "feast-data") pod "61d8a415-9f5b-4c05-9534-485c80bbd935" (UID: "61d8a415-9f5b-4c05-9534-485c80bbd935"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 15:56:15.841937 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.841915    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-online-tls" (OuterVolumeSpecName: "online-tls") pod "61d8a415-9f5b-4c05-9534-485c80bbd935" (UID: "61d8a415-9f5b-4c05-9534-485c80bbd935"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:56:15.842293 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.842261    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "61d8a415-9f5b-4c05-9534-485c80bbd935" (UID: "61d8a415-9f5b-4c05-9534-485c80bbd935"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:56:15.842293 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.842281    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d8a415-9f5b-4c05-9534-485c80bbd935-kube-api-access-pblpk" (OuterVolumeSpecName: "kube-api-access-pblpk") pod "61d8a415-9f5b-4c05-9534-485c80bbd935" (UID: "61d8a415-9f5b-4c05-9534-485c80bbd935"). InnerVolumeSpecName "kube-api-access-pblpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:56:15.842422 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.842304    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "61d8a415-9f5b-4c05-9534-485c80bbd935" (UID: "61d8a415-9f5b-4c05-9534-485c80bbd935"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:56:15.842422 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.842321    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "61d8a415-9f5b-4c05-9534-485c80bbd935" (UID: "61d8a415-9f5b-4c05-9534-485c80bbd935"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:56:15.941258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.941163    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.941258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.941198    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.941258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.941208    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/61d8a415-9f5b-4c05-9534-485c80bbd935-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.941258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.941217    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pblpk\" (UniqueName: \"kubernetes.io/projected/61d8a415-9f5b-4c05-9534-485c80bbd935-kube-api-access-pblpk\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.941258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.941225    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:15.941258 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:15.941233    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/61d8a415-9f5b-4c05-9534-485c80bbd935-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:56:16.089167 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.089129    2576 generic.go:356] "Generic (PLEG): container finished" podID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerID="30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb" exitCode=137
Jun 09 15:56:16.089167 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.089160    2576 generic.go:356] "Generic (PLEG): container finished" podID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerID="31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6" exitCode=137
Jun 09 15:56:16.089727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.089220    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"
Jun 09 15:56:16.089727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.089214    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerDied","Data":"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"}
Jun 09 15:56:16.089727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.089343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerDied","Data":"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"}
Jun 09 15:56:16.089727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.089369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98" event={"ID":"61d8a415-9f5b-4c05-9534-485c80bbd935","Type":"ContainerDied","Data":"678e71fd2c5f0e3f057f29da80979388ff17796e8977142bf0fbc9ecc28cad94"}
Jun 09 15:56:16.089727 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.089389    2576 scope.go:117] "RemoveContainer" containerID="333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"
Jun 09 15:56:16.092289 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.092256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn" event={"ID":"f9663b04-d2d4-41d0-bc4d-10170113050e","Type":"ContainerDied","Data":"07f7202c13766402a720741466b4f9db4dd17d7491293d93635d51877b562137"}
Jun 09 15:56:16.092394 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.092315    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"
Jun 09 15:56:16.098962 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.098931    2576 scope.go:117] "RemoveContainer" containerID="30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"
Jun 09 15:56:16.107401 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.107378    2576 scope.go:117] "RemoveContainer" containerID="7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"
Jun 09 15:56:16.112609 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.112573    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"]
Jun 09 15:56:16.116295 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.116264    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-9987ccc46-6gk98"]
Jun 09 15:56:16.116775 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.116759    2576 scope.go:117] "RemoveContainer" containerID="31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"
Jun 09 15:56:16.125876 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.125852    2576 scope.go:117] "RemoveContainer" containerID="7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"
Jun 09 15:56:16.127197 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.127174    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"]
Jun 09 15:56:16.132816 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.132787    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-84d8fc484d-vcxkn"]
Jun 09 15:56:16.134463 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.134444    2576 scope.go:117] "RemoveContainer" containerID="248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"
Jun 09 15:56:16.142314 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.142292    2576 scope.go:117] "RemoveContainer" containerID="333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"
Jun 09 15:56:16.142689 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:16.142663    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2\": container with ID starting with 333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2 not found: ID does not exist" containerID="333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"
Jun 09 15:56:16.142748 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.142702    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"} err="failed to get container status \"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2\": rpc error: code = NotFound desc = could not find container \"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2\": container with ID starting with 333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2 not found: ID does not exist"
Jun 09 15:56:16.142748 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.142730    2576 scope.go:117] "RemoveContainer" containerID="30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"
Jun 09 15:56:16.143048 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:16.143026    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb\": container with ID starting with 30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb not found: ID does not exist" containerID="30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"
Jun 09 15:56:16.143118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143053    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"} err="failed to get container status \"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb\": rpc error: code = NotFound desc = could not find container \"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb\": container with ID starting with 30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb not found: ID does not exist"
Jun 09 15:56:16.143118 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143071    2576 scope.go:117] "RemoveContainer" containerID="7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"
Jun 09 15:56:16.143346 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:16.143328    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec\": container with ID starting with 7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec not found: ID does not exist" containerID="7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"
Jun 09 15:56:16.143396 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143351    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"} err="failed to get container status \"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec\": rpc error: code = NotFound desc = could not find container \"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec\": container with ID starting with 7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec not found: ID does not exist"
Jun 09 15:56:16.143396 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143365    2576 scope.go:117] "RemoveContainer" containerID="31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"
Jun 09 15:56:16.143605 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:16.143587    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6\": container with ID starting with 31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6 not found: ID does not exist" containerID="31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"
Jun 09 15:56:16.143652 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143609    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"} err="failed to get container status \"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6\": rpc error: code = NotFound desc = could not find container \"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6\": container with ID starting with 31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6 not found: ID does not exist"
Jun 09 15:56:16.143652 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143621    2576 scope.go:117] "RemoveContainer" containerID="7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"
Jun 09 15:56:16.143805 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:16.143790    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf\": container with ID starting with 7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf not found: ID does not exist" containerID="7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"
Jun 09 15:56:16.143849 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143808    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"} err="failed to get container status \"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf\": rpc error: code = NotFound desc = could not find container \"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf\": container with ID starting with 7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf not found: ID does not exist"
Jun 09 15:56:16.143849 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.143821    2576 scope.go:117] "RemoveContainer" containerID="248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"
Jun 09 15:56:16.144026 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:16.144010    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960\": container with ID starting with 248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960 not found: ID does not exist" containerID="248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"
Jun 09 15:56:16.144072 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144029    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"} err="failed to get container status \"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960\": rpc error: code = NotFound desc = could not find container \"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960\": container with ID starting with 248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960 not found: ID does not exist"
Jun 09 15:56:16.144072 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144042    2576 scope.go:117] "RemoveContainer" containerID="333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"
Jun 09 15:56:16.144257 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144237    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2"} err="failed to get container status \"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2\": rpc error: code = NotFound desc = could not find container \"333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2\": container with ID starting with 333366d8c3ead7c43be100f64adb79fcc048ef854ed4cc9dc3602cbd734170f2 not found: ID does not exist"
Jun 09 15:56:16.144311 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144257    2576 scope.go:117] "RemoveContainer" containerID="30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"
Jun 09 15:56:16.144488 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144468    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb"} err="failed to get container status \"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb\": rpc error: code = NotFound desc = could not find container \"30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb\": container with ID starting with 30f4015a10b692806a0a2519b0c003e555b56415d99534d79ead8c71bc02bfbb not found: ID does not exist"
Jun 09 15:56:16.144488 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144487    2576 scope.go:117] "RemoveContainer" containerID="7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"
Jun 09 15:56:16.144691 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144672    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec"} err="failed to get container status \"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec\": rpc error: code = NotFound desc = could not find container \"7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec\": container with ID starting with 7eada27def5c3f1899a31687c22bb9fede2a4b8b3b4a16111216a3e3db7d71ec not found: ID does not exist"
Jun 09 15:56:16.144691 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144691    2576 scope.go:117] "RemoveContainer" containerID="31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"
Jun 09 15:56:16.144911 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144886    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6"} err="failed to get container status \"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6\": rpc error: code = NotFound desc = could not find container \"31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6\": container with ID starting with 31fa6b9bf0fe5559b063fe26912a3b18c58bd68c0723f0ec001ee5273360e6d6 not found: ID does not exist"
Jun 09 15:56:16.144911 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.144902    2576 scope.go:117] "RemoveContainer" containerID="7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"
Jun 09 15:56:16.145160 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.145142    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf"} err="failed to get container status \"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf\": rpc error: code = NotFound desc = could not find container \"7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf\": container with ID starting with 7fa41edd9f121d91d0e1cc74fa267265d2459e07bdb8fe77780076d83e9a7bcf not found: ID does not exist"
Jun 09 15:56:16.145211 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.145160    2576 scope.go:117] "RemoveContainer" containerID="248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"
Jun 09 15:56:16.145400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.145381    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960"} err="failed to get container status \"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960\": rpc error: code = NotFound desc = could not find container \"248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960\": container with ID starting with 248fce5af0d2353215ef3f241a3047c4cdce81e1903ca24bb07c6352f7f22960 not found: ID does not exist"
Jun 09 15:56:16.145400 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.145399    2576 scope.go:117] "RemoveContainer" containerID="7f9f60b65c173e2a4c179438f07061e0abba36705d79a2c66a36ebdd2c2a3af6"
Jun 09 15:56:16.154260 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.154234    2576 scope.go:117] "RemoveContainer" containerID="bd4ba132dc7f9156b6162fcc3737ec281424889301b8757fc74e22d3253ca069"
Jun 09 15:56:16.165694 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.165674    2576 scope.go:117] "RemoveContainer" containerID="e4c0656f21459b6328ae05467a98cdea69b281d284f635b8cab708507c98e063"
Jun 09 15:56:16.173880 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.173858    2576 scope.go:117] "RemoveContainer" containerID="ae3547983dcaebb65923fcef0d137e86b0ad3f3421b327ff179b3db1057a1bb9"
Jun 09 15:56:16.181648 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:16.181626    2576 scope.go:117] "RemoveContainer" containerID="9c9636b77dc79caebda42beee4dbfd467b5ea4690da4901c2d9e2414d38c9b94"
Jun 09 15:56:17.599364 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:17.599317    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" path="/var/lib/kubelet/pods/61d8a415-9f5b-4c05-9534-485c80bbd935/volumes"
Jun 09 15:56:17.600165 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:17.600143    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" path="/var/lib/kubelet/pods/f9663b04-d2d4-41d0-bc4d-10170113050e/volumes"
Jun 09 15:56:27.799821 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.799786    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-z2hpf"]
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800050    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="feast-init"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800062    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="feast-init"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800074    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800079    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800089    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800094    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800101    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="feast-init"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800106    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="feast-init"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800115    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="registry"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800120    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="registry"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800129    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="feast-apply"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800134    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="feast-apply"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800139    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="offline"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800144    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="offline"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800151    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="offline"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800155    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="offline"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800162    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800167    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800173    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="feast-apply"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800179    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="feast-apply"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800187    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800191    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online"
Jun 09 15:56:27.800225 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800235    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="ui"
Jun 09 15:56:27.800895 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800242    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="offline"
Jun 09 15:56:27.800895 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800248    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="offline"
Jun 09 15:56:27.800895 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800257    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="ui"
Jun 09 15:56:27.800895 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800264    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9663b04-d2d4-41d0-bc4d-10170113050e" containerName="online"
Jun 09 15:56:27.800895 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800270    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="registry"
Jun 09 15:56:27.800895 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.800275    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d8a415-9f5b-4c05-9534-485c80bbd935" containerName="online"
Jun 09 15:56:27.804876 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.804855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:27.807290 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.807268    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 09 15:56:27.807419 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.807399    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 09 15:56:27.808261 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.808243    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-tn5nh\""
Jun 09 15:56:27.808349 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.808292    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 09 15:56:27.812930 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.812906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z2hpf"]
Jun 09 15:56:27.930260 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.930220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cljmw\" (UniqueName: \"kubernetes.io/projected/758bf77f-c354-4d61-ae41-03dbf2b1192e-kube-api-access-cljmw\") pod \"postgres-864846d4f5-z2hpf\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") " pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:27.930448 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:27.930287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/758bf77f-c354-4d61-ae41-03dbf2b1192e-postgresdata\") pod \"postgres-864846d4f5-z2hpf\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") " pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:28.030812 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:28.030767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/758bf77f-c354-4d61-ae41-03dbf2b1192e-postgresdata\") pod \"postgres-864846d4f5-z2hpf\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") " pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:28.031035 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:28.030851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cljmw\" (UniqueName: \"kubernetes.io/projected/758bf77f-c354-4d61-ae41-03dbf2b1192e-kube-api-access-cljmw\") pod \"postgres-864846d4f5-z2hpf\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") " pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:28.031211 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:28.031187    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/758bf77f-c354-4d61-ae41-03dbf2b1192e-postgresdata\") pod \"postgres-864846d4f5-z2hpf\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") " pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:28.038398 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:28.038376    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cljmw\" (UniqueName: \"kubernetes.io/projected/758bf77f-c354-4d61-ae41-03dbf2b1192e-kube-api-access-cljmw\") pod \"postgres-864846d4f5-z2hpf\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") " pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:28.125156 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:28.125066    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:56:28.251745 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:28.251708    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z2hpf"]
Jun 09 15:56:28.254665 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:56:28.254638    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod758bf77f_c354_4d61_ae41_03dbf2b1192e.slice/crio-84b415f5d3c0d399c751a446dd4c37a7f8aaf567591f0f0f1ec148d2389d5db1 WatchSource:0}: Error finding container 84b415f5d3c0d399c751a446dd4c37a7f8aaf567591f0f0f1ec148d2389d5db1: Status 404 returned error can't find the container with id 84b415f5d3c0d399c751a446dd4c37a7f8aaf567591f0f0f1ec148d2389d5db1
Jun 09 15:56:28.256435 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:28.256418    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 15:56:29.142031 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:29.141977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z2hpf" event={"ID":"758bf77f-c354-4d61-ae41-03dbf2b1192e","Type":"ContainerStarted","Data":"84b415f5d3c0d399c751a446dd4c37a7f8aaf567591f0f0f1ec148d2389d5db1"}
Jun 09 15:56:35.165643 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:35.165595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z2hpf" event={"ID":"758bf77f-c354-4d61-ae41-03dbf2b1192e","Type":"ContainerStarted","Data":"79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d"}
Jun 09 15:56:35.183066 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:35.183010    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-z2hpf" podStartSLOduration=2.1820683 podStartE2EDuration="8.182974816s" totalImagesPullingTime="6.000906516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:56:35.182191534 +0000 UTC m=+950.060971474" watchObservedRunningTime="2026-06-09 15:56:35.182974816 +0000 UTC m=+950.061754750"
Jun 09 15:56:38.479894 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.479851    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"]
Jun 09 15:56:38.485734 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.485712    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.488266 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.488238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jun 09 15:56:38.488554 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.488535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jun 09 15:56:38.488607 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.488557    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 09 15:56:38.488662 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.488557    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-v464f\""
Jun 09 15:56:38.488662 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.488538    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jun 09 15:56:38.493513 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.493487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"]
Jun 09 15:56:38.614826 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.614783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.614826 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.614825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7rmf\" (UniqueName: \"kubernetes.io/projected/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-kube-api-access-x7rmf\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.615120 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.614855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-online-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.615120 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.614935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-feast-data\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.615120 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.614968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.716424 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.716375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.716424 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.716424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7rmf\" (UniqueName: \"kubernetes.io/projected/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-kube-api-access-x7rmf\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.716645 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.716468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-online-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.716645 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.716508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-feast-data\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.716645 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:38.716545    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
Jun 09 15:56:38.716645 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:38.716616    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls podName:f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e nodeName:}" failed. No retries permitted until 2026-06-09 15:56:39.21659414 +0000 UTC m=+954.095374063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls") pod "feast-credit-scoring-6f845d7657-cstjb" (UID: "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e") : secret "feast-credit-scoring-offline-tls" not found
Jun 09 15:56:38.716847 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.716638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.716847 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:38.716766    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Jun 09 15:56:38.716847 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:56:38.716817    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls podName:f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e nodeName:}" failed. No retries permitted until 2026-06-09 15:56:39.216800661 +0000 UTC m=+954.095580585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls") pod "feast-credit-scoring-6f845d7657-cstjb" (UID: "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e") : secret "feast-credit-scoring-registry-tls" not found
Jun 09 15:56:38.717031 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.716895    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-feast-data\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.719174 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.719152    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-online-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:38.725163 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:38.725139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7rmf\" (UniqueName: \"kubernetes.io/projected/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-kube-api-access-x7rmf\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:39.221695 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:39.221183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:39.221695 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:39.221280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:39.225398 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:39.225020    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:39.227506 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:39.227481    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls\") pod \"feast-credit-scoring-6f845d7657-cstjb\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") " pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:39.396186 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:39.396135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:39.537334 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:39.537304    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"]
Jun 09 15:56:39.538962 ip-10-0-128-73 kubenswrapper[2576]: W0609 15:56:39.538935    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88aa3e8_2393_45fc_92a1_7e7f1ad7c08e.slice/crio-6634c082f800fe15da979c04655cffd1af8fc1c6641bcd6901d7c8c1662c7f28 WatchSource:0}: Error finding container 6634c082f800fe15da979c04655cffd1af8fc1c6641bcd6901d7c8c1662c7f28: Status 404 returned error can't find the container with id 6634c082f800fe15da979c04655cffd1af8fc1c6641bcd6901d7c8c1662c7f28
Jun 09 15:56:40.186980 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:40.186943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerStarted","Data":"9ae1eb8331ebb4120bec9081eede3fa8fb1dcdede13025ad85a8d8e1f0ac293a"}
Jun 09 15:56:40.187186 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:40.187014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerStarted","Data":"6634c082f800fe15da979c04655cffd1af8fc1c6641bcd6901d7c8c1662c7f28"}
Jun 09 15:56:41.192158 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:41.192124    2576 generic.go:356] "Generic (PLEG): container finished" podID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerID="9ae1eb8331ebb4120bec9081eede3fa8fb1dcdede13025ad85a8d8e1f0ac293a" exitCode=0
Jun 09 15:56:41.192541 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:41.192196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerDied","Data":"9ae1eb8331ebb4120bec9081eede3fa8fb1dcdede13025ad85a8d8e1f0ac293a"}
Jun 09 15:56:42.197477 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:42.197432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerStarted","Data":"6ecf66acfab5066f966af6617e77d17526897ab79f2f99394ebec90fdc2a9374"}
Jun 09 15:56:48.222545 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:48.222507    2576 generic.go:356] "Generic (PLEG): container finished" podID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerID="6ecf66acfab5066f966af6617e77d17526897ab79f2f99394ebec90fdc2a9374" exitCode=0
Jun 09 15:56:48.222963 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:48.222579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerDied","Data":"6ecf66acfab5066f966af6617e77d17526897ab79f2f99394ebec90fdc2a9374"}
Jun 09 15:56:48.226888 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:48.226864    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 09 15:56:49.232244 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:49.232205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerStarted","Data":"b906559120d38a3a260dd2917833dcefffae238b2a91643eca51cef2747f53c5"}
Jun 09 15:56:49.232845 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:49.232273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerStarted","Data":"2eddc5d7825d51e0980b13834071f392ec3ce7cf304d80fe1724849f72145450"}
Jun 09 15:56:49.232845 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:49.232296    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerStarted","Data":"56d699c7f5a633c9aacae938f3d7a906bd7fcfacca8e695b1ee2f16c8120b7b9"}
Jun 09 15:56:49.254442 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:49.254349    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podStartSLOduration=11.254329189 podStartE2EDuration="11.254329189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:56:49.253169604 +0000 UTC m=+964.131949539" watchObservedRunningTime="2026-06-09 15:56:49.254329189 +0000 UTC m=+964.133109124"
Jun 09 15:56:49.396282 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:49.396242    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:49.396483 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:49.396314    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:49.396483 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:49.396331    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:51.396845 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:51.396784    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:51.397486 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:51.396923    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:51.397486 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:51.396944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:51.398887 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:51.398855    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused"
Jun 09 15:56:51.399042 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:51.398855    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
Jun 09 15:56:51.399042 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:51.398917    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 09 15:56:54.397101 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:54.397051    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
Jun 09 15:56:54.397912 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:54.397887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:54.398793 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:54.398773    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:54.675864 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:54.675764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:55.263049 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:55.263009    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:56:57.397283 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:56:57.397233    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
Jun 09 15:57:00.397309 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:57:00.397221    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:57:00.398037 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:57:00.398018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:58:07.058068 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.058033    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"]
Jun 09 15:58:07.058545 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.058324    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="registry" containerID="cri-o://56d699c7f5a633c9aacae938f3d7a906bd7fcfacca8e695b1ee2f16c8120b7b9" gracePeriod=30
Jun 09 15:58:07.058545 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.058417    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="offline" containerID="cri-o://b906559120d38a3a260dd2917833dcefffae238b2a91643eca51cef2747f53c5" gracePeriod=30
Jun 09 15:58:07.058545 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.058421    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online" containerID="cri-o://2eddc5d7825d51e0980b13834071f392ec3ce7cf304d80fe1724849f72145450" gracePeriod=30
Jun 09 15:58:07.078129 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.078094    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z2hpf"]
Jun 09 15:58:07.078299 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.078269    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-z2hpf" podUID="758bf77f-c354-4d61-ae41-03dbf2b1192e" containerName="postgres" containerID="cri-o://79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d" gracePeriod=30
Jun 09 15:58:07.328806 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.328779    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:58:07.336625 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.336592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cljmw\" (UniqueName: \"kubernetes.io/projected/758bf77f-c354-4d61-ae41-03dbf2b1192e-kube-api-access-cljmw\") pod \"758bf77f-c354-4d61-ae41-03dbf2b1192e\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") "
Jun 09 15:58:07.336741 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.336637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/758bf77f-c354-4d61-ae41-03dbf2b1192e-postgresdata\") pod \"758bf77f-c354-4d61-ae41-03dbf2b1192e\" (UID: \"758bf77f-c354-4d61-ae41-03dbf2b1192e\") "
Jun 09 15:58:07.338754 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.338717    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/758bf77f-c354-4d61-ae41-03dbf2b1192e-kube-api-access-cljmw" (OuterVolumeSpecName: "kube-api-access-cljmw") pod "758bf77f-c354-4d61-ae41-03dbf2b1192e" (UID: "758bf77f-c354-4d61-ae41-03dbf2b1192e"). InnerVolumeSpecName "kube-api-access-cljmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:58:07.372186 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.372135    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758bf77f-c354-4d61-ae41-03dbf2b1192e-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "758bf77f-c354-4d61-ae41-03dbf2b1192e" (UID: "758bf77f-c354-4d61-ae41-03dbf2b1192e"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 15:58:07.437263 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.437217    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cljmw\" (UniqueName: \"kubernetes.io/projected/758bf77f-c354-4d61-ae41-03dbf2b1192e-kube-api-access-cljmw\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:58:07.437263 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.437262    2576 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/758bf77f-c354-4d61-ae41-03dbf2b1192e-postgresdata\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:58:07.545766 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.545731    2576 generic.go:356] "Generic (PLEG): container finished" podID="758bf77f-c354-4d61-ae41-03dbf2b1192e" containerID="79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d" exitCode=0
Jun 09 15:58:07.545961 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.545788    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-z2hpf"
Jun 09 15:58:07.545961 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.545819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z2hpf" event={"ID":"758bf77f-c354-4d61-ae41-03dbf2b1192e","Type":"ContainerDied","Data":"79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d"}
Jun 09 15:58:07.545961 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.545871    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-z2hpf" event={"ID":"758bf77f-c354-4d61-ae41-03dbf2b1192e","Type":"ContainerDied","Data":"84b415f5d3c0d399c751a446dd4c37a7f8aaf567591f0f0f1ec148d2389d5db1"}
Jun 09 15:58:07.545961 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.545894    2576 scope.go:117] "RemoveContainer" containerID="79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d"
Jun 09 15:58:07.554260 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.554236    2576 scope.go:117] "RemoveContainer" containerID="79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d"
Jun 09 15:58:07.554596 ip-10-0-128-73 kubenswrapper[2576]: E0609 15:58:07.554575    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d\": container with ID starting with 79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d not found: ID does not exist" containerID="79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d"
Jun 09 15:58:07.554677 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.554611    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d"} err="failed to get container status \"79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d\": rpc error: code = NotFound desc = could not find container \"79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d\": container with ID starting with 79a7635beb7a53fe56eba8c5d94f0742a45c4e03a1816968d0447e3a921a670d not found: ID does not exist"
Jun 09 15:58:07.569536 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.569443    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z2hpf"]
Jun 09 15:58:07.575189 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.575159    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-z2hpf"]
Jun 09 15:58:07.598909 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:07.598875    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="758bf77f-c354-4d61-ae41-03dbf2b1192e" path="/var/lib/kubelet/pods/758bf77f-c354-4d61-ae41-03dbf2b1192e/volumes"
Jun 09 15:58:08.551964 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:08.551932    2576 generic.go:356] "Generic (PLEG): container finished" podID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerID="2eddc5d7825d51e0980b13834071f392ec3ce7cf304d80fe1724849f72145450" exitCode=0
Jun 09 15:58:08.552386 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:08.552025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerDied","Data":"2eddc5d7825d51e0980b13834071f392ec3ce7cf304d80fe1724849f72145450"}
Jun 09 15:58:15.260013 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:15.259944    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 09 15:58:25.260679 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:25.260634    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 09 15:58:35.260676 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:35.260574    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 09 15:58:35.261187 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:35.260715    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:58:37.656976 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.656940    2576 generic.go:356] "Generic (PLEG): container finished" podID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerID="b906559120d38a3a260dd2917833dcefffae238b2a91643eca51cef2747f53c5" exitCode=137
Jun 09 15:58:37.656976 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.656968    2576 generic.go:356] "Generic (PLEG): container finished" podID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerID="56d699c7f5a633c9aacae938f3d7a906bd7fcfacca8e695b1ee2f16c8120b7b9" exitCode=137
Jun 09 15:58:37.657453 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.657027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerDied","Data":"b906559120d38a3a260dd2917833dcefffae238b2a91643eca51cef2747f53c5"}
Jun 09 15:58:37.657453 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.657084    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerDied","Data":"56d699c7f5a633c9aacae938f3d7a906bd7fcfacca8e695b1ee2f16c8120b7b9"}
Jun 09 15:58:37.706985 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.706961    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:58:37.767547 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.767506    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7rmf\" (UniqueName: \"kubernetes.io/projected/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-kube-api-access-x7rmf\") pod \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") "
Jun 09 15:58:37.767755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.767603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls\") pod \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") "
Jun 09 15:58:37.767755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.767627    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls\") pod \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") "
Jun 09 15:58:37.767755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.767653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-online-tls\") pod \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") "
Jun 09 15:58:37.767755 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.767673    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-feast-data\") pod \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\" (UID: \"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e\") "
Jun 09 15:58:37.769985 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.769945    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-online-tls" (OuterVolumeSpecName: "online-tls") pod "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" (UID: "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:58:37.770158 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.770043    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" (UID: "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:58:37.770274 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.770251    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" (UID: "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 15:58:37.770353 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.770292    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-kube-api-access-x7rmf" (OuterVolumeSpecName: "kube-api-access-x7rmf") pod "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" (UID: "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e"). InnerVolumeSpecName "kube-api-access-x7rmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 15:58:37.776339 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.776314    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-feast-data" (OuterVolumeSpecName: "feast-data") pod "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" (UID: "f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 15:58:37.869175 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.869090    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:58:37.869175 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.869124    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:58:37.869175 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.869136    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7rmf\" (UniqueName: \"kubernetes.io/projected/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-kube-api-access-x7rmf\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:58:37.869175 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.869146    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:58:37.869175 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:37.869154    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 15:58:38.663579 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.663542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb" event={"ID":"f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e","Type":"ContainerDied","Data":"6634c082f800fe15da979c04655cffd1af8fc1c6641bcd6901d7c8c1662c7f28"}
Jun 09 15:58:38.664075 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.663607    2576 scope.go:117] "RemoveContainer" containerID="b906559120d38a3a260dd2917833dcefffae238b2a91643eca51cef2747f53c5"
Jun 09 15:58:38.664075 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.663607    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"
Jun 09 15:58:38.673676 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.673327    2576 scope.go:117] "RemoveContainer" containerID="2eddc5d7825d51e0980b13834071f392ec3ce7cf304d80fe1724849f72145450"
Jun 09 15:58:38.681558 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.681539    2576 scope.go:117] "RemoveContainer" containerID="56d699c7f5a633c9aacae938f3d7a906bd7fcfacca8e695b1ee2f16c8120b7b9"
Jun 09 15:58:38.686985 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.686959    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"]
Jun 09 15:58:38.689333 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.689309    2576 scope.go:117] "RemoveContainer" containerID="6ecf66acfab5066f966af6617e77d17526897ab79f2f99394ebec90fdc2a9374"
Jun 09 15:58:38.692875 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.692848    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6f845d7657-cstjb"]
Jun 09 15:58:38.697620 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:38.697602    2576 scope.go:117] "RemoveContainer" containerID="9ae1eb8331ebb4120bec9081eede3fa8fb1dcdede13025ad85a8d8e1f0ac293a"
Jun 09 15:58:39.598062 ip-10-0-128-73 kubenswrapper[2576]: I0609 15:58:39.598026    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" path="/var/lib/kubelet/pods/f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e/volumes"
Jun 09 16:00:31.701184 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701152    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xdf6g"]
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701418    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="758bf77f-c354-4d61-ae41-03dbf2b1192e" containerName="postgres"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701429    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="758bf77f-c354-4d61-ae41-03dbf2b1192e" containerName="postgres"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701438    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="feast-init"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701444    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="feast-init"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701460    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="feast-apply"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701467    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="feast-apply"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701473    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="registry"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701478    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="registry"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701485    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701490    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701495    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="offline"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701501    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="offline"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701536    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="758bf77f-c354-4d61-ae41-03dbf2b1192e" containerName="postgres"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701543    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="offline"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701550    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="online"
Jun 09 16:00:31.701810 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.701556    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f88aa3e8-2393-45fc-92a1-7e7f1ad7c08e" containerName="registry"
Jun 09 16:00:31.704220 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.704198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g"
Jun 09 16:00:31.706770 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.706745    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 09 16:00:31.706899 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.706750    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 09 16:00:31.707653 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.707635    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-dctt8\""
Jun 09 16:00:31.716854 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.716825    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xdf6g"]
Jun 09 16:00:31.801193 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.801150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbhm\" (UniqueName: \"kubernetes.io/projected/8309ec86-8147-4b28-9ba8-87a3ff18217b-kube-api-access-pvbhm\") pod \"redis-69bbd798b6-xdf6g\" (UID: \"8309ec86-8147-4b28-9ba8-87a3ff18217b\") " pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g"
Jun 09 16:00:31.902499 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.902448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbhm\" (UniqueName: \"kubernetes.io/projected/8309ec86-8147-4b28-9ba8-87a3ff18217b-kube-api-access-pvbhm\") pod \"redis-69bbd798b6-xdf6g\" (UID: \"8309ec86-8147-4b28-9ba8-87a3ff18217b\") " pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g"
Jun 09 16:00:31.911039 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:31.910979    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbhm\" (UniqueName: \"kubernetes.io/projected/8309ec86-8147-4b28-9ba8-87a3ff18217b-kube-api-access-pvbhm\") pod \"redis-69bbd798b6-xdf6g\" (UID: \"8309ec86-8147-4b28-9ba8-87a3ff18217b\") " pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g"
Jun 09 16:00:32.027378 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:32.027293    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g"
Jun 09 16:00:32.159147 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:32.159122    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xdf6g"]
Jun 09 16:00:32.161708 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:00:32.161671    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8309ec86_8147_4b28_9ba8_87a3ff18217b.slice/crio-204af18777a3b72762f139f121a7fb579bc8aad3c1ea543889f577440fd8fef3 WatchSource:0}: Error finding container 204af18777a3b72762f139f121a7fb579bc8aad3c1ea543889f577440fd8fef3: Status 404 returned error can't find the container with id 204af18777a3b72762f139f121a7fb579bc8aad3c1ea543889f577440fd8fef3
Jun 09 16:00:33.063819 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:33.063781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g" event={"ID":"8309ec86-8147-4b28-9ba8-87a3ff18217b","Type":"ContainerStarted","Data":"204af18777a3b72762f139f121a7fb579bc8aad3c1ea543889f577440fd8fef3"}
Jun 09 16:00:34.069690 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:34.069598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g" event={"ID":"8309ec86-8147-4b28-9ba8-87a3ff18217b","Type":"ContainerStarted","Data":"10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a"}
Jun 09 16:00:34.085161 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:34.085097    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g" podStartSLOduration=1.432932328 podStartE2EDuration="3.085082356s" totalImagesPullingTime="1.652150028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:00:34.083723035 +0000 UTC m=+1188.962502969" watchObservedRunningTime="2026-06-09 16:00:34.085082356 +0000 UTC m=+1188.963862303"
Jun 09 16:00:37.152474 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.152394    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-n8qdb"]
Jun 09 16:00:37.155634 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.155612    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.158331 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.158312    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 09 16:00:37.162022 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.161973    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-n8qdb"]
Jun 09 16:00:37.245317 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.245279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5kth\" (UniqueName: \"kubernetes.io/projected/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-kube-api-access-n5kth\") pod \"postgres-864846d4f5-n8qdb\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") " pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.245498 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.245349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-postgresdata\") pod \"postgres-864846d4f5-n8qdb\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") " pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.345958 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.345919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5kth\" (UniqueName: \"kubernetes.io/projected/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-kube-api-access-n5kth\") pod \"postgres-864846d4f5-n8qdb\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") " pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.346162 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.346020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-postgresdata\") pod \"postgres-864846d4f5-n8qdb\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") " pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.346445 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.346426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-postgresdata\") pod \"postgres-864846d4f5-n8qdb\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") " pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.354487 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.354455    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5kth\" (UniqueName: \"kubernetes.io/projected/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-kube-api-access-n5kth\") pod \"postgres-864846d4f5-n8qdb\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") " pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.467190 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.467152    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:00:37.598886 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:37.598857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-n8qdb"]
Jun 09 16:00:37.600048 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:00:37.600018    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod787cd7dd_1ef6_4d18_a3fb_d389354be0b5.slice/crio-f946755244e84fd668733bf44fe0403ffbcab276ebd6790c1bcfa27981662eb5 WatchSource:0}: Error finding container f946755244e84fd668733bf44fe0403ffbcab276ebd6790c1bcfa27981662eb5: Status 404 returned error can't find the container with id f946755244e84fd668733bf44fe0403ffbcab276ebd6790c1bcfa27981662eb5
Jun 09 16:00:38.087011 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:38.086958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb" event={"ID":"787cd7dd-1ef6-4d18-a3fb-d389354be0b5","Type":"ContainerStarted","Data":"54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06"}
Jun 09 16:00:38.087194 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:38.087028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb" event={"ID":"787cd7dd-1ef6-4d18-a3fb-d389354be0b5","Type":"ContainerStarted","Data":"f946755244e84fd668733bf44fe0403ffbcab276ebd6790c1bcfa27981662eb5"}
Jun 09 16:00:38.101380 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:38.101316    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb" podStartSLOduration=1.101296169 podStartE2EDuration="1.101296169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:00:38.101111807 +0000 UTC m=+1192.979891743" watchObservedRunningTime="2026-06-09 16:00:38.101296169 +0000 UTC m=+1192.980076094"
Jun 09 16:00:42.818152 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.818120    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"]
Jun 09 16:00:42.823978 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.823954    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:42.826617 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.826591    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 09 16:00:42.826750 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.826636    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jun 09 16:00:42.826750 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.826686    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-czvlc\""
Jun 09 16:00:42.826831 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.826809    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jun 09 16:00:42.832526 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.832503    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"]
Jun 09 16:00:42.994511 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.994465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bspbm\" (UniqueName: \"kubernetes.io/projected/68110e42-e52c-4c5c-bb39-71d2360ac46f-kube-api-access-bspbm\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:42.994511 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.994514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-registry-tls\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:42.994749 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.994576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-online-tls\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:42.994749 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:42.994649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/68110e42-e52c-4c5c-bb39-71d2360ac46f-feast-data\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.096066 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.095945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bspbm\" (UniqueName: \"kubernetes.io/projected/68110e42-e52c-4c5c-bb39-71d2360ac46f-kube-api-access-bspbm\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.096066 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.096031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-registry-tls\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.096066 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.096068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-online-tls\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.096342 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.096133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/68110e42-e52c-4c5c-bb39-71d2360ac46f-feast-data\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.096587 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.096565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/68110e42-e52c-4c5c-bb39-71d2360ac46f-feast-data\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.098535 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.098503    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-registry-tls\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.098639 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.098584    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-online-tls\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.105883 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.105853    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bspbm\" (UniqueName: \"kubernetes.io/projected/68110e42-e52c-4c5c-bb39-71d2360ac46f-kube-api-access-bspbm\") pod \"feast-credit-scoring-687b75b945-dfgl6\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") " pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.134768 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.134721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:43.271206 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:43.271175    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"]
Jun 09 16:00:43.273685 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:00:43.273657    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68110e42_e52c_4c5c_bb39_71d2360ac46f.slice/crio-9f75e663788b1ad468992ce19a1d38c6324566f3c36c52f6adf921900fabc654 WatchSource:0}: Error finding container 9f75e663788b1ad468992ce19a1d38c6324566f3c36c52f6adf921900fabc654: Status 404 returned error can't find the container with id 9f75e663788b1ad468992ce19a1d38c6324566f3c36c52f6adf921900fabc654
Jun 09 16:00:44.110982 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:44.110944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerStarted","Data":"7e701dbaa510f1f683f19bcc17b654024396e54a5f76b7876339c0bc6c0cc8a5"}
Jun 09 16:00:44.111417 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:44.111016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerStarted","Data":"9f75e663788b1ad468992ce19a1d38c6324566f3c36c52f6adf921900fabc654"}
Jun 09 16:00:45.116580 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:45.116536    2576 generic.go:356] "Generic (PLEG): container finished" podID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerID="7e701dbaa510f1f683f19bcc17b654024396e54a5f76b7876339c0bc6c0cc8a5" exitCode=0
Jun 09 16:00:45.117016 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:45.116593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerDied","Data":"7e701dbaa510f1f683f19bcc17b654024396e54a5f76b7876339c0bc6c0cc8a5"}
Jun 09 16:00:45.631827 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:45.631799    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 16:00:45.633327 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:45.633298    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 16:00:46.122117 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:46.122079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerStarted","Data":"bcf8949d8fb98b7f488ce601ab4ee519b9527d41d783e94622c1e47f325414f7"}
Jun 09 16:00:53.150554 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:53.150517    2576 generic.go:356] "Generic (PLEG): container finished" podID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerID="bcf8949d8fb98b7f488ce601ab4ee519b9527d41d783e94622c1e47f325414f7" exitCode=0
Jun 09 16:00:53.150942 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:53.150560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerDied","Data":"bcf8949d8fb98b7f488ce601ab4ee519b9527d41d783e94622c1e47f325414f7"}
Jun 09 16:00:53.154076 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:53.154051    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 09 16:00:54.157795 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:54.157759    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerStarted","Data":"9dff18b31f9c5b44e0c9cf65ff911098991a07691bd1a227bb0694c9ce22d55e"}
Jun 09 16:00:54.158265 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:54.157820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerStarted","Data":"84eefcce9ec8c20c6cf175b315d92c97bb019a9bf027b0ff2b648d3dc1068f38"}
Jun 09 16:00:54.179460 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:54.179403    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podStartSLOduration=12.179379086 podStartE2EDuration="12.179379086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:00:54.177701756 +0000 UTC m=+1209.056481726" watchObservedRunningTime="2026-06-09 16:00:54.179379086 +0000 UTC m=+1209.058159023"
Jun 09 16:00:55.135159 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:55.135119    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:55.135360 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:55.135210    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:00:55.137061 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:55.137016    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 09 16:00:55.137178 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:55.137017    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 09 16:00:58.135795 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:58.135745    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 09 16:00:58.135795 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:00:58.135758    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 09 16:01:01.135632 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:01.135575    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 09 16:01:01.141139 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:01.141107    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:01:01.141663 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:01.141635    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:01:01.144463 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:01.144434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:01:03.135089 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:03.135043    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:01:04.135555 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:04.135500    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 09 16:01:07.136491 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:07.136456    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:01:07.137079 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:07.137058    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:01:08.707433 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.707390    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"]
Jun 09 16:01:08.710814 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.710795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.713311 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.713288    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jun 09 16:01:08.713464 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.713330    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jun 09 16:01:08.713464 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.713402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-gvp7d\""
Jun 09 16:01:08.713607 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.713485    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 09 16:01:08.722166 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.722141    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"]
Jun 09 16:01:08.817579 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.817541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9q9\" (UniqueName: \"kubernetes.io/projected/af8d6a5f-860a-48fa-922f-5b70696ba976-kube-api-access-jb9q9\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.817752 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.817584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-online-tls\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.817752 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.817653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-registry-tls\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.817752 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.817698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/af8d6a5f-860a-48fa-922f-5b70696ba976-feast-data\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.918792 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.918749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-online-tls\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.919029 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.918815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-registry-tls\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.919029 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.918857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/af8d6a5f-860a-48fa-922f-5b70696ba976-feast-data\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.919029 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.918911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9q9\" (UniqueName: \"kubernetes.io/projected/af8d6a5f-860a-48fa-922f-5b70696ba976-kube-api-access-jb9q9\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.919326 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.919302    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/af8d6a5f-860a-48fa-922f-5b70696ba976-feast-data\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.921352 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.921331    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-registry-tls\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.921450 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.921332    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-online-tls\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:08.927119 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:08.927093    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9q9\" (UniqueName: \"kubernetes.io/projected/af8d6a5f-860a-48fa-922f-5b70696ba976-kube-api-access-jb9q9\") pod \"feast-driver-ranking-f989cd446-j2h8j\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") " pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:09.020644 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:09.020537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:09.156511 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:09.156476    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"]
Jun 09 16:01:09.159740 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:01:09.159704    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8d6a5f_860a_48fa_922f_5b70696ba976.slice/crio-d100662f3bc7172fc8486019c540e253d8ee250fe1cefc10c2eb922f2c79b720 WatchSource:0}: Error finding container d100662f3bc7172fc8486019c540e253d8ee250fe1cefc10c2eb922f2c79b720: Status 404 returned error can't find the container with id d100662f3bc7172fc8486019c540e253d8ee250fe1cefc10c2eb922f2c79b720
Jun 09 16:01:09.219072 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:09.219025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerStarted","Data":"d100662f3bc7172fc8486019c540e253d8ee250fe1cefc10c2eb922f2c79b720"}
Jun 09 16:01:10.225122 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:10.225086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerStarted","Data":"d39da54a712f49a4b8e074212c8ab4e878e9f85a8d061e579b6d6d6e6331ff77"}
Jun 09 16:01:14.243455 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:14.243420    2576 generic.go:356] "Generic (PLEG): container finished" podID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerID="d39da54a712f49a4b8e074212c8ab4e878e9f85a8d061e579b6d6d6e6331ff77" exitCode=0
Jun 09 16:01:14.243849 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:14.243497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerDied","Data":"d39da54a712f49a4b8e074212c8ab4e878e9f85a8d061e579b6d6d6e6331ff77"}
Jun 09 16:01:15.249446 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:15.249412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerStarted","Data":"3101a94577dea845b5b7e2543e3537e1057ef8a1e86323737414ce2a6500990c"}
Jun 09 16:01:22.279144 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:22.279111    2576 generic.go:356] "Generic (PLEG): container finished" podID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerID="3101a94577dea845b5b7e2543e3537e1057ef8a1e86323737414ce2a6500990c" exitCode=0
Jun 09 16:01:22.279525 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:22.279185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerDied","Data":"3101a94577dea845b5b7e2543e3537e1057ef8a1e86323737414ce2a6500990c"}
Jun 09 16:01:23.286913 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:23.286875    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerStarted","Data":"4bbcf641ddeb76b99109988cb4a1bc4c3027fe8411b6777f60887f1c3fb9bafd"}
Jun 09 16:01:23.287294 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:23.286945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerStarted","Data":"633716a9093de4389b799c05eb9aa32c1b200a977fa7146f4b0efdb1def9b0ff"}
Jun 09 16:01:23.317491 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:23.317423    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podStartSLOduration=15.317405373 podStartE2EDuration="15.317405373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:01:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:01:23.316225868 +0000 UTC m=+1238.195005803" watchObservedRunningTime="2026-06-09 16:01:23.317405373 +0000 UTC m=+1238.196185309"
Jun 09 16:01:24.021184 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:24.021131    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:24.021402 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:24.021204    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:24.022864 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:24.022831    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 16:01:24.023015 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:24.022836    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jun 09 16:01:27.021625 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:27.021574    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 16:01:27.022169 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:27.021579    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jun 09 16:01:29.020900 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:29.020795    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:29.020900 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:29.020887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:30.021682 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:30.021617    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jun 09 16:01:30.026983 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:30.026953    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:30.030435 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:30.030406    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:33.021121 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:33.021071    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jun 09 16:01:36.022272 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:36.022232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:01:36.023037 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:01:36.023013    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:02:54.385893 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:54.385855    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"]
Jun 09 16:02:54.386471 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:54.386114    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry" containerID="cri-o://633716a9093de4389b799c05eb9aa32c1b200a977fa7146f4b0efdb1def9b0ff" gracePeriod=30
Jun 09 16:02:54.386471 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:54.386192    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online" containerID="cri-o://4bbcf641ddeb76b99109988cb4a1bc4c3027fe8411b6777f60887f1c3fb9bafd" gracePeriod=30
Jun 09 16:02:54.387288 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:54.387261    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"]
Jun 09 16:02:54.387516 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:54.387492    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry" containerID="cri-o://84eefcce9ec8c20c6cf175b315d92c97bb019a9bf027b0ff2b648d3dc1068f38" gracePeriod=30
Jun 09 16:02:54.387610 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:54.387544    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online" containerID="cri-o://9dff18b31f9c5b44e0c9cf65ff911098991a07691bd1a227bb0694c9ce22d55e" gracePeriod=30
Jun 09 16:02:55.657461 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:55.657426    2576 generic.go:356] "Generic (PLEG): container finished" podID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerID="9dff18b31f9c5b44e0c9cf65ff911098991a07691bd1a227bb0694c9ce22d55e" exitCode=0
Jun 09 16:02:55.657911 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:55.657499    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerDied","Data":"9dff18b31f9c5b44e0c9cf65ff911098991a07691bd1a227bb0694c9ce22d55e"}
Jun 09 16:02:55.659719 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:55.659697    2576 generic.go:356] "Generic (PLEG): container finished" podID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerID="4bbcf641ddeb76b99109988cb4a1bc4c3027fe8411b6777f60887f1c3fb9bafd" exitCode=0
Jun 09 16:02:55.659847 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:55.659760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerDied","Data":"4bbcf641ddeb76b99109988cb4a1bc4c3027fe8411b6777f60887f1c3fb9bafd"}
Jun 09 16:02:56.568506 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.568469    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-n8qdb"]
Jun 09 16:02:56.568676 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.568637    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb" podUID="787cd7dd-1ef6-4d18-a3fb-d389354be0b5" containerName="postgres" containerID="cri-o://54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06" gracePeriod=30
Jun 09 16:02:56.574736 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.574683    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xdf6g"]
Jun 09 16:02:56.575236 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.575205    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g" podUID="8309ec86-8147-4b28-9ba8-87a3ff18217b" containerName="redis" containerID="cri-o://10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a" gracePeriod=30
Jun 09 16:02:56.845241 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.845216    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g"
Jun 09 16:02:56.847893 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.847877    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:02:56.887256 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.887225    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-postgresdata\") pod \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") "
Jun 09 16:02:56.887256 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.887259    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvbhm\" (UniqueName: \"kubernetes.io/projected/8309ec86-8147-4b28-9ba8-87a3ff18217b-kube-api-access-pvbhm\") pod \"8309ec86-8147-4b28-9ba8-87a3ff18217b\" (UID: \"8309ec86-8147-4b28-9ba8-87a3ff18217b\") "
Jun 09 16:02:56.887520 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.887307    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5kth\" (UniqueName: \"kubernetes.io/projected/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-kube-api-access-n5kth\") pod \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\" (UID: \"787cd7dd-1ef6-4d18-a3fb-d389354be0b5\") "
Jun 09 16:02:56.889570 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.889539    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8309ec86-8147-4b28-9ba8-87a3ff18217b-kube-api-access-pvbhm" (OuterVolumeSpecName: "kube-api-access-pvbhm") pod "8309ec86-8147-4b28-9ba8-87a3ff18217b" (UID: "8309ec86-8147-4b28-9ba8-87a3ff18217b"). InnerVolumeSpecName "kube-api-access-pvbhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:02:56.889704 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.889581    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-kube-api-access-n5kth" (OuterVolumeSpecName: "kube-api-access-n5kth") pod "787cd7dd-1ef6-4d18-a3fb-d389354be0b5" (UID: "787cd7dd-1ef6-4d18-a3fb-d389354be0b5"). InnerVolumeSpecName "kube-api-access-n5kth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:02:56.917973 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.917934    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "787cd7dd-1ef6-4d18-a3fb-d389354be0b5" (UID: "787cd7dd-1ef6-4d18-a3fb-d389354be0b5"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:02:56.987872 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.987811    2576 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-postgresdata\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:02:56.987872 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.987865    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvbhm\" (UniqueName: \"kubernetes.io/projected/8309ec86-8147-4b28-9ba8-87a3ff18217b-kube-api-access-pvbhm\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:02:56.987872 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:56.987877    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5kth\" (UniqueName: \"kubernetes.io/projected/787cd7dd-1ef6-4d18-a3fb-d389354be0b5-kube-api-access-n5kth\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:02:57.667695 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.667654    2576 generic.go:356] "Generic (PLEG): container finished" podID="787cd7dd-1ef6-4d18-a3fb-d389354be0b5" containerID="54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06" exitCode=0
Jun 09 16:02:57.667695 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.667697    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb"
Jun 09 16:02:57.667947 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.667739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb" event={"ID":"787cd7dd-1ef6-4d18-a3fb-d389354be0b5","Type":"ContainerDied","Data":"54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06"}
Jun 09 16:02:57.667947 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.667786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-n8qdb" event={"ID":"787cd7dd-1ef6-4d18-a3fb-d389354be0b5","Type":"ContainerDied","Data":"f946755244e84fd668733bf44fe0403ffbcab276ebd6790c1bcfa27981662eb5"}
Jun 09 16:02:57.667947 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.667805    2576 scope.go:117] "RemoveContainer" containerID="54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06"
Jun 09 16:02:57.669251 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.669094    2576 generic.go:356] "Generic (PLEG): container finished" podID="8309ec86-8147-4b28-9ba8-87a3ff18217b" containerID="10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a" exitCode=0
Jun 09 16:02:57.669251 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.669137    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g"
Jun 09 16:02:57.669251 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.669137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g" event={"ID":"8309ec86-8147-4b28-9ba8-87a3ff18217b","Type":"ContainerDied","Data":"10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a"}
Jun 09 16:02:57.669251 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.669230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xdf6g" event={"ID":"8309ec86-8147-4b28-9ba8-87a3ff18217b","Type":"ContainerDied","Data":"204af18777a3b72762f139f121a7fb579bc8aad3c1ea543889f577440fd8fef3"}
Jun 09 16:02:57.676451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.676429    2576 scope.go:117] "RemoveContainer" containerID="54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06"
Jun 09 16:02:57.676753 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:02:57.676730    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06\": container with ID starting with 54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06 not found: ID does not exist" containerID="54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06"
Jun 09 16:02:57.676826 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.676762    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06"} err="failed to get container status \"54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06\": rpc error: code = NotFound desc = could not find container \"54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06\": container with ID starting with 54d77b237b95747678e8578ce514191a3548d24c37f4f595589e5b4d24383c06 not found: ID does not exist"
Jun 09 16:02:57.676826 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.676778    2576 scope.go:117] "RemoveContainer" containerID="10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a"
Jun 09 16:02:57.683646 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.683611    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xdf6g"]
Jun 09 16:02:57.685640 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.685614    2576 scope.go:117] "RemoveContainer" containerID="10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a"
Jun 09 16:02:57.686047 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:02:57.686016    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a\": container with ID starting with 10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a not found: ID does not exist" containerID="10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a"
Jun 09 16:02:57.686146 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.686053    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a"} err="failed to get container status \"10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a\": rpc error: code = NotFound desc = could not find container \"10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a\": container with ID starting with 10aac5dc7d22be2a849739230390cb38b6d9bb72fd9e25624883a76ea3a3b37a not found: ID does not exist"
Jun 09 16:02:57.686836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.686816    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xdf6g"]
Jun 09 16:02:57.696612 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.696582    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-n8qdb"]
Jun 09 16:02:57.698688 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:57.698662    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-n8qdb"]
Jun 09 16:02:59.597826 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:59.597792    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="787cd7dd-1ef6-4d18-a3fb-d389354be0b5" path="/var/lib/kubelet/pods/787cd7dd-1ef6-4d18-a3fb-d389354be0b5/volumes"
Jun 09 16:02:59.598235 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:02:59.598131    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8309ec86-8147-4b28-9ba8-87a3ff18217b" path="/var/lib/kubelet/pods/8309ec86-8147-4b28-9ba8-87a3ff18217b/volumes"
Jun 09 16:03:00.028506 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:00.028465    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 16:03:01.142281 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:01.142235    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 09 16:03:10.028483 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:10.028434    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 16:03:11.142153 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:11.142106    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 09 16:03:20.028530 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:20.028484    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 16:03:20.028938 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:20.028604    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:03:21.141827 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:21.141776    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 09 16:03:21.142277 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:21.141909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:03:24.776075 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:24.776033    2576 generic.go:356] "Generic (PLEG): container finished" podID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerID="84eefcce9ec8c20c6cf175b315d92c97bb019a9bf027b0ff2b648d3dc1068f38" exitCode=137
Jun 09 16:03:24.776524 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:24.776103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerDied","Data":"84eefcce9ec8c20c6cf175b315d92c97bb019a9bf027b0ff2b648d3dc1068f38"}
Jun 09 16:03:24.778425 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:24.778397    2576 generic.go:356] "Generic (PLEG): container finished" podID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerID="633716a9093de4389b799c05eb9aa32c1b200a977fa7146f4b0efdb1def9b0ff" exitCode=137
Jun 09 16:03:24.778558 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:24.778463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerDied","Data":"633716a9093de4389b799c05eb9aa32c1b200a977fa7146f4b0efdb1def9b0ff"}
Jun 09 16:03:25.035408 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.035331    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:03:25.065324 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.065300    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:03:25.103293 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103259    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bspbm\" (UniqueName: \"kubernetes.io/projected/68110e42-e52c-4c5c-bb39-71d2360ac46f-kube-api-access-bspbm\") pod \"68110e42-e52c-4c5c-bb39-71d2360ac46f\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") "
Jun 09 16:03:25.103293 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103297    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-online-tls\") pod \"68110e42-e52c-4c5c-bb39-71d2360ac46f\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") "
Jun 09 16:03:25.103544 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103326    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-registry-tls\") pod \"af8d6a5f-860a-48fa-922f-5b70696ba976\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") "
Jun 09 16:03:25.103544 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103360    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb9q9\" (UniqueName: \"kubernetes.io/projected/af8d6a5f-860a-48fa-922f-5b70696ba976-kube-api-access-jb9q9\") pod \"af8d6a5f-860a-48fa-922f-5b70696ba976\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") "
Jun 09 16:03:25.103544 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103432    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/af8d6a5f-860a-48fa-922f-5b70696ba976-feast-data\") pod \"af8d6a5f-860a-48fa-922f-5b70696ba976\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") "
Jun 09 16:03:25.103544 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103476    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/68110e42-e52c-4c5c-bb39-71d2360ac46f-feast-data\") pod \"68110e42-e52c-4c5c-bb39-71d2360ac46f\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") "
Jun 09 16:03:25.103544 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103501    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-online-tls\") pod \"af8d6a5f-860a-48fa-922f-5b70696ba976\" (UID: \"af8d6a5f-860a-48fa-922f-5b70696ba976\") "
Jun 09 16:03:25.103828 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.103770    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-registry-tls\") pod \"68110e42-e52c-4c5c-bb39-71d2360ac46f\" (UID: \"68110e42-e52c-4c5c-bb39-71d2360ac46f\") "
Jun 09 16:03:25.104048 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.104014    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af8d6a5f-860a-48fa-922f-5b70696ba976-feast-data" (OuterVolumeSpecName: "feast-data") pod "af8d6a5f-860a-48fa-922f-5b70696ba976" (UID: "af8d6a5f-860a-48fa-922f-5b70696ba976"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:03:25.105674 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.105643    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af8d6a5f-860a-48fa-922f-5b70696ba976-kube-api-access-jb9q9" (OuterVolumeSpecName: "kube-api-access-jb9q9") pod "af8d6a5f-860a-48fa-922f-5b70696ba976" (UID: "af8d6a5f-860a-48fa-922f-5b70696ba976"). InnerVolumeSpecName "kube-api-access-jb9q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:03:25.105896 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.105862    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-online-tls" (OuterVolumeSpecName: "online-tls") pod "68110e42-e52c-4c5c-bb39-71d2360ac46f" (UID: "68110e42-e52c-4c5c-bb39-71d2360ac46f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:03:25.106060 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.105946    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "af8d6a5f-860a-48fa-922f-5b70696ba976" (UID: "af8d6a5f-860a-48fa-922f-5b70696ba976"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:03:25.106060 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.105958    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-online-tls" (OuterVolumeSpecName: "online-tls") pod "af8d6a5f-860a-48fa-922f-5b70696ba976" (UID: "af8d6a5f-860a-48fa-922f-5b70696ba976"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:03:25.106060 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.106042    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68110e42-e52c-4c5c-bb39-71d2360ac46f-kube-api-access-bspbm" (OuterVolumeSpecName: "kube-api-access-bspbm") pod "68110e42-e52c-4c5c-bb39-71d2360ac46f" (UID: "68110e42-e52c-4c5c-bb39-71d2360ac46f"). InnerVolumeSpecName "kube-api-access-bspbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:03:25.106295 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.106274    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "68110e42-e52c-4c5c-bb39-71d2360ac46f" (UID: "68110e42-e52c-4c5c-bb39-71d2360ac46f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:03:25.113580 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.113553    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68110e42-e52c-4c5c-bb39-71d2360ac46f-feast-data" (OuterVolumeSpecName: "feast-data") pod "68110e42-e52c-4c5c-bb39-71d2360ac46f" (UID: "68110e42-e52c-4c5c-bb39-71d2360ac46f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:03:25.204802 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204758    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb9q9\" (UniqueName: \"kubernetes.io/projected/af8d6a5f-860a-48fa-922f-5b70696ba976-kube-api-access-jb9q9\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.204802 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204796    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/af8d6a5f-860a-48fa-922f-5b70696ba976-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.204802 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204805    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/68110e42-e52c-4c5c-bb39-71d2360ac46f-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.205070 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204814    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.205070 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204823    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.205070 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204831    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bspbm\" (UniqueName: \"kubernetes.io/projected/68110e42-e52c-4c5c-bb39-71d2360ac46f-kube-api-access-bspbm\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.205070 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204839    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/68110e42-e52c-4c5c-bb39-71d2360ac46f-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.205070 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.204847    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/af8d6a5f-860a-48fa-922f-5b70696ba976-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:03:25.785136 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.785107    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"
Jun 09 16:03:25.785673 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.785096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6" event={"ID":"68110e42-e52c-4c5c-bb39-71d2360ac46f","Type":"ContainerDied","Data":"9f75e663788b1ad468992ce19a1d38c6324566f3c36c52f6adf921900fabc654"}
Jun 09 16:03:25.785673 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.785252    2576 scope.go:117] "RemoveContainer" containerID="9dff18b31f9c5b44e0c9cf65ff911098991a07691bd1a227bb0694c9ce22d55e"
Jun 09 16:03:25.787735 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.787688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j" event={"ID":"af8d6a5f-860a-48fa-922f-5b70696ba976","Type":"ContainerDied","Data":"d100662f3bc7172fc8486019c540e253d8ee250fe1cefc10c2eb922f2c79b720"}
Jun 09 16:03:25.787863 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.787772    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"
Jun 09 16:03:25.794410 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.794391    2576 scope.go:117] "RemoveContainer" containerID="84eefcce9ec8c20c6cf175b315d92c97bb019a9bf027b0ff2b648d3dc1068f38"
Jun 09 16:03:25.802268 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.802250    2576 scope.go:117] "RemoveContainer" containerID="bcf8949d8fb98b7f488ce601ab4ee519b9527d41d783e94622c1e47f325414f7"
Jun 09 16:03:25.808365 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.808342    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"]
Jun 09 16:03:25.810069 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.810038    2576 scope.go:117] "RemoveContainer" containerID="7e701dbaa510f1f683f19bcc17b654024396e54a5f76b7876339c0bc6c0cc8a5"
Jun 09 16:03:25.811865 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.811847    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-687b75b945-dfgl6"]
Jun 09 16:03:25.817500 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.817482    2576 scope.go:117] "RemoveContainer" containerID="4bbcf641ddeb76b99109988cb4a1bc4c3027fe8411b6777f60887f1c3fb9bafd"
Jun 09 16:03:25.822292 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.822273    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"]
Jun 09 16:03:25.825398 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.825377    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-f989cd446-j2h8j"]
Jun 09 16:03:25.825649 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.825633    2576 scope.go:117] "RemoveContainer" containerID="633716a9093de4389b799c05eb9aa32c1b200a977fa7146f4b0efdb1def9b0ff"
Jun 09 16:03:25.832961 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.832941    2576 scope.go:117] "RemoveContainer" containerID="3101a94577dea845b5b7e2543e3537e1057ef8a1e86323737414ce2a6500990c"
Jun 09 16:03:25.839861 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:25.839844    2576 scope.go:117] "RemoveContainer" containerID="d39da54a712f49a4b8e074212c8ab4e878e9f85a8d061e579b6d6d6e6331ff77"
Jun 09 16:03:27.598228 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.598192    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" path="/var/lib/kubelet/pods/68110e42-e52c-4c5c-bb39-71d2360ac46f/volumes"
Jun 09 16:03:27.598857 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.598832    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" path="/var/lib/kubelet/pods/af8d6a5f-860a-48fa-922f-5b70696ba976/volumes"
Jun 09 16:03:27.599411 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599388    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"]
Jun 09 16:03:27.599673 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599659    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="feast-init"
Jun 09 16:03:27.599715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599676    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="feast-init"
Jun 09 16:03:27.599715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599691    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="feast-apply"
Jun 09 16:03:27.599715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599699    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="feast-apply"
Jun 09 16:03:27.599715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599710    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="787cd7dd-1ef6-4d18-a3fb-d389354be0b5" containerName="postgres"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599717    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="787cd7dd-1ef6-4d18-a3fb-d389354be0b5" containerName="postgres"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599723    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="feast-apply"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599728    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="feast-apply"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599738    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8309ec86-8147-4b28-9ba8-87a3ff18217b" containerName="redis"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599743    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8309ec86-8147-4b28-9ba8-87a3ff18217b" containerName="redis"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599749    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599755    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599761    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="feast-init"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599766    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="feast-init"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599771    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599779    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599787    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599795    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599801    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online"
Jun 09 16:03:27.599836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599806    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online"
Jun 09 16:03:27.600300 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599870    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="registry"
Jun 09 16:03:27.600300 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599878    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="online"
Jun 09 16:03:27.600300 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599884    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="787cd7dd-1ef6-4d18-a3fb-d389354be0b5" containerName="postgres"
Jun 09 16:03:27.600300 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599890    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="68110e42-e52c-4c5c-bb39-71d2360ac46f" containerName="online"
Jun 09 16:03:27.600300 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599898    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8309ec86-8147-4b28-9ba8-87a3ff18217b" containerName="redis"
Jun 09 16:03:27.600300 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.599903    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af8d6a5f-860a-48fa-922f-5b70696ba976" containerName="registry"
Jun 09 16:03:27.605158 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.605137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.607772 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.607747    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 09 16:03:27.607940 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.607753    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 09 16:03:27.607940 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.607839    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 09 16:03:27.607940 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.607846    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 09 16:03:27.607940 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.607918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-hh7j7\""
Jun 09 16:03:27.608198 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.607952    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 09 16:03:27.608668 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.608652    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 09 16:03:27.614942 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.614920    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"]
Jun 09 16:03:27.719681 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.719636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.719681 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.719682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wmn5\" (UniqueName: \"kubernetes.io/projected/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-kube-api-access-4wmn5\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.719947 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.719745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.719947 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.719792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.719947 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.719819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.719947 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.719861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.820856 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.820827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.821051 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.820879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.821051 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:03:27.820977    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 16:03:27.821051 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.821015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wmn5\" (UniqueName: \"kubernetes.io/projected/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-kube-api-access-4wmn5\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.821304 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:03:27.821083    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls podName:44424c4a-35b5-424d-b1bf-bbf36f99bdcf nodeName:}" failed. No retries permitted until 2026-06-09 16:03:28.321061506 +0000 UTC m=+1363.199841421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls") pod "feast-simple-feast-setup-75c64c888b-nvhf2" (UID: "44424c4a-35b5-424d-b1bf-bbf36f99bdcf") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 16:03:27.821304 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.821122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.821304 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.821170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.821304 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.821201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.822048 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.821758    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.827696 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.824263    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.827696 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.826208    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.828783 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.828751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:27.829500 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:27.829477    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wmn5\" (UniqueName: \"kubernetes.io/projected/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-kube-api-access-4wmn5\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:28.325472 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:28.325435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:28.327860 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:28.327825    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nvhf2\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:28.523311 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:28.523263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:03:28.662800 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:28.662774    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"]
Jun 09 16:03:28.664381 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:03:28.664356    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44424c4a_35b5_424d_b1bf_bbf36f99bdcf.slice/crio-42eea9a57f5dd55544723e65a62264a65c1c05e19026b40ea0168a07d60e722e WatchSource:0}: Error finding container 42eea9a57f5dd55544723e65a62264a65c1c05e19026b40ea0168a07d60e722e: Status 404 returned error can't find the container with id 42eea9a57f5dd55544723e65a62264a65c1c05e19026b40ea0168a07d60e722e
Jun 09 16:03:28.666310 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:28.666288    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 16:03:28.802067 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:28.802030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerStarted","Data":"42eea9a57f5dd55544723e65a62264a65c1c05e19026b40ea0168a07d60e722e"}
Jun 09 16:03:46.885224 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:46.885182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerStarted","Data":"eadc12a216c8951d8f6c14b91fd9340ff57a035932eb9ac20c30a9e0699e0138"}
Jun 09 16:03:51.911979 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:51.911945    2576 generic.go:356] "Generic (PLEG): container finished" podID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerID="eadc12a216c8951d8f6c14b91fd9340ff57a035932eb9ac20c30a9e0699e0138" exitCode=0
Jun 09 16:03:51.912380 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:51.912022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerDied","Data":"eadc12a216c8951d8f6c14b91fd9340ff57a035932eb9ac20c30a9e0699e0138"}
Jun 09 16:03:52.917430 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:52.917399    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerStarted","Data":"dfe6aa86500cbcb43eb4b4e51f3e628255796895b8e5b69cc364ea88b0a19170"}
Jun 09 16:03:57.937424 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:57.937329    2576 generic.go:356] "Generic (PLEG): container finished" podID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerID="dfe6aa86500cbcb43eb4b4e51f3e628255796895b8e5b69cc364ea88b0a19170" exitCode=0
Jun 09 16:03:57.937424 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:57.937405    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerDied","Data":"dfe6aa86500cbcb43eb4b4e51f3e628255796895b8e5b69cc364ea88b0a19170"}
Jun 09 16:03:58.947071 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:58.947028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerStarted","Data":"5282b47894fad16881932848f7400b3ecf4d70475ca2b39326b2d8771111e4b9"}
Jun 09 16:03:58.947606 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:58.947098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerStarted","Data":"1cff876287491dd844858ba4a497f7712d7c11b6f2f6c685a282e87c2bf8f61f"}
Jun 09 16:03:58.947606 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:58.947119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerStarted","Data":"ebe3b1cabd1d8b5de278189075325a2dbda6a09bf5d9abc6a0fa296b33cf6fff"}
Jun 09 16:03:58.947606 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:58.947140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerStarted","Data":"18b6b4a26042e181dfe60cdde18b5d5109789aafa2b5c4005f6ff502421dc7f7"}
Jun 09 16:03:58.994767 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:03:58.994697    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podStartSLOduration=14.329119123 podStartE2EDuration="31.994675347s" totalImagesPullingTime="17.665556224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:03:58.993531565 +0000 UTC m=+1393.872311500" watchObservedRunningTime="2026-06-09 16:03:58.994675347 +0000 UTC m=+1393.873455281"
Jun 09 16:04:01.524503 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.524415    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:01.524503 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.524493    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:01.524503 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.524513    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:01.525176 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.524530    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:01.526818 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.526629    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
Jun 09 16:04:01.526818 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.526655    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Jun 09 16:04:01.526818 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.526670    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 16:04:01.526818 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:01.526763    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 16:04:04.524676 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.524644    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.525232 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.525214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.525357 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.525345    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.525799 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.525770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.525935 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.525816    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.525935 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.525835    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.525935 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.525909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.526145 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.525955    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.526145 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.526136    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.529412 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.529388    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.985453 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.985424    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:04:04.988302 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:04:04.988285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:05:06.834445 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:06.834400    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"]
Jun 09 16:05:06.834980 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:06.834701    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="registry" containerID="cri-o://18b6b4a26042e181dfe60cdde18b5d5109789aafa2b5c4005f6ff502421dc7f7" gracePeriod=30
Jun 09 16:05:06.835118 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:06.835055    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online" containerID="cri-o://ebe3b1cabd1d8b5de278189075325a2dbda6a09bf5d9abc6a0fa296b33cf6fff" gracePeriod=30
Jun 09 16:05:06.835736 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:06.835049    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui" containerID="cri-o://5282b47894fad16881932848f7400b3ecf4d70475ca2b39326b2d8771111e4b9" gracePeriod=30
Jun 09 16:05:06.835824 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:06.835109    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="offline" containerID="cri-o://1cff876287491dd844858ba4a497f7712d7c11b6f2f6c685a282e87c2bf8f61f" gracePeriod=30
Jun 09 16:05:07.114792 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.114701    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"]
Jun 09 16:05:07.117972 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.117952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.121754 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.121729    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-j8wvr\""
Jun 09 16:05:07.197615 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.197577    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"]
Jun 09 16:05:07.208804 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.208701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07756441-633d-48ac-9f85-945b563dfba6-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.208804 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.208747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pf6m\" (UniqueName: \"kubernetes.io/projected/07756441-633d-48ac-9f85-945b563dfba6-kube-api-access-9pf6m\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.208804 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.208805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.209113 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.208825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.209113 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.208925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.209113 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.208978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.310160 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.310114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.310392 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.310173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.310392 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.310252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07756441-633d-48ac-9f85-945b563dfba6-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.310392 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.310274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pf6m\" (UniqueName: \"kubernetes.io/projected/07756441-633d-48ac-9f85-945b563dfba6-kube-api-access-9pf6m\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.310392 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.310329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.310392 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.310350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.310725 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:05:07.310505    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 16:05:07.310725 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:05:07.310573    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls podName:07756441-633d-48ac-9f85-945b563dfba6 nodeName:}" failed. No retries permitted until 2026-06-09 16:05:07.810550842 +0000 UTC m=+1462.689330769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls") pod "feast-simple-feast-setup-75c64c888b-fwb2b" (UID: "07756441-633d-48ac-9f85-945b563dfba6") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 16:05:07.311045 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.311014    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07756441-633d-48ac-9f85-945b563dfba6-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.313049 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.313022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.313158 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.313121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.313220 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.313198    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.318541 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.318512    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pf6m\" (UniqueName: \"kubernetes.io/projected/07756441-633d-48ac-9f85-945b563dfba6-kube-api-access-9pf6m\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.815725 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.815682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:07.818168 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:07.818135    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-fwb2b\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:08.027973 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:08.027907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:08.172084 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:08.172055    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"]
Jun 09 16:05:08.173291 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:05:08.173264    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07756441_633d_48ac_9f85_945b563dfba6.slice/crio-51c784f4a5f0fb81b65e811796ca7a4d2fd45e16e778d00b1967daf3a726cc49 WatchSource:0}: Error finding container 51c784f4a5f0fb81b65e811796ca7a4d2fd45e16e778d00b1967daf3a726cc49: Status 404 returned error can't find the container with id 51c784f4a5f0fb81b65e811796ca7a4d2fd45e16e778d00b1967daf3a726cc49
Jun 09 16:05:08.221596 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:08.221566    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerStarted","Data":"51c784f4a5f0fb81b65e811796ca7a4d2fd45e16e778d00b1967daf3a726cc49"}
Jun 09 16:05:08.224616 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:08.224589    2576 generic.go:356] "Generic (PLEG): container finished" podID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerID="5282b47894fad16881932848f7400b3ecf4d70475ca2b39326b2d8771111e4b9" exitCode=0
Jun 09 16:05:08.224616 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:08.224616    2576 generic.go:356] "Generic (PLEG): container finished" podID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerID="ebe3b1cabd1d8b5de278189075325a2dbda6a09bf5d9abc6a0fa296b33cf6fff" exitCode=0
Jun 09 16:05:08.224787 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:08.224646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerDied","Data":"5282b47894fad16881932848f7400b3ecf4d70475ca2b39326b2d8771111e4b9"}
Jun 09 16:05:08.224787 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:08.224689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerDied","Data":"ebe3b1cabd1d8b5de278189075325a2dbda6a09bf5d9abc6a0fa296b33cf6fff"}
Jun 09 16:05:09.229378 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:09.229337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerStarted","Data":"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"}
Jun 09 16:05:13.250371 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:13.250335    2576 generic.go:356] "Generic (PLEG): container finished" podID="07756441-633d-48ac-9f85-945b563dfba6" containerID="62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f" exitCode=0
Jun 09 16:05:13.250815 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:13.250405    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerDied","Data":"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"}
Jun 09 16:05:14.255878 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:14.255839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerStarted","Data":"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"}
Jun 09 16:05:14.526402 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:14.526288    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 16:05:14.985956 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:14.985909    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 16:05:19.277684 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:19.277582    2576 generic.go:356] "Generic (PLEG): container finished" podID="07756441-633d-48ac-9f85-945b563dfba6" containerID="2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8" exitCode=0
Jun 09 16:05:19.277684 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:19.277653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerDied","Data":"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"}
Jun 09 16:05:20.287413 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:20.287372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerStarted","Data":"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"}
Jun 09 16:05:20.287920 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:20.287443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerStarted","Data":"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"}
Jun 09 16:05:20.287920 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:20.287469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerStarted","Data":"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"}
Jun 09 16:05:20.287920 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:20.287489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerStarted","Data":"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"}
Jun 09 16:05:20.311942 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:20.311879    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podStartSLOduration=13.311858192 podStartE2EDuration="13.311858192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:05:20.309579967 +0000 UTC m=+1475.188359901" watchObservedRunningTime="2026-06-09 16:05:20.311858192 +0000 UTC m=+1475.190638127"
Jun 09 16:05:23.028835 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.028687    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:23.028835 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.028765    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:23.028835 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.028784    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:23.028835 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.028802    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:23.030981 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.030935    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 16:05:23.031158 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.030972    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
Jun 09 16:05:23.031158 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.031007    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 16:05:23.031158 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:23.031080    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.31:8816: connect: connection refused"
Jun 09 16:05:24.526847 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:24.526794    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 16:05:24.986719 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:24.986669    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 16:05:26.029566 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.029511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030034 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.029668    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030034 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.029754    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030186 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.030143    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030246 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.030190    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030246 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.030206    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030364 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.030322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030503 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.030486    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.030628 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.030612    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.034653 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.034628    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.317694 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.317612    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:26.320624 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:26.320602    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:05:34.525925 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:34.525856    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 16:05:34.526442 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:34.526067    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:05:34.985964 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:34.985910    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 16:05:34.986177 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:34.986086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:05:37.361537 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.361495    2576 generic.go:356] "Generic (PLEG): container finished" podID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerID="1cff876287491dd844858ba4a497f7712d7c11b6f2f6c685a282e87c2bf8f61f" exitCode=137
Jun 09 16:05:37.361537 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.361519    2576 generic.go:356] "Generic (PLEG): container finished" podID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerID="18b6b4a26042e181dfe60cdde18b5d5109789aafa2b5c4005f6ff502421dc7f7" exitCode=137
Jun 09 16:05:37.362130 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.361575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerDied","Data":"1cff876287491dd844858ba4a497f7712d7c11b6f2f6c685a282e87c2bf8f61f"}
Jun 09 16:05:37.362130 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.361627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerDied","Data":"18b6b4a26042e181dfe60cdde18b5d5109789aafa2b5c4005f6ff502421dc7f7"}
Jun 09 16:05:37.493916 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.493887    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:05:37.549521 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.549488    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wmn5\" (UniqueName: \"kubernetes.io/projected/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-kube-api-access-4wmn5\") pod \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") "
Jun 09 16:05:37.549715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.549546    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-ui-tls\") pod \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") "
Jun 09 16:05:37.549715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.549578    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-online-tls\") pod \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") "
Jun 09 16:05:37.549715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.549602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-feast-data\") pod \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") "
Jun 09 16:05:37.549715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.549627    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-offline-tls\") pod \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") "
Jun 09 16:05:37.549715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.549644    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls\") pod \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\" (UID: \"44424c4a-35b5-424d-b1bf-bbf36f99bdcf\") "
Jun 09 16:05:37.550266 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.550234    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-feast-data" (OuterVolumeSpecName: "feast-data") pod "44424c4a-35b5-424d-b1bf-bbf36f99bdcf" (UID: "44424c4a-35b5-424d-b1bf-bbf36f99bdcf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:05:37.552013 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.551958    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "44424c4a-35b5-424d-b1bf-bbf36f99bdcf" (UID: "44424c4a-35b5-424d-b1bf-bbf36f99bdcf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:05:37.552139 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.552078    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "44424c4a-35b5-424d-b1bf-bbf36f99bdcf" (UID: "44424c4a-35b5-424d-b1bf-bbf36f99bdcf"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:05:37.552139 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.552099    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-kube-api-access-4wmn5" (OuterVolumeSpecName: "kube-api-access-4wmn5") pod "44424c4a-35b5-424d-b1bf-bbf36f99bdcf" (UID: "44424c4a-35b5-424d-b1bf-bbf36f99bdcf"). InnerVolumeSpecName "kube-api-access-4wmn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:05:37.552237 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.552148    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-online-tls" (OuterVolumeSpecName: "online-tls") pod "44424c4a-35b5-424d-b1bf-bbf36f99bdcf" (UID: "44424c4a-35b5-424d-b1bf-bbf36f99bdcf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:05:37.552237 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.552198    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "44424c4a-35b5-424d-b1bf-bbf36f99bdcf" (UID: "44424c4a-35b5-424d-b1bf-bbf36f99bdcf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:05:37.650637 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.650596    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:05:37.650637 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.650634    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:05:37.650637 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.650649    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:05:37.650891 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.650657    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:05:37.650891 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.650665    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:05:37.650891 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:37.650674    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wmn5\" (UniqueName: \"kubernetes.io/projected/44424c4a-35b5-424d-b1bf-bbf36f99bdcf-kube-api-access-4wmn5\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:05:38.368113 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.368080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2" event={"ID":"44424c4a-35b5-424d-b1bf-bbf36f99bdcf","Type":"ContainerDied","Data":"42eea9a57f5dd55544723e65a62264a65c1c05e19026b40ea0168a07d60e722e"}
Jun 09 16:05:38.368113 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.368112    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"
Jun 09 16:05:38.368581 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.368135    2576 scope.go:117] "RemoveContainer" containerID="5282b47894fad16881932848f7400b3ecf4d70475ca2b39326b2d8771111e4b9"
Jun 09 16:05:38.377276 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.377254    2576 scope.go:117] "RemoveContainer" containerID="1cff876287491dd844858ba4a497f7712d7c11b6f2f6c685a282e87c2bf8f61f"
Jun 09 16:05:38.385438 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.385414    2576 scope.go:117] "RemoveContainer" containerID="ebe3b1cabd1d8b5de278189075325a2dbda6a09bf5d9abc6a0fa296b33cf6fff"
Jun 09 16:05:38.388476 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.388450    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"]
Jun 09 16:05:38.392923 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.392894    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nvhf2"]
Jun 09 16:05:38.397036 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.397016    2576 scope.go:117] "RemoveContainer" containerID="18b6b4a26042e181dfe60cdde18b5d5109789aafa2b5c4005f6ff502421dc7f7"
Jun 09 16:05:38.404775 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.404750    2576 scope.go:117] "RemoveContainer" containerID="dfe6aa86500cbcb43eb4b4e51f3e628255796895b8e5b69cc364ea88b0a19170"
Jun 09 16:05:38.412387 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:38.412367    2576 scope.go:117] "RemoveContainer" containerID="eadc12a216c8951d8f6c14b91fd9340ff57a035932eb9ac20c30a9e0699e0138"
Jun 09 16:05:39.598052 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:39.598018    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" path="/var/lib/kubelet/pods/44424c4a-35b5-424d-b1bf-bbf36f99bdcf/volumes"
Jun 09 16:05:45.654378 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:45.654352    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 16:05:45.656375 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:05:45.656350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 16:06:28.947896 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.947860    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"]
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948133    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="registry"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948145    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="registry"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948153    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="offline"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948158    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="offline"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948171    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="feast-init"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948176    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="feast-init"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948189    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948195    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948205    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948210    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948216    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="feast-apply"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948221    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="feast-apply"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948281    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="offline"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948288    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="ui"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948295    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="online"
Jun 09 16:06:28.948384 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.948302    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44424c4a-35b5-424d-b1bf-bbf36f99bdcf" containerName="registry"
Jun 09 16:06:28.951495 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.951467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:28.953925 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.953892    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 09 16:06:28.954071 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.953901    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-k624q\""
Jun 09 16:06:28.954071 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.954020    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 09 16:06:28.954071 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.954040    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 09 16:06:28.954241 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.954069    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 09 16:06:28.954893 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.954874    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 09 16:06:28.954893 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.954885    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 09 16:06:28.961945 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:28.961926    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"]
Jun 09 16:06:29.051789 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.051750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.051979 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.051803    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5lbx\" (UniqueName: \"kubernetes.io/projected/725718e4-9490-4511-8e18-bc0d35a6b484-kube-api-access-z5lbx\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.051979 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.051881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/725718e4-9490-4511-8e18-bc0d35a6b484-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.051979 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.051927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.051979 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.051945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/725718e4-9490-4511-8e18-bc0d35a6b484-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.052153 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.052034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.152784 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.152740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.152784 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.152793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lbx\" (UniqueName: \"kubernetes.io/projected/725718e4-9490-4511-8e18-bc0d35a6b484-kube-api-access-z5lbx\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.153096 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.152825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/725718e4-9490-4511-8e18-bc0d35a6b484-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.153096 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.152855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.153096 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.152869    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/725718e4-9490-4511-8e18-bc0d35a6b484-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.153096 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.152893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.153096 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:06:29.152904    2576 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 09 16:06:29.153096 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:06:29.152988    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls podName:725718e4-9490-4511-8e18-bc0d35a6b484 nodeName:}" failed. No retries permitted until 2026-06-09 16:06:29.6529636 +0000 UTC m=+1544.531743514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-c8hb8" (UID: "725718e4-9490-4511-8e18-bc0d35a6b484") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 09 16:06:29.153415 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.153374    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/725718e4-9490-4511-8e18-bc0d35a6b484-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.153625 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.153607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/725718e4-9490-4511-8e18-bc0d35a6b484-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.155335 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.155316    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.155448 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.155431    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.163402 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.163377    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5lbx\" (UniqueName: \"kubernetes.io/projected/725718e4-9490-4511-8e18-bc0d35a6b484-kube-api-access-z5lbx\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.657398 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.657336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.659743 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.659718    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-c8hb8\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.861119 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.861070    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:29.991610 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:29.991415    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"]
Jun 09 16:06:29.993798 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:06:29.993770    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod725718e4_9490_4511_8e18_bc0d35a6b484.slice/crio-0c209f3c3b7a7b9972108d8aa60695d0cc8f1dc05b5dae4ad9af253cff65b8d8 WatchSource:0}: Error finding container 0c209f3c3b7a7b9972108d8aa60695d0cc8f1dc05b5dae4ad9af253cff65b8d8: Status 404 returned error can't find the container with id 0c209f3c3b7a7b9972108d8aa60695d0cc8f1dc05b5dae4ad9af253cff65b8d8
Jun 09 16:06:30.564886 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:30.564844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerStarted","Data":"c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8"}
Jun 09 16:06:30.565094 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:30.564908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerStarted","Data":"0c209f3c3b7a7b9972108d8aa60695d0cc8f1dc05b5dae4ad9af253cff65b8d8"}
Jun 09 16:06:35.587190 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:35.587158    2576 generic.go:356] "Generic (PLEG): container finished" podID="725718e4-9490-4511-8e18-bc0d35a6b484" containerID="c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8" exitCode=0
Jun 09 16:06:35.587612 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:35.587225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerDied","Data":"c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8"}
Jun 09 16:06:36.593856 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:36.593815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerStarted","Data":"5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501"}
Jun 09 16:06:41.613890 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:41.613857    2576 generic.go:356] "Generic (PLEG): container finished" podID="725718e4-9490-4511-8e18-bc0d35a6b484" containerID="5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501" exitCode=0
Jun 09 16:06:41.614306 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:41.613911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerDied","Data":"5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501"}
Jun 09 16:06:42.621987 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:42.621949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerStarted","Data":"a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f"}
Jun 09 16:06:42.622493 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:42.622023    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerStarted","Data":"af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8"}
Jun 09 16:06:42.622493 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:42.622041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerStarted","Data":"6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae"}
Jun 09 16:06:42.645925 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:42.645858    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podStartSLOduration=14.64583617 podStartE2EDuration="14.64583617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:06:42.643671369 +0000 UTC m=+1557.522451303" watchObservedRunningTime="2026-06-09 16:06:42.64583617 +0000 UTC m=+1557.524616106"
Jun 09 16:06:44.861893 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:44.861846    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:44.862441 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:44.861915    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:44.862441 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:44.861934    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:44.863671 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:44.863631    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.32:8816: connect: connection refused"
Jun 09 16:06:44.863795 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:44.863696    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 09 16:06:44.863795 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:44.863704    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jun 09 16:06:47.862938 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:47.862905    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:47.863462 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:47.863051    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:47.863531 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:47.863478    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:47.863531 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:47.863521    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:47.863722 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:47.863705    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:47.863952 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:47.863939    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:47.867151 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:47.867130    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:48.648143 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:48.648107    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:06:48.651272 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:06:48.651249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:07:50.179859 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.179778    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"]
Jun 09 16:07:50.180429 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.180045    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online" containerID="cri-o://6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae" gracePeriod=30
Jun 09 16:07:50.180429 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.180093    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui" containerID="cri-o://a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f" gracePeriod=30
Jun 09 16:07:50.180429 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.180118    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="offline" containerID="cri-o://af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8" gracePeriod=30
Jun 09 16:07:50.322025 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.321973    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"]
Jun 09 16:07:50.322535 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.322285    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="registry" containerID="cri-o://d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e" gracePeriod=30
Jun 09 16:07:50.322535 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.322361    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="offline" containerID="cri-o://abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a" gracePeriod=30
Jun 09 16:07:50.322535 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.322392    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online" containerID="cri-o://2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e" gracePeriod=30
Jun 09 16:07:50.322535 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.322338    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui" containerID="cri-o://998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb" gracePeriod=30
Jun 09 16:07:50.887897 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.887859    2576 generic.go:356] "Generic (PLEG): container finished" podID="725718e4-9490-4511-8e18-bc0d35a6b484" containerID="a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f" exitCode=0
Jun 09 16:07:50.888129 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:50.887937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerDied","Data":"a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f"}
Jun 09 16:07:51.894559 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:51.894517    2576 generic.go:356] "Generic (PLEG): container finished" podID="07756441-633d-48ac-9f85-945b563dfba6" containerID="998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb" exitCode=0
Jun 09 16:07:51.894559 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:51.894545    2576 generic.go:356] "Generic (PLEG): container finished" podID="07756441-633d-48ac-9f85-945b563dfba6" containerID="2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e" exitCode=0
Jun 09 16:07:51.895063 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:51.894583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerDied","Data":"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"}
Jun 09 16:07:51.895063 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:51.894626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerDied","Data":"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"}
Jun 09 16:07:51.897146 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:51.897124    2576 generic.go:356] "Generic (PLEG): container finished" podID="725718e4-9490-4511-8e18-bc0d35a6b484" containerID="6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae" exitCode=0
Jun 09 16:07:51.897273 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:51.897197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerDied","Data":"6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae"}
Jun 09 16:07:56.030581 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:56.030537    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 16:07:56.317797 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:56.317712    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 16:07:57.863941 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:57.863888    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jun 09 16:07:58.648551 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:07:58.648502    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 09 16:08:06.030558 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:06.030507    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 16:08:06.317704 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:06.317608    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 16:08:07.864152 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:07.864109    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jun 09 16:08:08.649094 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:08.649050    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 09 16:08:16.030320 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:16.030267    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 16:08:16.030755 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:16.030421    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:08:16.317742 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:16.317645    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 16:08:16.317891 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:16.317767    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:08:17.864266 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:17.864222    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jun 09 16:08:17.864688 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:17.864367    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:08:18.648435 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:18.648386    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 09 16:08:18.648631 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:18.648526    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:08:20.424144 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.424116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:08:20.521603 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.521560    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/725718e4-9490-4511-8e18-bc0d35a6b484-feast-data\") pod \"725718e4-9490-4511-8e18-bc0d35a6b484\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") "
Jun 09 16:08:20.521603 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.521611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls\") pod \"725718e4-9490-4511-8e18-bc0d35a6b484\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") "
Jun 09 16:08:20.521878 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.521654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/725718e4-9490-4511-8e18-bc0d35a6b484-registry-tls\") pod \"725718e4-9490-4511-8e18-bc0d35a6b484\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") "
Jun 09 16:08:20.521878 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.521677    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5lbx\" (UniqueName: \"kubernetes.io/projected/725718e4-9490-4511-8e18-bc0d35a6b484-kube-api-access-z5lbx\") pod \"725718e4-9490-4511-8e18-bc0d35a6b484\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") "
Jun 09 16:08:20.521878 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.521696    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-online-tls\") pod \"725718e4-9490-4511-8e18-bc0d35a6b484\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") "
Jun 09 16:08:20.521878 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.521721    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-offline-tls\") pod \"725718e4-9490-4511-8e18-bc0d35a6b484\" (UID: \"725718e4-9490-4511-8e18-bc0d35a6b484\") "
Jun 09 16:08:20.522381 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.522344    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/725718e4-9490-4511-8e18-bc0d35a6b484-feast-data" (OuterVolumeSpecName: "feast-data") pod "725718e4-9490-4511-8e18-bc0d35a6b484" (UID: "725718e4-9490-4511-8e18-bc0d35a6b484"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:08:20.522546 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.522463    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/725718e4-9490-4511-8e18-bc0d35a6b484-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "725718e4-9490-4511-8e18-bc0d35a6b484" (UID: "725718e4-9490-4511-8e18-bc0d35a6b484"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 16:08:20.525176 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.525148    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "725718e4-9490-4511-8e18-bc0d35a6b484" (UID: "725718e4-9490-4511-8e18-bc0d35a6b484"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:08:20.528823 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.528792    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/725718e4-9490-4511-8e18-bc0d35a6b484-kube-api-access-z5lbx" (OuterVolumeSpecName: "kube-api-access-z5lbx") pod "725718e4-9490-4511-8e18-bc0d35a6b484" (UID: "725718e4-9490-4511-8e18-bc0d35a6b484"). InnerVolumeSpecName "kube-api-access-z5lbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:08:20.529120 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.529092    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "725718e4-9490-4511-8e18-bc0d35a6b484" (UID: "725718e4-9490-4511-8e18-bc0d35a6b484"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:08:20.529205 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.529163    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-online-tls" (OuterVolumeSpecName: "online-tls") pod "725718e4-9490-4511-8e18-bc0d35a6b484" (UID: "725718e4-9490-4511-8e18-bc0d35a6b484"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:08:20.623004 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.622960    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/725718e4-9490-4511-8e18-bc0d35a6b484-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:20.623174 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.623031    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5lbx\" (UniqueName: \"kubernetes.io/projected/725718e4-9490-4511-8e18-bc0d35a6b484-kube-api-access-z5lbx\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:20.623174 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.623044    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:20.623174 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.623053    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:20.623174 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.623061    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/725718e4-9490-4511-8e18-bc0d35a6b484-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:20.623174 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.623068    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/725718e4-9490-4511-8e18-bc0d35a6b484-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:20.965688 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:20.965660    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:08:21.012462 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.012433    2576 generic.go:356] "Generic (PLEG): container finished" podID="07756441-633d-48ac-9f85-945b563dfba6" containerID="abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a" exitCode=137
Jun 09 16:08:21.012462 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.012457    2576 generic.go:356] "Generic (PLEG): container finished" podID="07756441-633d-48ac-9f85-945b563dfba6" containerID="d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e" exitCode=137
Jun 09 16:08:21.012677 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.012494    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"
Jun 09 16:08:21.012677 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.012522    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerDied","Data":"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"}
Jun 09 16:08:21.012677 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.012581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerDied","Data":"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"}
Jun 09 16:08:21.012677 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.012601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b" event={"ID":"07756441-633d-48ac-9f85-945b563dfba6","Type":"ContainerDied","Data":"51c784f4a5f0fb81b65e811796ca7a4d2fd45e16e778d00b1967daf3a726cc49"}
Jun 09 16:08:21.012677 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.012626    2576 scope.go:117] "RemoveContainer" containerID="998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"
Jun 09 16:08:21.015139 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.015118    2576 generic.go:356] "Generic (PLEG): container finished" podID="725718e4-9490-4511-8e18-bc0d35a6b484" containerID="af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8" exitCode=137
Jun 09 16:08:21.015250 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.015154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerDied","Data":"af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8"}
Jun 09 16:08:21.015250 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.015193    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"
Jun 09 16:08:21.015330 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.015194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8" event={"ID":"725718e4-9490-4511-8e18-bc0d35a6b484","Type":"ContainerDied","Data":"0c209f3c3b7a7b9972108d8aa60695d0cc8f1dc05b5dae4ad9af253cff65b8d8"}
Jun 09 16:08:21.023247 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.023230    2576 scope.go:117] "RemoveContainer" containerID="abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"
Jun 09 16:08:21.025371 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.025352    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pf6m\" (UniqueName: \"kubernetes.io/projected/07756441-633d-48ac-9f85-945b563dfba6-kube-api-access-9pf6m\") pod \"07756441-633d-48ac-9f85-945b563dfba6\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") "
Jun 09 16:08:21.025496 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.025405    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07756441-633d-48ac-9f85-945b563dfba6-feast-data\") pod \"07756441-633d-48ac-9f85-945b563dfba6\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") "
Jun 09 16:08:21.025496 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.025434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-registry-tls\") pod \"07756441-633d-48ac-9f85-945b563dfba6\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") "
Jun 09 16:08:21.025496 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.025456    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-ui-tls\") pod \"07756441-633d-48ac-9f85-945b563dfba6\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") "
Jun 09 16:08:21.025496 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.025486    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls\") pod \"07756441-633d-48ac-9f85-945b563dfba6\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") "
Jun 09 16:08:21.025795 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.025566    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-online-tls\") pod \"07756441-633d-48ac-9f85-945b563dfba6\" (UID: \"07756441-633d-48ac-9f85-945b563dfba6\") "
Jun 09 16:08:21.026078 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.026049    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07756441-633d-48ac-9f85-945b563dfba6-feast-data" (OuterVolumeSpecName: "feast-data") pod "07756441-633d-48ac-9f85-945b563dfba6" (UID: "07756441-633d-48ac-9f85-945b563dfba6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:08:21.027757 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.027724    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "07756441-633d-48ac-9f85-945b563dfba6" (UID: "07756441-633d-48ac-9f85-945b563dfba6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:08:21.027868 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.027731    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-online-tls" (OuterVolumeSpecName: "online-tls") pod "07756441-633d-48ac-9f85-945b563dfba6" (UID: "07756441-633d-48ac-9f85-945b563dfba6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:08:21.028052 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.028029    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07756441-633d-48ac-9f85-945b563dfba6-kube-api-access-9pf6m" (OuterVolumeSpecName: "kube-api-access-9pf6m") pod "07756441-633d-48ac-9f85-945b563dfba6" (UID: "07756441-633d-48ac-9f85-945b563dfba6"). InnerVolumeSpecName "kube-api-access-9pf6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:08:21.028052 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.028037    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07756441-633d-48ac-9f85-945b563dfba6" (UID: "07756441-633d-48ac-9f85-945b563dfba6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:08:21.028239 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.028160    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "07756441-633d-48ac-9f85-945b563dfba6" (UID: "07756441-633d-48ac-9f85-945b563dfba6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:08:21.032321 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.032302    2576 scope.go:117] "RemoveContainer" containerID="2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"
Jun 09 16:08:21.038425 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.038402    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"]
Jun 09 16:08:21.040557 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.040540    2576 scope.go:117] "RemoveContainer" containerID="d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"
Jun 09 16:08:21.041906 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.041888    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-c8hb8"]
Jun 09 16:08:21.048142 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.048122    2576 scope.go:117] "RemoveContainer" containerID="2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"
Jun 09 16:08:21.057832 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.057804    2576 scope.go:117] "RemoveContainer" containerID="62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"
Jun 09 16:08:21.065028 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.064977    2576 scope.go:117] "RemoveContainer" containerID="998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"
Jun 09 16:08:21.065262 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.065242    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb\": container with ID starting with 998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb not found: ID does not exist" containerID="998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"
Jun 09 16:08:21.065319 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.065274    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"} err="failed to get container status \"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb\": rpc error: code = NotFound desc = could not find container \"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb\": container with ID starting with 998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb not found: ID does not exist"
Jun 09 16:08:21.065319 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.065294    2576 scope.go:117] "RemoveContainer" containerID="abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"
Jun 09 16:08:21.065528 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.065509    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a\": container with ID starting with abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a not found: ID does not exist" containerID="abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"
Jun 09 16:08:21.065569 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.065534    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"} err="failed to get container status \"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a\": rpc error: code = NotFound desc = could not find container \"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a\": container with ID starting with abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a not found: ID does not exist"
Jun 09 16:08:21.065569 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.065551    2576 scope.go:117] "RemoveContainer" containerID="2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"
Jun 09 16:08:21.065758 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.065743    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e\": container with ID starting with 2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e not found: ID does not exist" containerID="2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"
Jun 09 16:08:21.065804 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.065764    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"} err="failed to get container status \"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e\": rpc error: code = NotFound desc = could not find container \"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e\": container with ID starting with 2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e not found: ID does not exist"
Jun 09 16:08:21.065804 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.065778    2576 scope.go:117] "RemoveContainer" containerID="d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"
Jun 09 16:08:21.066001 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.065974    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e\": container with ID starting with d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e not found: ID does not exist" containerID="d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"
Jun 09 16:08:21.066047 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066014    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"} err="failed to get container status \"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e\": rpc error: code = NotFound desc = could not find container \"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e\": container with ID starting with d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e not found: ID does not exist"
Jun 09 16:08:21.066047 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066035    2576 scope.go:117] "RemoveContainer" containerID="2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"
Jun 09 16:08:21.066261 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.066242    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8\": container with ID starting with 2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8 not found: ID does not exist" containerID="2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"
Jun 09 16:08:21.066330 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066269    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"} err="failed to get container status \"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8\": rpc error: code = NotFound desc = could not find container \"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8\": container with ID starting with 2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8 not found: ID does not exist"
Jun 09 16:08:21.066330 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066290    2576 scope.go:117] "RemoveContainer" containerID="62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"
Jun 09 16:08:21.066529 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.066512    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f\": container with ID starting with 62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f not found: ID does not exist" containerID="62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"
Jun 09 16:08:21.066568 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066534    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"} err="failed to get container status \"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f\": rpc error: code = NotFound desc = could not find container \"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f\": container with ID starting with 62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f not found: ID does not exist"
Jun 09 16:08:21.066568 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066548    2576 scope.go:117] "RemoveContainer" containerID="998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"
Jun 09 16:08:21.066766 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066749    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb"} err="failed to get container status \"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb\": rpc error: code = NotFound desc = could not find container \"998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb\": container with ID starting with 998da8e26ce562ef9bfd493c8ec6cbf74442289ac1349ce5a75472b46dfee9bb not found: ID does not exist"
Jun 09 16:08:21.066811 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066767    2576 scope.go:117] "RemoveContainer" containerID="abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"
Jun 09 16:08:21.066982 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066961    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a"} err="failed to get container status \"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a\": rpc error: code = NotFound desc = could not find container \"abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a\": container with ID starting with abeb7b090e1ba62f748288db73d8f5c4051f0b40bf99315bcc51f647e47f510a not found: ID does not exist"
Jun 09 16:08:21.067052 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.066983    2576 scope.go:117] "RemoveContainer" containerID="2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"
Jun 09 16:08:21.067199 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067182    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e"} err="failed to get container status \"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e\": rpc error: code = NotFound desc = could not find container \"2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e\": container with ID starting with 2903230ca20b7d961d266e30eed74d8cdf4e5553b625bafe795046188ac8b46e not found: ID does not exist"
Jun 09 16:08:21.067250 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067198    2576 scope.go:117] "RemoveContainer" containerID="d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"
Jun 09 16:08:21.067413 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067395    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e"} err="failed to get container status \"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e\": rpc error: code = NotFound desc = could not find container \"d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e\": container with ID starting with d57032e722fd462d709e35555af8c7fdc179fe8faed2e23d46c05750ca38e07e not found: ID does not exist"
Jun 09 16:08:21.067488 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067415    2576 scope.go:117] "RemoveContainer" containerID="2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"
Jun 09 16:08:21.067664 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067645    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8"} err="failed to get container status \"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8\": rpc error: code = NotFound desc = could not find container \"2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8\": container with ID starting with 2454d200459802c9398df63be9b62ddd096329ba9741d5647e928b922ce5e8f8 not found: ID does not exist"
Jun 09 16:08:21.067712 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067665    2576 scope.go:117] "RemoveContainer" containerID="62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"
Jun 09 16:08:21.067872 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067855    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f"} err="failed to get container status \"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f\": rpc error: code = NotFound desc = could not find container \"62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f\": container with ID starting with 62e50b28636a0df9c1e12b605c89d491147ca1ab86128706775e3528c7c6b95f not found: ID does not exist"
Jun 09 16:08:21.067923 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.067874    2576 scope.go:117] "RemoveContainer" containerID="a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f"
Jun 09 16:08:21.075250 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.075232    2576 scope.go:117] "RemoveContainer" containerID="af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8"
Jun 09 16:08:21.082450 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.082433    2576 scope.go:117] "RemoveContainer" containerID="6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae"
Jun 09 16:08:21.089602 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.089588    2576 scope.go:117] "RemoveContainer" containerID="5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501"
Jun 09 16:08:21.096301 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.096284    2576 scope.go:117] "RemoveContainer" containerID="c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8"
Jun 09 16:08:21.103031 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.102878    2576 scope.go:117] "RemoveContainer" containerID="a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f"
Jun 09 16:08:21.103163 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.103146    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f\": container with ID starting with a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f not found: ID does not exist" containerID="a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f"
Jun 09 16:08:21.103215 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103170    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f"} err="failed to get container status \"a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f\": rpc error: code = NotFound desc = could not find container \"a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f\": container with ID starting with a013cb8ee9b04e4f45ef28a7a641a02490026cbb84e3adf5360f8b6accfc7c0f not found: ID does not exist"
Jun 09 16:08:21.103215 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103189    2576 scope.go:117] "RemoveContainer" containerID="af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8"
Jun 09 16:08:21.103412 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.103394    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8\": container with ID starting with af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8 not found: ID does not exist" containerID="af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8"
Jun 09 16:08:21.103476 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103421    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8"} err="failed to get container status \"af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8\": rpc error: code = NotFound desc = could not find container \"af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8\": container with ID starting with af4dc318d7d7609d10739ad64a36bcb5cd610efbec519c5fd694dc20d9fe4dc8 not found: ID does not exist"
Jun 09 16:08:21.103476 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103442    2576 scope.go:117] "RemoveContainer" containerID="6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae"
Jun 09 16:08:21.103701 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.103683    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae\": container with ID starting with 6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae not found: ID does not exist" containerID="6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae"
Jun 09 16:08:21.103745 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103706    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae"} err="failed to get container status \"6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae\": rpc error: code = NotFound desc = could not find container \"6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae\": container with ID starting with 6c0329267bdb87bea759e59e244a84642fd1cfc581d0ff461cf76f4393c0caae not found: ID does not exist"
Jun 09 16:08:21.103745 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103719    2576 scope.go:117] "RemoveContainer" containerID="5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501"
Jun 09 16:08:21.103933 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.103916    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501\": container with ID starting with 5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501 not found: ID does not exist" containerID="5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501"
Jun 09 16:08:21.103978 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103938    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501"} err="failed to get container status \"5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501\": rpc error: code = NotFound desc = could not find container \"5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501\": container with ID starting with 5f85ad5de6475983eb0d5c619a6672c8857fc9e57af67ab0082c215ccfff9501 not found: ID does not exist"
Jun 09 16:08:21.103978 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.103954    2576 scope.go:117] "RemoveContainer" containerID="c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8"
Jun 09 16:08:21.104202 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:08:21.104186    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8\": container with ID starting with c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8 not found: ID does not exist" containerID="c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8"
Jun 09 16:08:21.104246 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.104206    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8"} err="failed to get container status \"c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8\": rpc error: code = NotFound desc = could not find container \"c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8\": container with ID starting with c613741ef886e1634c3adf038d29f6713003273ccd4345143444f2c439aa15c8 not found: ID does not exist"
Jun 09 16:08:21.126174 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.126146    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:21.126174 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.126170    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pf6m\" (UniqueName: \"kubernetes.io/projected/07756441-633d-48ac-9f85-945b563dfba6-kube-api-access-9pf6m\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:21.126301 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.126187    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07756441-633d-48ac-9f85-945b563dfba6-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:21.126301 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.126199    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:21.126301 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.126209    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:21.126301 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.126220    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07756441-633d-48ac-9f85-945b563dfba6-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:08:21.335456 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.335417    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"]
Jun 09 16:08:21.338603 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.338575    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-fwb2b"]
Jun 09 16:08:21.597803 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.597761    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07756441-633d-48ac-9f85-945b563dfba6" path="/var/lib/kubelet/pods/07756441-633d-48ac-9f85-945b563dfba6/volumes"
Jun 09 16:08:21.598582 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:08:21.598558    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" path="/var/lib/kubelet/pods/725718e4-9490-4511-8e18-bc0d35a6b484/volumes"
Jun 09 16:09:02.230591 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230497    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"]
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230744    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230754    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230765    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="feast-apply"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230770    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="feast-apply"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230778    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="feast-init"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230783    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="feast-init"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230790    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="offline"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230795    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="offline"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230803    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230808    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230814    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="feast-apply"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230819    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="feast-apply"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230829    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="feast-init"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230835    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="feast-init"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230845    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230850    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230855    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="offline"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230861    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="offline"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230866    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230872    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230877    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="registry"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230882    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="registry"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230923    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="offline"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230930    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="online"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230936    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="registry"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230942    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="offline"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230947    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="ui"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230952    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07756441-633d-48ac-9f85-945b563dfba6" containerName="online"
Jun 09 16:09:02.231115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.230958    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="725718e4-9490-4511-8e18-bc0d35a6b484" containerName="ui"
Jun 09 16:09:02.235598 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.235577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.238345 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.238316    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 09 16:09:02.238345 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.238316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 09 16:09:02.238567 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.238358    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 09 16:09:02.238567 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.238407    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 09 16:09:02.238715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.238695    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 09 16:09:02.238715 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.238709    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 09 16:09:02.238865 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.238768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8pwpx\""
Jun 09 16:09:02.245562 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.245538    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"]
Jun 09 16:09:02.327508 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.327466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4nj\" (UniqueName: \"kubernetes.io/projected/5d58785b-eef6-421c-aa0e-dff4f8e83844-kube-api-access-2k4nj\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.327703 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.327515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d58785b-eef6-421c-aa0e-dff4f8e83844-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.327703 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.327603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.327703 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.327657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.327703 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.327698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.327869 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.327738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.429043 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.428954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4nj\" (UniqueName: \"kubernetes.io/projected/5d58785b-eef6-421c-aa0e-dff4f8e83844-kube-api-access-2k4nj\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.429268 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.429057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d58785b-eef6-421c-aa0e-dff4f8e83844-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.429268 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.429091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.429268 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.429108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.429268 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.429145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.429268 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.429181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.429268 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:09:02.429236    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 09 16:09:02.429597 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:09:02.429350    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls podName:5d58785b-eef6-421c-aa0e-dff4f8e83844 nodeName:}" failed. No retries permitted until 2026-06-09 16:09:02.929326298 +0000 UTC m=+1697.808106225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls") pod "feast-simple-feast-setup-75c64c888b-jfb4j" (UID: "5d58785b-eef6-421c-aa0e-dff4f8e83844") : secret "feast-simple-feast-setup-online-tls" not found
Jun 09 16:09:02.429597 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.429527    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d58785b-eef6-421c-aa0e-dff4f8e83844-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.431740 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.431713    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.431847 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.431742    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.431892 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.431867    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.442244 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.438150    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4nj\" (UniqueName: \"kubernetes.io/projected/5d58785b-eef6-421c-aa0e-dff4f8e83844-kube-api-access-2k4nj\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.933931 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.933885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:02.936357 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:02.936326    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jfb4j\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:03.156190 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:03.156135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:03.303561 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:03.303535    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"]
Jun 09 16:09:03.305626 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:09:03.305595    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d58785b_eef6_421c_aa0e_dff4f8e83844.slice/crio-9af7ee8277057c538840ebf39f7075d4d02d56ac52a26eb14cb193d0390be13d WatchSource:0}: Error finding container 9af7ee8277057c538840ebf39f7075d4d02d56ac52a26eb14cb193d0390be13d: Status 404 returned error can't find the container with id 9af7ee8277057c538840ebf39f7075d4d02d56ac52a26eb14cb193d0390be13d
Jun 09 16:09:04.173311 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:04.173268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerStarted","Data":"f853fb364da456e316fd0bab6d5978a54815b5bc0ad9c6cc94a994cb5babd0c9"}
Jun 09 16:09:04.173496 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:04.173326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerStarted","Data":"9af7ee8277057c538840ebf39f7075d4d02d56ac52a26eb14cb193d0390be13d"}
Jun 09 16:09:08.191968 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:08.191928    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerID="f853fb364da456e316fd0bab6d5978a54815b5bc0ad9c6cc94a994cb5babd0c9" exitCode=0
Jun 09 16:09:08.191968 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:08.191974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerDied","Data":"f853fb364da456e316fd0bab6d5978a54815b5bc0ad9c6cc94a994cb5babd0c9"}
Jun 09 16:09:09.197326 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:09.197289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerStarted","Data":"f409d678ef612256359b1473ebe7dabfc0db372c89c400b0860282866820ba6c"}
Jun 09 16:09:14.219723 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:14.219687    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerID="f409d678ef612256359b1473ebe7dabfc0db372c89c400b0860282866820ba6c" exitCode=0
Jun 09 16:09:14.220111 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:14.219731    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerDied","Data":"f409d678ef612256359b1473ebe7dabfc0db372c89c400b0860282866820ba6c"}
Jun 09 16:09:15.238596 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:15.238547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerStarted","Data":"cce0116f613155052f6784144b8c8aadd868668514f53256a0f74b809103ea54"}
Jun 09 16:09:15.239127 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:15.238617    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerStarted","Data":"caac18ea80858c02f6c8c6dfa8c2d7c00d23ffeee7d47b36e178fbffdfa75f6e"}
Jun 09 16:09:15.239127 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:15.238647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerStarted","Data":"3edaab59a941682b9619af93f802af2fafa8993e7307f7faf5e6073f8b8e3518"}
Jun 09 16:09:15.239127 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:15.238672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerStarted","Data":"84db4e5b54adf13efeefb8ef5612572f6d7079c3a5705b0fd5eab913b3a46f4c"}
Jun 09 16:09:15.263784 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:15.263714    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podStartSLOduration=13.263691114 podStartE2EDuration="13.263691114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:09:15.26178279 +0000 UTC m=+1710.140562725" watchObservedRunningTime="2026-06-09 16:09:15.263691114 +0000 UTC m=+1710.142471051"
Jun 09 16:09:18.157430 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.157109    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:18.157430 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.157176    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:18.157430 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.157194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:18.158081 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.157648    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:18.159393 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.159350    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Jun 09 16:09:18.159393 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.159366    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 16:09:18.159393 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.159384    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
Jun 09 16:09:18.159667 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:18.159480    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 16:09:21.157594 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.157556    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.158105 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.158078    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.158163 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.158116    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.158226 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.158216    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.158343 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.158324    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.162297 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.162277    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.268055 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.268018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.268272 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.268075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.268272 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.268095    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.268512 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.268493    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.268633 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.268612    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:09:21.271062 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:09:21.271044    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:10:23.403918 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.403880    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"]
Jun 09 16:10:23.404482 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.404189    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="registry" containerID="cri-o://84db4e5b54adf13efeefb8ef5612572f6d7079c3a5705b0fd5eab913b3a46f4c" gracePeriod=30
Jun 09 16:10:23.404482 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.404227    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="offline" containerID="cri-o://caac18ea80858c02f6c8c6dfa8c2d7c00d23ffeee7d47b36e178fbffdfa75f6e" gracePeriod=30
Jun 09 16:10:23.404482 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.404238    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online" containerID="cri-o://3edaab59a941682b9619af93f802af2fafa8993e7307f7faf5e6073f8b8e3518" gracePeriod=30
Jun 09 16:10:23.404482 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.404369    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui" containerID="cri-o://cce0116f613155052f6784144b8c8aadd868668514f53256a0f74b809103ea54" gracePeriod=30
Jun 09 16:10:23.799265 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.799218    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"]
Jun 09 16:10:23.803632 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.803604    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:23.807668 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.807641    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-g2ltx\""
Jun 09 16:10:23.844406 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.844366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"]
Jun 09 16:10:23.990868 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.990823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:23.990868 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.990866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:23.991175 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.990892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-568bq\" (UniqueName: \"kubernetes.io/projected/396d4d4e-5ff4-4355-860b-2f7a02791cda-kube-api-access-568bq\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:23.991175 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.990985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396d4d4e-5ff4-4355-860b-2f7a02791cda-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:23.991175 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.991034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:23.991175 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:23.991085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091499 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.091471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396d4d4e-5ff4-4355-860b-2f7a02791cda-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091628 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.091524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091628 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.091558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091900 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.091628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091900 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.091656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091900 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.091686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-568bq\" (UniqueName: \"kubernetes.io/projected/396d4d4e-5ff4-4355-860b-2f7a02791cda-kube-api-access-568bq\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091900 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:10:24.091758    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 16:10:24.091900 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.091827    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396d4d4e-5ff4-4355-860b-2f7a02791cda-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.091900 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:10:24.091837    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls podName:396d4d4e-5ff4-4355-860b-2f7a02791cda nodeName:}" failed. No retries permitted until 2026-06-09 16:10:24.591816997 +0000 UTC m=+1779.470596913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls") pod "feast-simple-feast-setup-75c64c888b-hpnl9" (UID: "396d4d4e-5ff4-4355-860b-2f7a02791cda") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 16:10:24.093940 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.093916    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.094109 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.094089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.094177 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.094089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.101420 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.101394    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-568bq\" (UniqueName: \"kubernetes.io/projected/396d4d4e-5ff4-4355-860b-2f7a02791cda-kube-api-access-568bq\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.498428 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.498388    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerID="cce0116f613155052f6784144b8c8aadd868668514f53256a0f74b809103ea54" exitCode=0
Jun 09 16:10:24.498428 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.498417    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerID="3edaab59a941682b9619af93f802af2fafa8993e7307f7faf5e6073f8b8e3518" exitCode=0
Jun 09 16:10:24.498840 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.498460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerDied","Data":"cce0116f613155052f6784144b8c8aadd868668514f53256a0f74b809103ea54"}
Jun 09 16:10:24.498840 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.498502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerDied","Data":"3edaab59a941682b9619af93f802af2fafa8993e7307f7faf5e6073f8b8e3518"}
Jun 09 16:10:24.594955 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.594921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.597286 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.597265    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hpnl9\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.715092 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.715057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:24.847187 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:24.847154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"]
Jun 09 16:10:24.848487 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:10:24.848459    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod396d4d4e_5ff4_4355_860b_2f7a02791cda.slice/crio-7ff65b181fad6b14a48bc82eeb40c7be3981357727b4659362570be119fccc94 WatchSource:0}: Error finding container 7ff65b181fad6b14a48bc82eeb40c7be3981357727b4659362570be119fccc94: Status 404 returned error can't find the container with id 7ff65b181fad6b14a48bc82eeb40c7be3981357727b4659362570be119fccc94
Jun 09 16:10:25.504272 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:25.504235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerStarted","Data":"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"}
Jun 09 16:10:25.504646 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:25.504286    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerStarted","Data":"7ff65b181fad6b14a48bc82eeb40c7be3981357727b4659362570be119fccc94"}
Jun 09 16:10:29.522519 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:29.522486    2576 generic.go:356] "Generic (PLEG): container finished" podID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerID="9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895" exitCode=0
Jun 09 16:10:29.522889 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:29.522525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerDied","Data":"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"}
Jun 09 16:10:30.527713 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:30.527672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerStarted","Data":"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"}
Jun 09 16:10:31.268167 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:31.268116    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 16:10:31.268375 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:31.268133    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 16:10:35.547622 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:35.547586    2576 generic.go:356] "Generic (PLEG): container finished" podID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerID="df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825" exitCode=0
Jun 09 16:10:35.547983 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:35.547649    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerDied","Data":"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"}
Jun 09 16:10:36.557075 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.557028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerStarted","Data":"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"}
Jun 09 16:10:36.557564 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.557096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerStarted","Data":"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"}
Jun 09 16:10:36.557564 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.557120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerStarted","Data":"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"}
Jun 09 16:10:36.557564 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.557140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerStarted","Data":"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"}
Jun 09 16:10:36.585132 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.585059    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podStartSLOduration=13.585035526 podStartE2EDuration="13.585035526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:10:36.583140012 +0000 UTC m=+1791.461919967" watchObservedRunningTime="2026-06-09 16:10:36.585035526 +0000 UTC m=+1791.463815463"
Jun 09 16:10:36.716307 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.716261    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:36.716511 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.716335    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:36.716511 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.716358    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:36.716511 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.716376    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:36.718654 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.718608    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
Jun 09 16:10:36.718811 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.718641    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 16:10:36.718811 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.718655    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
Jun 09 16:10:36.719076 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:36.719042    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 16:10:39.715829 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:39.715787    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
Jun 09 16:10:39.716463 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:39.715784    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
Jun 09 16:10:39.716677 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:39.715804    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 16:10:39.716842 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:39.715912    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 16:10:41.268446 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:41.268399    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 16:10:41.268946 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:41.268412    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 16:10:42.716948 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.716917    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717352 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717040    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717352 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717139    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717504 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717421    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717504 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717473    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717504 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717492    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717764 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717921 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717907    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.717987 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.717975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:42.721619 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:42.721600    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:43.598261 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:43.598232    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:43.598456 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:43.598305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:10:45.677923 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:45.677894    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 16:10:45.681227 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:45.681201    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 16:10:51.268647 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:51.268597    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 16:10:51.269098 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:51.268677    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 16:10:51.269098 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:51.268731    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:10:51.269098 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:51.268796    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:10:53.629309 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:53.629278    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerID="caac18ea80858c02f6c8c6dfa8c2d7c00d23ffeee7d47b36e178fbffdfa75f6e" exitCode=137
Jun 09 16:10:53.629309 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:53.629301    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerID="84db4e5b54adf13efeefb8ef5612572f6d7079c3a5705b0fd5eab913b3a46f4c" exitCode=137
Jun 09 16:10:53.629749 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:53.629348    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerDied","Data":"caac18ea80858c02f6c8c6dfa8c2d7c00d23ffeee7d47b36e178fbffdfa75f6e"}
Jun 09 16:10:53.629749 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:53.629392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerDied","Data":"84db4e5b54adf13efeefb8ef5612572f6d7079c3a5705b0fd5eab913b3a46f4c"}
Jun 09 16:10:54.052874 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.052848    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:10:54.127857 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.127820    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k4nj\" (UniqueName: \"kubernetes.io/projected/5d58785b-eef6-421c-aa0e-dff4f8e83844-kube-api-access-2k4nj\") pod \"5d58785b-eef6-421c-aa0e-dff4f8e83844\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") "
Jun 09 16:10:54.127857 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.127862    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d58785b-eef6-421c-aa0e-dff4f8e83844-feast-data\") pod \"5d58785b-eef6-421c-aa0e-dff4f8e83844\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") "
Jun 09 16:10:54.128151 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.127930    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls\") pod \"5d58785b-eef6-421c-aa0e-dff4f8e83844\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") "
Jun 09 16:10:54.128151 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.127956    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-offline-tls\") pod \"5d58785b-eef6-421c-aa0e-dff4f8e83844\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") "
Jun 09 16:10:54.128151 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.127979    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-ui-tls\") pod \"5d58785b-eef6-421c-aa0e-dff4f8e83844\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") "
Jun 09 16:10:54.128151 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.128051    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-registry-tls\") pod \"5d58785b-eef6-421c-aa0e-dff4f8e83844\" (UID: \"5d58785b-eef6-421c-aa0e-dff4f8e83844\") "
Jun 09 16:10:54.128539 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.128506    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d58785b-eef6-421c-aa0e-dff4f8e83844-feast-data" (OuterVolumeSpecName: "feast-data") pod "5d58785b-eef6-421c-aa0e-dff4f8e83844" (UID: "5d58785b-eef6-421c-aa0e-dff4f8e83844"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:10:54.130373 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.130347    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls" (OuterVolumeSpecName: "online-tls") pod "5d58785b-eef6-421c-aa0e-dff4f8e83844" (UID: "5d58785b-eef6-421c-aa0e-dff4f8e83844"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:10:54.130575 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.130545    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d58785b-eef6-421c-aa0e-dff4f8e83844-kube-api-access-2k4nj" (OuterVolumeSpecName: "kube-api-access-2k4nj") pod "5d58785b-eef6-421c-aa0e-dff4f8e83844" (UID: "5d58785b-eef6-421c-aa0e-dff4f8e83844"). InnerVolumeSpecName "kube-api-access-2k4nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:10:54.130646 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.130585    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5d58785b-eef6-421c-aa0e-dff4f8e83844" (UID: "5d58785b-eef6-421c-aa0e-dff4f8e83844"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:10:54.130646 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.130594    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5d58785b-eef6-421c-aa0e-dff4f8e83844" (UID: "5d58785b-eef6-421c-aa0e-dff4f8e83844"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:10:54.130646 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.130617    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5d58785b-eef6-421c-aa0e-dff4f8e83844" (UID: "5d58785b-eef6-421c-aa0e-dff4f8e83844"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:10:54.229180 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.229125    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:10:54.229180 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.229175    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:10:54.229180 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.229183    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:10:54.229180 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.229193    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k4nj\" (UniqueName: \"kubernetes.io/projected/5d58785b-eef6-421c-aa0e-dff4f8e83844-kube-api-access-2k4nj\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:10:54.229477 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.229203    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5d58785b-eef6-421c-aa0e-dff4f8e83844-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:10:54.229477 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.229212    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5d58785b-eef6-421c-aa0e-dff4f8e83844-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:10:54.636248 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.636176    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"
Jun 09 16:10:54.636756 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.636170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j" event={"ID":"5d58785b-eef6-421c-aa0e-dff4f8e83844","Type":"ContainerDied","Data":"9af7ee8277057c538840ebf39f7075d4d02d56ac52a26eb14cb193d0390be13d"}
Jun 09 16:10:54.636756 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.636357    2576 scope.go:117] "RemoveContainer" containerID="cce0116f613155052f6784144b8c8aadd868668514f53256a0f74b809103ea54"
Jun 09 16:10:54.646172 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.646149    2576 scope.go:117] "RemoveContainer" containerID="caac18ea80858c02f6c8c6dfa8c2d7c00d23ffeee7d47b36e178fbffdfa75f6e"
Jun 09 16:10:54.654253 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.654234    2576 scope.go:117] "RemoveContainer" containerID="3edaab59a941682b9619af93f802af2fafa8993e7307f7faf5e6073f8b8e3518"
Jun 09 16:10:54.659324 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.659290    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"]
Jun 09 16:10:54.662699 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.662672    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jfb4j"]
Jun 09 16:10:54.662948 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.662927    2576 scope.go:117] "RemoveContainer" containerID="84db4e5b54adf13efeefb8ef5612572f6d7079c3a5705b0fd5eab913b3a46f4c"
Jun 09 16:10:54.670897 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.670877    2576 scope.go:117] "RemoveContainer" containerID="f409d678ef612256359b1473ebe7dabfc0db372c89c400b0860282866820ba6c"
Jun 09 16:10:54.678435 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:54.678411    2576 scope.go:117] "RemoveContainer" containerID="f853fb364da456e316fd0bab6d5978a54815b5bc0ad9c6cc94a994cb5babd0c9"
Jun 09 16:10:55.598749 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:10:55.598715    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" path="/var/lib/kubelet/pods/5d58785b-eef6-421c-aa0e-dff4f8e83844/volumes"
Jun 09 16:11:45.135732 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.135692    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"]
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.135969    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="feast-apply"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.135981    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="feast-apply"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136004    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136013    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136036    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="registry"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136043    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="registry"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136053    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="offline"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136057    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="offline"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136065    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="feast-init"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136070    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="feast-init"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136077    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136082    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136125    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="offline"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136134    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="online"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136140    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="ui"
Jun 09 16:11:45.136257 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.136148    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d58785b-eef6-421c-aa0e-dff4f8e83844" containerName="registry"
Jun 09 16:11:45.139342 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.139324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.145027 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.142765    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 09 16:11:45.145027 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.143136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mxbf5\""
Jun 09 16:11:45.145027 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.143371    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 09 16:11:45.145027 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.144944    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 09 16:11:45.145328 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.145073    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 09 16:11:45.145328 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.145126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 09 16:11:45.145840 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.145501    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 09 16:11:45.149591 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.149570    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"]
Jun 09 16:11:45.229281 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.229239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.229501 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.229311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c518f118-e2e3-4288-91b0-015afb9af152-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.229501 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.229336    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2bxg\" (UniqueName: \"kubernetes.io/projected/c518f118-e2e3-4288-91b0-015afb9af152-kube-api-access-z2bxg\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.229501 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.229396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.229501 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.229459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.229501 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.229481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c518f118-e2e3-4288-91b0-015afb9af152-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.329892 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.329848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.329909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c518f118-e2e3-4288-91b0-015afb9af152-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.329928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2bxg\" (UniqueName: \"kubernetes.io/projected/c518f118-e2e3-4288-91b0-015afb9af152-kube-api-access-z2bxg\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.329957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.329980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.330017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c518f118-e2e3-4288-91b0-015afb9af152-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:11:45.330039    2576 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:11:45.330119    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls podName:c518f118-e2e3-4288-91b0-015afb9af152 nodeName:}" failed. No retries permitted until 2026-06-09 16:11:45.830097351 +0000 UTC m=+1860.708877280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-hczlg" (UID: "c518f118-e2e3-4288-91b0-015afb9af152") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 09 16:11:45.330125 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:11:45.330121    2576 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 09 16:11:45.330437 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:11:45.330159    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls podName:c518f118-e2e3-4288-91b0-015afb9af152 nodeName:}" failed. No retries permitted until 2026-06-09 16:11:45.830149947 +0000 UTC m=+1860.708929859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-hczlg" (UID: "c518f118-e2e3-4288-91b0-015afb9af152") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 09 16:11:45.330437 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.330422    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c518f118-e2e3-4288-91b0-015afb9af152-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.330702 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.330679    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c518f118-e2e3-4288-91b0-015afb9af152-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.332537 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.332519    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.338117 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.338094    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2bxg\" (UniqueName: \"kubernetes.io/projected/c518f118-e2e3-4288-91b0-015afb9af152-kube-api-access-z2bxg\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.834723 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.834689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.834915 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.834834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.837108 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.837074    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:45.837258 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:45.837191    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hczlg\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:46.054056 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:46.054022    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mxbf5\""
Jun 09 16:11:46.061381 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:46.061352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:11:46.194909 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:46.194880    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"]
Jun 09 16:11:46.196725 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:11:46.196699    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc518f118_e2e3_4288_91b0_015afb9af152.slice/crio-868397e77fdc698444ead4a7dfe2be6c65cf16c3a7a9ddad087cd78f00941116 WatchSource:0}: Error finding container 868397e77fdc698444ead4a7dfe2be6c65cf16c3a7a9ddad087cd78f00941116: Status 404 returned error can't find the container with id 868397e77fdc698444ead4a7dfe2be6c65cf16c3a7a9ddad087cd78f00941116
Jun 09 16:11:46.826874 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:46.826831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerStarted","Data":"3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927"}
Jun 09 16:11:46.827093 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:46.826881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerStarted","Data":"868397e77fdc698444ead4a7dfe2be6c65cf16c3a7a9ddad087cd78f00941116"}
Jun 09 16:11:51.847149 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:51.847114    2576 generic.go:356] "Generic (PLEG): container finished" podID="c518f118-e2e3-4288-91b0-015afb9af152" containerID="3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927" exitCode=0
Jun 09 16:11:51.847574 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:51.847161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerDied","Data":"3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927"}
Jun 09 16:11:52.854111 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:52.854080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerStarted","Data":"37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99"}
Jun 09 16:11:57.876964 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:57.876831    2576 generic.go:356] "Generic (PLEG): container finished" podID="c518f118-e2e3-4288-91b0-015afb9af152" containerID="37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99" exitCode=0
Jun 09 16:11:57.876964 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:57.876908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerDied","Data":"37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99"}
Jun 09 16:11:58.887122 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:58.886282    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerStarted","Data":"0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab"}
Jun 09 16:11:58.887122 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:58.886333    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerStarted","Data":"eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74"}
Jun 09 16:11:58.887122 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:58.886353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerStarted","Data":"34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47"}
Jun 09 16:11:58.909345 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:11:58.909280    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podStartSLOduration=13.909260548 podStartE2EDuration="13.909260548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:11:58.907788461 +0000 UTC m=+1873.786568398" watchObservedRunningTime="2026-06-09 16:11:58.909260548 +0000 UTC m=+1873.788040483"
Jun 09 16:12:01.062418 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:01.062374    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:01.062933 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:01.062443    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:01.062933 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:01.062459    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:01.064432 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:01.064390    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Jun 09 16:12:01.064587 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:01.064390    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 16:12:01.064587 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:01.064469    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 16:12:04.063042 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.062981    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.063556 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.063277    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.063652 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.063635    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.063721 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.063682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.063839 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.063817    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.063883 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.063871    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.067472 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.067449    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.915320 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.915287    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:12:04.918336 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:12:04.918307    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:13:06.287676 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.287639    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"]
Jun 09 16:13:06.288224 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.287899    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online" containerID="cri-o://34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47" gracePeriod=30
Jun 09 16:13:06.288224 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.287969    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="offline" containerID="cri-o://eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74" gracePeriod=30
Jun 09 16:13:06.288224 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.287967    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui" containerID="cri-o://0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab" gracePeriod=30
Jun 09 16:13:06.441141 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.441105    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"]
Jun 09 16:13:06.441368 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.441340    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="registry" containerID="cri-o://7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8" gracePeriod=30
Jun 09 16:13:06.441477 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.441438    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="offline" containerID="cri-o://09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f" gracePeriod=30
Jun 09 16:13:06.441477 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.441436    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui" containerID="cri-o://3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78" gracePeriod=30
Jun 09 16:13:06.441603 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:06.441517    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online" containerID="cri-o://3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1" gracePeriod=30
Jun 09 16:13:07.161841 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:07.161815    2576 generic.go:356] "Generic (PLEG): container finished" podID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerID="3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78" exitCode=0
Jun 09 16:13:07.161938 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:07.161891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerDied","Data":"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"}
Jun 09 16:13:07.164238 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:07.164218    2576 generic.go:356] "Generic (PLEG): container finished" podID="c518f118-e2e3-4288-91b0-015afb9af152" containerID="0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab" exitCode=0
Jun 09 16:13:07.164238 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:07.164235    2576 generic.go:356] "Generic (PLEG): container finished" podID="c518f118-e2e3-4288-91b0-015afb9af152" containerID="34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47" exitCode=0
Jun 09 16:13:07.164359 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:07.164271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerDied","Data":"0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab"}
Jun 09 16:13:07.164359 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:07.164297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerDied","Data":"34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47"}
Jun 09 16:13:08.171037 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:08.170983    2576 generic.go:356] "Generic (PLEG): container finished" podID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerID="3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1" exitCode=0
Jun 09 16:13:08.171037 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:08.171022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerDied","Data":"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"}
Jun 09 16:13:12.718050 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:12.717972    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 16:13:13.594399 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:13.594348    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 16:13:14.063978 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:14.063931    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 16:13:14.916082 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:14.916028    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 16:13:22.718637 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:22.718570    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 16:13:23.593701 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:23.593644    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 16:13:24.063843 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:24.063790    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 16:13:24.916513 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:24.916466    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 16:13:32.717809 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:32.717706    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 16:13:32.718295 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:32.717906    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:13:33.594431 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:33.594389    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 16:13:33.598563 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:33.598541    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:13:34.064035 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:34.063977    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 16:13:34.064460 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:34.064105    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:13:34.915907 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:34.915856    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 16:13:34.916167 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:34.916038    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:13:36.938912 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.938878    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:13:36.983005 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.982960    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-offline-tls\") pod \"c518f118-e2e3-4288-91b0-015afb9af152\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") "
Jun 09 16:13:36.983208 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.983028    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c518f118-e2e3-4288-91b0-015afb9af152-feast-data\") pod \"c518f118-e2e3-4288-91b0-015afb9af152\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") "
Jun 09 16:13:36.983208 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.983050    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls\") pod \"c518f118-e2e3-4288-91b0-015afb9af152\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") "
Jun 09 16:13:36.983208 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.983101    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c518f118-e2e3-4288-91b0-015afb9af152-registry-tls\") pod \"c518f118-e2e3-4288-91b0-015afb9af152\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") "
Jun 09 16:13:36.983208 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.983145    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls\") pod \"c518f118-e2e3-4288-91b0-015afb9af152\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") "
Jun 09 16:13:36.983208 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.983185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2bxg\" (UniqueName: \"kubernetes.io/projected/c518f118-e2e3-4288-91b0-015afb9af152-kube-api-access-z2bxg\") pod \"c518f118-e2e3-4288-91b0-015afb9af152\" (UID: \"c518f118-e2e3-4288-91b0-015afb9af152\") "
Jun 09 16:13:36.983587 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.983559    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c518f118-e2e3-4288-91b0-015afb9af152-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c518f118-e2e3-4288-91b0-015afb9af152" (UID: "c518f118-e2e3-4288-91b0-015afb9af152"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 16:13:36.983656 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.983569    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c518f118-e2e3-4288-91b0-015afb9af152-feast-data" (OuterVolumeSpecName: "feast-data") pod "c518f118-e2e3-4288-91b0-015afb9af152" (UID: "c518f118-e2e3-4288-91b0-015afb9af152"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:13:36.985365 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.985335    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c518f118-e2e3-4288-91b0-015afb9af152" (UID: "c518f118-e2e3-4288-91b0-015afb9af152"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:13:36.985484 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.985457    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c518f118-e2e3-4288-91b0-015afb9af152" (UID: "c518f118-e2e3-4288-91b0-015afb9af152"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:13:36.985527 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.985485    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c518f118-e2e3-4288-91b0-015afb9af152-kube-api-access-z2bxg" (OuterVolumeSpecName: "kube-api-access-z2bxg") pod "c518f118-e2e3-4288-91b0-015afb9af152" (UID: "c518f118-e2e3-4288-91b0-015afb9af152"). InnerVolumeSpecName "kube-api-access-z2bxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:13:36.985632 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:36.985617    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls" (OuterVolumeSpecName: "online-tls") pod "c518f118-e2e3-4288-91b0-015afb9af152" (UID: "c518f118-e2e3-4288-91b0-015afb9af152"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:13:37.083277 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.083247    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:13:37.083734 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.083713    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c518f118-e2e3-4288-91b0-015afb9af152-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.083734 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.083734    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.083854 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.083744    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2bxg\" (UniqueName: \"kubernetes.io/projected/c518f118-e2e3-4288-91b0-015afb9af152-kube-api-access-z2bxg\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.083854 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.083753    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.083854 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.083763    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c518f118-e2e3-4288-91b0-015afb9af152-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.083854 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.083771    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c518f118-e2e3-4288-91b0-015afb9af152-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.184255 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.184196    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-online-tls\") pod \"396d4d4e-5ff4-4355-860b-2f7a02791cda\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") "
Jun 09 16:13:37.184255 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.184252    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls\") pod \"396d4d4e-5ff4-4355-860b-2f7a02791cda\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") "
Jun 09 16:13:37.184255 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.184273    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-ui-tls\") pod \"396d4d4e-5ff4-4355-860b-2f7a02791cda\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") "
Jun 09 16:13:37.184531 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.184323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-offline-tls\") pod \"396d4d4e-5ff4-4355-860b-2f7a02791cda\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") "
Jun 09 16:13:37.184531 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.184351    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396d4d4e-5ff4-4355-860b-2f7a02791cda-feast-data\") pod \"396d4d4e-5ff4-4355-860b-2f7a02791cda\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") "
Jun 09 16:13:37.184531 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.184385    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-568bq\" (UniqueName: \"kubernetes.io/projected/396d4d4e-5ff4-4355-860b-2f7a02791cda-kube-api-access-568bq\") pod \"396d4d4e-5ff4-4355-860b-2f7a02791cda\" (UID: \"396d4d4e-5ff4-4355-860b-2f7a02791cda\") "
Jun 09 16:13:37.184984 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.184950    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396d4d4e-5ff4-4355-860b-2f7a02791cda-feast-data" (OuterVolumeSpecName: "feast-data") pod "396d4d4e-5ff4-4355-860b-2f7a02791cda" (UID: "396d4d4e-5ff4-4355-860b-2f7a02791cda"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 16:13:37.186663 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.186635    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "396d4d4e-5ff4-4355-860b-2f7a02791cda" (UID: "396d4d4e-5ff4-4355-860b-2f7a02791cda"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:13:37.186663 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.186644    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396d4d4e-5ff4-4355-860b-2f7a02791cda-kube-api-access-568bq" (OuterVolumeSpecName: "kube-api-access-568bq") pod "396d4d4e-5ff4-4355-860b-2f7a02791cda" (UID: "396d4d4e-5ff4-4355-860b-2f7a02791cda"). InnerVolumeSpecName "kube-api-access-568bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 16:13:37.186837 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.186657    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "396d4d4e-5ff4-4355-860b-2f7a02791cda" (UID: "396d4d4e-5ff4-4355-860b-2f7a02791cda"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:13:37.186878 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.186868    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "396d4d4e-5ff4-4355-860b-2f7a02791cda" (UID: "396d4d4e-5ff4-4355-860b-2f7a02791cda"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:13:37.186916 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.186890    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-online-tls" (OuterVolumeSpecName: "online-tls") pod "396d4d4e-5ff4-4355-860b-2f7a02791cda" (UID: "396d4d4e-5ff4-4355-860b-2f7a02791cda"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 16:13:37.283847 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.283809    2576 generic.go:356] "Generic (PLEG): container finished" podID="c518f118-e2e3-4288-91b0-015afb9af152" containerID="eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74" exitCode=137
Jun 09 16:13:37.284035 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.283889    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"
Jun 09 16:13:37.284035 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.283894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerDied","Data":"eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74"}
Jun 09 16:13:37.284035 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.283944    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg" event={"ID":"c518f118-e2e3-4288-91b0-015afb9af152","Type":"ContainerDied","Data":"868397e77fdc698444ead4a7dfe2be6c65cf16c3a7a9ddad087cd78f00941116"}
Jun 09 16:13:37.284035 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.283973    2576 scope.go:117] "RemoveContainer" containerID="0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab"
Jun 09 16:13:37.284918 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.284892    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-offline-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.284918 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.284919    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396d4d4e-5ff4-4355-860b-2f7a02791cda-feast-data\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.285110 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.284934    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-568bq\" (UniqueName: \"kubernetes.io/projected/396d4d4e-5ff4-4355-860b-2f7a02791cda-kube-api-access-568bq\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.285110 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.284950    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-online-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.285110 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.284964    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-registry-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.285110 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.284972    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396d4d4e-5ff4-4355-860b-2f7a02791cda-ui-tls\") on node \"ip-10-0-128-73.ec2.internal\" DevicePath \"\""
Jun 09 16:13:37.287240 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.287213    2576 generic.go:356] "Generic (PLEG): container finished" podID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerID="09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f" exitCode=137
Jun 09 16:13:37.287240 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.287235    2576 generic.go:356] "Generic (PLEG): container finished" podID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerID="7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8" exitCode=137
Jun 09 16:13:37.287425 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.287264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerDied","Data":"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"}
Jun 09 16:13:37.287425 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.287297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerDied","Data":"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"}
Jun 09 16:13:37.287425 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.287311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9" event={"ID":"396d4d4e-5ff4-4355-860b-2f7a02791cda","Type":"ContainerDied","Data":"7ff65b181fad6b14a48bc82eeb40c7be3981357727b4659362570be119fccc94"}
Jun 09 16:13:37.287425 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.287363    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"
Jun 09 16:13:37.293330 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.293088    2576 scope.go:117] "RemoveContainer" containerID="eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74"
Jun 09 16:13:37.307640 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.307608    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"]
Jun 09 16:13:37.311290 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.311263    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hczlg"]
Jun 09 16:13:37.312129 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.312102    2576 scope.go:117] "RemoveContainer" containerID="34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47"
Jun 09 16:13:37.320376 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.320345    2576 scope.go:117] "RemoveContainer" containerID="37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99"
Jun 09 16:13:37.322272 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.322246    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"]
Jun 09 16:13:37.326024 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.325946    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hpnl9"]
Jun 09 16:13:37.328808 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.328785    2576 scope.go:117] "RemoveContainer" containerID="3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927"
Jun 09 16:13:37.336229 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.336207    2576 scope.go:117] "RemoveContainer" containerID="0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab"
Jun 09 16:13:37.336527 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.336507    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab\": container with ID starting with 0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab not found: ID does not exist" containerID="0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab"
Jun 09 16:13:37.336579 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.336537    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab"} err="failed to get container status \"0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab\": rpc error: code = NotFound desc = could not find container \"0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab\": container with ID starting with 0bd0e5d0daed3e1668618f182e47af11eac4cbac67f6263e2cb1d05e90d1e1ab not found: ID does not exist"
Jun 09 16:13:37.336579 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.336557    2576 scope.go:117] "RemoveContainer" containerID="eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74"
Jun 09 16:13:37.336793 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.336774    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74\": container with ID starting with eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74 not found: ID does not exist" containerID="eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74"
Jun 09 16:13:37.336836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.336801    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74"} err="failed to get container status \"eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74\": rpc error: code = NotFound desc = could not find container \"eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74\": container with ID starting with eb5b93e9a43f5488e0d955a8d8525a6b33f2b062fea912a4bd74f9dd4ed19a74 not found: ID does not exist"
Jun 09 16:13:37.336836 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.336817    2576 scope.go:117] "RemoveContainer" containerID="34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47"
Jun 09 16:13:37.337058 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.337026    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47\": container with ID starting with 34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47 not found: ID does not exist" containerID="34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47"
Jun 09 16:13:37.337161 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.337057    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47"} err="failed to get container status \"34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47\": rpc error: code = NotFound desc = could not find container \"34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47\": container with ID starting with 34a8eb58dee8b52b955e879256bb0c7bf6ae08d8e5599d447d81e9cae1d7ab47 not found: ID does not exist"
Jun 09 16:13:37.337161 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.337074    2576 scope.go:117] "RemoveContainer" containerID="37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99"
Jun 09 16:13:37.337328 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.337310    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99\": container with ID starting with 37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99 not found: ID does not exist" containerID="37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99"
Jun 09 16:13:37.337374 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.337331    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99"} err="failed to get container status \"37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99\": rpc error: code = NotFound desc = could not find container \"37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99\": container with ID starting with 37f4e6131837ec3fd643b772bfbe0d22f25e5f9bf6642c34ec63d8bcfea0fa99 not found: ID does not exist"
Jun 09 16:13:37.337374 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.337344    2576 scope.go:117] "RemoveContainer" containerID="3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927"
Jun 09 16:13:37.337619 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.337594    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927\": container with ID starting with 3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927 not found: ID does not exist" containerID="3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927"
Jun 09 16:13:37.337668 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.337615    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927"} err="failed to get container status \"3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927\": rpc error: code = NotFound desc = could not find container \"3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927\": container with ID starting with 3633d3270f72646fcd716d944e0d158b25ef25aafe5dd383228ae12eb3257927 not found: ID does not exist"
Jun 09 16:13:37.337668 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.337630    2576 scope.go:117] "RemoveContainer" containerID="3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"
Jun 09 16:13:37.345297 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.345277    2576 scope.go:117] "RemoveContainer" containerID="09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"
Jun 09 16:13:37.352936 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.352913    2576 scope.go:117] "RemoveContainer" containerID="3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"
Jun 09 16:13:37.360683 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.360662    2576 scope.go:117] "RemoveContainer" containerID="7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"
Jun 09 16:13:37.368145 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.368122    2576 scope.go:117] "RemoveContainer" containerID="df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"
Jun 09 16:13:37.375459 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.375433    2576 scope.go:117] "RemoveContainer" containerID="9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"
Jun 09 16:13:37.382766 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.382744    2576 scope.go:117] "RemoveContainer" containerID="3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"
Jun 09 16:13:37.383066 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.383045    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78\": container with ID starting with 3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78 not found: ID does not exist" containerID="3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"
Jun 09 16:13:37.383115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383075    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"} err="failed to get container status \"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78\": rpc error: code = NotFound desc = could not find container \"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78\": container with ID starting with 3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78 not found: ID does not exist"
Jun 09 16:13:37.383115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383095    2576 scope.go:117] "RemoveContainer" containerID="09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"
Jun 09 16:13:37.383386 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.383361    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f\": container with ID starting with 09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f not found: ID does not exist" containerID="09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"
Jun 09 16:13:37.383429 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383393    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"} err="failed to get container status \"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f\": rpc error: code = NotFound desc = could not find container \"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f\": container with ID starting with 09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f not found: ID does not exist"
Jun 09 16:13:37.383429 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383410    2576 scope.go:117] "RemoveContainer" containerID="3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"
Jun 09 16:13:37.383652 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.383633    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1\": container with ID starting with 3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1 not found: ID does not exist" containerID="3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"
Jun 09 16:13:37.383698 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383657    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"} err="failed to get container status \"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1\": rpc error: code = NotFound desc = could not find container \"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1\": container with ID starting with 3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1 not found: ID does not exist"
Jun 09 16:13:37.383698 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383673    2576 scope.go:117] "RemoveContainer" containerID="7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"
Jun 09 16:13:37.383963 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.383945    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8\": container with ID starting with 7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8 not found: ID does not exist" containerID="7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"
Jun 09 16:13:37.384069 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383968    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"} err="failed to get container status \"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8\": rpc error: code = NotFound desc = could not find container \"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8\": container with ID starting with 7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8 not found: ID does not exist"
Jun 09 16:13:37.384069 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.383981    2576 scope.go:117] "RemoveContainer" containerID="df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"
Jun 09 16:13:37.384255 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.384230    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825\": container with ID starting with df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825 not found: ID does not exist" containerID="df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"
Jun 09 16:13:37.384303 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.384266    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"} err="failed to get container status \"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825\": rpc error: code = NotFound desc = could not find container \"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825\": container with ID starting with df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825 not found: ID does not exist"
Jun 09 16:13:37.384303 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.384286    2576 scope.go:117] "RemoveContainer" containerID="9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"
Jun 09 16:13:37.384525 ip-10-0-128-73 kubenswrapper[2576]: E0609 16:13:37.384506    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895\": container with ID starting with 9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895 not found: ID does not exist" containerID="9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"
Jun 09 16:13:37.384568 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.384530    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"} err="failed to get container status \"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895\": rpc error: code = NotFound desc = could not find container \"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895\": container with ID starting with 9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895 not found: ID does not exist"
Jun 09 16:13:37.384568 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.384544    2576 scope.go:117] "RemoveContainer" containerID="3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"
Jun 09 16:13:37.384786 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.384769    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78"} err="failed to get container status \"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78\": rpc error: code = NotFound desc = could not find container \"3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78\": container with ID starting with 3da57fca2993540f7bf727a6516d4a042c997987dc475bc958aac910b160ff78 not found: ID does not exist"
Jun 09 16:13:37.384890 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.384785    2576 scope.go:117] "RemoveContainer" containerID="09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"
Jun 09 16:13:37.385066 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385047    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f"} err="failed to get container status \"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f\": rpc error: code = NotFound desc = could not find container \"09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f\": container with ID starting with 09b7b8fac4242611f2d4ea35d2216ac16b74ce9371fcb5082c18cc13b1c8346f not found: ID does not exist"
Jun 09 16:13:37.385115 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385068    2576 scope.go:117] "RemoveContainer" containerID="3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"
Jun 09 16:13:37.385265 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385249    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1"} err="failed to get container status \"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1\": rpc error: code = NotFound desc = could not find container \"3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1\": container with ID starting with 3f994d7678e4b4168b415648f30575e2dca7ac09b711e5849f474e3ed16b6ab1 not found: ID does not exist"
Jun 09 16:13:37.385265 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385264    2576 scope.go:117] "RemoveContainer" containerID="7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"
Jun 09 16:13:37.385478 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385458    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8"} err="failed to get container status \"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8\": rpc error: code = NotFound desc = could not find container \"7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8\": container with ID starting with 7c4fd641f35964491878a20194844858b12e15db3b11f58851efef41109ac8d8 not found: ID does not exist"
Jun 09 16:13:37.385549 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385479    2576 scope.go:117] "RemoveContainer" containerID="df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"
Jun 09 16:13:37.385713 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385696    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825"} err="failed to get container status \"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825\": rpc error: code = NotFound desc = could not find container \"df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825\": container with ID starting with df2042c5fc3da60f087f2da2ab29fd80994fde66b983723eeaed395a2d92d825 not found: ID does not exist"
Jun 09 16:13:37.385762 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385712    2576 scope.go:117] "RemoveContainer" containerID="9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"
Jun 09 16:13:37.385926 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.385909    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895"} err="failed to get container status \"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895\": rpc error: code = NotFound desc = could not find container \"9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895\": container with ID starting with 9625330e3a8b6483421196f7f2b227ea1719769ff65b9b7f3a557e2ab2328895 not found: ID does not exist"
Jun 09 16:13:37.598277 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.598194    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" path="/var/lib/kubelet/pods/396d4d4e-5ff4-4355-860b-2f7a02791cda/volumes"
Jun 09 16:13:37.598816 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:13:37.598802    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c518f118-e2e3-4288-91b0-015afb9af152" path="/var/lib/kubelet/pods/c518f118-e2e3-4288-91b0-015afb9af152/volumes"
Jun 09 16:14:14.784908 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.784873    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jhfgg/must-gather-xzspt"]
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785146    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="offline"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785158    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="offline"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785169    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="feast-init"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785175    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="feast-init"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785187    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="feast-apply"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785192    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="feast-apply"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785198    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="feast-apply"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785203    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="feast-apply"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785210    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785216    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785222    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785228    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785237    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="offline"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785243    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="offline"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785250    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="registry"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785256    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="registry"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785262    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785267    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785276    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="feast-init"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785281    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="feast-init"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785286    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785291    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785333    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="offline"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785341    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="ui"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785347    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="offline"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785353    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="online"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785358    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="online"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785364    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="396d4d4e-5ff4-4355-860b-2f7a02791cda" containerName="registry"
Jun 09 16:14:14.785451 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.785370    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c518f118-e2e3-4288-91b0-015afb9af152" containerName="ui"
Jun 09 16:14:14.788081 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.788064    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:14.790661 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.790636    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jhfgg\"/\"default-dockercfg-ff5zg\""
Jun 09 16:14:14.790816 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.790750    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhfgg\"/\"openshift-service-ca.crt\""
Jun 09 16:14:14.791616 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.791596    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhfgg\"/\"kube-root-ca.crt\""
Jun 09 16:14:14.795864 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.795841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhfgg/must-gather-xzspt"]
Jun 09 16:14:14.860797 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.860753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfee5ee3-c0ad-444a-9402-5e54262c52b8-must-gather-output\") pod \"must-gather-xzspt\" (UID: \"dfee5ee3-c0ad-444a-9402-5e54262c52b8\") " pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:14.860974 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.860837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74jx6\" (UniqueName: \"kubernetes.io/projected/dfee5ee3-c0ad-444a-9402-5e54262c52b8-kube-api-access-74jx6\") pod \"must-gather-xzspt\" (UID: \"dfee5ee3-c0ad-444a-9402-5e54262c52b8\") " pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:14.962119 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.962081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74jx6\" (UniqueName: \"kubernetes.io/projected/dfee5ee3-c0ad-444a-9402-5e54262c52b8-kube-api-access-74jx6\") pod \"must-gather-xzspt\" (UID: \"dfee5ee3-c0ad-444a-9402-5e54262c52b8\") " pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:14.962251 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.962128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfee5ee3-c0ad-444a-9402-5e54262c52b8-must-gather-output\") pod \"must-gather-xzspt\" (UID: \"dfee5ee3-c0ad-444a-9402-5e54262c52b8\") " pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:14.962445 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.962430    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dfee5ee3-c0ad-444a-9402-5e54262c52b8-must-gather-output\") pod \"must-gather-xzspt\" (UID: \"dfee5ee3-c0ad-444a-9402-5e54262c52b8\") " pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:14.970105 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:14.970080    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74jx6\" (UniqueName: \"kubernetes.io/projected/dfee5ee3-c0ad-444a-9402-5e54262c52b8-kube-api-access-74jx6\") pod \"must-gather-xzspt\" (UID: \"dfee5ee3-c0ad-444a-9402-5e54262c52b8\") " pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:15.111330 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:15.111218    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhfgg/must-gather-xzspt"
Jun 09 16:14:15.241502 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:15.241463    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhfgg/must-gather-xzspt"]
Jun 09 16:14:15.244868 ip-10-0-128-73 kubenswrapper[2576]: W0609 16:14:15.244839    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfee5ee3_c0ad_444a_9402_5e54262c52b8.slice/crio-2d74712f2010a79b0dafe4ffd1ad49708f7762dfaed6baecd244653fb3a431d0 WatchSource:0}: Error finding container 2d74712f2010a79b0dafe4ffd1ad49708f7762dfaed6baecd244653fb3a431d0: Status 404 returned error can't find the container with id 2d74712f2010a79b0dafe4ffd1ad49708f7762dfaed6baecd244653fb3a431d0
Jun 09 16:14:15.246723 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:15.246705    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 16:14:15.431432 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:15.431335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhfgg/must-gather-xzspt" event={"ID":"dfee5ee3-c0ad-444a-9402-5e54262c52b8","Type":"ContainerStarted","Data":"2d74712f2010a79b0dafe4ffd1ad49708f7762dfaed6baecd244653fb3a431d0"}
Jun 09 16:14:16.437481 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:16.437379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhfgg/must-gather-xzspt" event={"ID":"dfee5ee3-c0ad-444a-9402-5e54262c52b8","Type":"ContainerStarted","Data":"8998cba825a3eda2a23a6042109613740703bf458236e820ac008ab83c6d409f"}
Jun 09 16:14:16.437481 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:16.437448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhfgg/must-gather-xzspt" event={"ID":"dfee5ee3-c0ad-444a-9402-5e54262c52b8","Type":"ContainerStarted","Data":"8c691b9fd7ff94412ce7790fc877f6768a7673e11fd7e45cbab17ea0b1051989"}
Jun 09 16:14:16.454450 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:16.454378    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jhfgg/must-gather-xzspt" podStartSLOduration=1.558253751 podStartE2EDuration="2.454350245s" totalImagesPullingTime="896.096494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 16:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:14:16.453069173 +0000 UTC m=+2011.331849108" watchObservedRunningTime="2026-06-09 16:14:16.454350245 +0000 UTC m=+2011.333130181"
Jun 09 16:14:17.459659 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:17.459629    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6d92b_1d865fb0-6977-4e46-bcd7-8d98da5ee9b9/global-pull-secret-syncer/0.log"
Jun 09 16:14:17.651681 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:17.651647    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nzm45_ae26fb92-feca-4d63-a19e-ce77734afdab/konnectivity-agent/0.log"
Jun 09 16:14:17.669900 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:17.669871    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-73.ec2.internal_58267d6e6471fb16c1b68a4f6cfaa490/haproxy/0.log"
Jun 09 16:14:21.862803 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:21.862748    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-s4xmr_062c33bf-1a1f-4d12-a100-26e631b4bc0c/cluster-monitoring-operator/0.log"
Jun 09 16:14:22.019597 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:22.019562    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dqxh_235572fd-a4ef-425a-a42a-d0a86f8ec2d2/node-exporter/0.log"
Jun 09 16:14:22.045044 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:22.045008    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dqxh_235572fd-a4ef-425a-a42a-d0a86f8ec2d2/kube-rbac-proxy/0.log"
Jun 09 16:14:22.065974 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:22.065944    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dqxh_235572fd-a4ef-425a-a42a-d0a86f8ec2d2/init-textfile/0.log"
Jun 09 16:14:22.485641 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:22.485603    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pvc9q_1d4f592a-7167-4a89-8927-6c4ba23d5a6c/prometheus-operator/0.log"
Jun 09 16:14:22.503011 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:22.502948    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pvc9q_1d4f592a-7167-4a89-8927-6c4ba23d5a6c/kube-rbac-proxy/0.log"
Jun 09 16:14:22.531908 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:22.531863    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-m759z_750c929b-6a0c-45ea-966e-c79fbd15d20a/prometheus-operator-admission-webhook/0.log"
Jun 09 16:14:23.956147 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:23.956113    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-f5xjv_46c596e3-7815-4b6e-a479-acf7f667a7f3/networking-console-plugin/0.log"
Jun 09 16:14:25.543116 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.543072    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"]
Jun 09 16:14:25.547400 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.547366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.554936 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.554761    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"]
Jun 09 16:14:25.658460 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.658417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nkzw\" (UniqueName: \"kubernetes.io/projected/72f33c4e-2753-4d78-8ddd-ab685aae465c-kube-api-access-9nkzw\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.658676 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.658478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-proc\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.658676 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.658613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-lib-modules\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.658813 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.658679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-sys\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.658813 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.658719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-podres\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.759749 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.759706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-sys\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.759950 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.759765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-podres\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.759950 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.759795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nkzw\" (UniqueName: \"kubernetes.io/projected/72f33c4e-2753-4d78-8ddd-ab685aae465c-kube-api-access-9nkzw\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.759950 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.759831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-proc\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.759950 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.759883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-lib-modules\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.759950 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.759829    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-sys\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.760255 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.759960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-podres\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.760255 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.760105    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-lib-modules\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.760255 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.760194    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72f33c4e-2753-4d78-8ddd-ab685aae465c-proc\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.768734 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.768695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nkzw\" (UniqueName: \"kubernetes.io/projected/72f33c4e-2753-4d78-8ddd-ab685aae465c-kube-api-access-9nkzw\") pod \"perf-node-gather-daemonset-f8lpd\" (UID: \"72f33c4e-2753-4d78-8ddd-ab685aae465c\") " pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:25.859753 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:25.859640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:26.011007 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.010940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"]
Jun 09 16:14:26.213135 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.213087    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsq8t_54ef7652-cfab-491a-9be5-1f278316e88e/dns/0.log"
Jun 09 16:14:26.233535 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.233502    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nsq8t_54ef7652-cfab-491a-9be5-1f278316e88e/kube-rbac-proxy/0.log"
Jun 09 16:14:26.256071 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.256039    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nvsms_678d5149-004b-438d-80ed-6785d48fa41e/dns-node-resolver/0.log"
Jun 09 16:14:26.489671 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.489628    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd" event={"ID":"72f33c4e-2753-4d78-8ddd-ab685aae465c","Type":"ContainerStarted","Data":"fc4cf4c8217596e05ecff66bcf948b1442eff030d9a763e8668c28d5c9c2de4a"}
Jun 09 16:14:26.489862 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.489685    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd" event={"ID":"72f33c4e-2753-4d78-8ddd-ab685aae465c","Type":"ContainerStarted","Data":"a787ef74481275c39837217499664e17a6836d4ec7c508c4d3d08f87c4095da8"}
Jun 09 16:14:26.489862 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.489714    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:26.505083 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.505031    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd" podStartSLOduration=1.505014324 podStartE2EDuration="1.505014324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 16:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 16:14:26.503368657 +0000 UTC m=+2021.382148593" watchObservedRunningTime="2026-06-09 16:14:26.505014324 +0000 UTC m=+2021.383794248"
Jun 09 16:14:26.673094 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.673064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b5c897d58-br47x_3c43c75b-9f9a-4f67-84f0-546d0d82938a/registry/0.log"
Jun 09 16:14:26.682805 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.682772    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b5c897d58-br47x_3c43c75b-9f9a-4f67-84f0-546d0d82938a/registry/1.log"
Jun 09 16:14:26.751048 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:26.750948    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qf9f5_3157c15f-0b54-4002-b43c-863bdfcd6861/node-ca/0.log"
Jun 09 16:14:27.727623 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:27.727590    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n5592_426f746c-696c-4582-a3b4-1c78ec6f4349/serve-healthcheck-canary/0.log"
Jun 09 16:14:28.148136 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:28.148043    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dmfq_c38b47d9-51a4-42e9-a19f-53e0397435b3/kube-rbac-proxy/0.log"
Jun 09 16:14:28.169247 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:28.169219    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dmfq_c38b47d9-51a4-42e9-a19f-53e0397435b3/exporter/0.log"
Jun 09 16:14:28.190819 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:28.190788    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dmfq_c38b47d9-51a4-42e9-a19f-53e0397435b3/extractor/0.log"
Jun 09 16:14:32.345037 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:32.345007    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-8k9l6_d7529792-d9a4-4380-96b1-f4af1122c15c/migrator/0.log"
Jun 09 16:14:32.365308 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:32.365278    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-8k9l6_d7529792-d9a4-4380-96b1-f4af1122c15c/graceful-termination/0.log"
Jun 09 16:14:32.504149 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:32.504118    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jhfgg/perf-node-gather-daemonset-f8lpd"
Jun 09 16:14:32.653242 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:32.653155    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-5nkcs_760bb045-5532-42f6-96fa-eb27892063d2/kube-storage-version-migrator-operator/1.log"
Jun 09 16:14:32.654031 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:32.654010    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-5nkcs_760bb045-5532-42f6-96fa-eb27892063d2/kube-storage-version-migrator-operator/0.log"
Jun 09 16:14:33.501087 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.501054    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrv58_63bf53bd-bef5-451d-9734-72dca9a94d3b/kube-multus-additional-cni-plugins/0.log"
Jun 09 16:14:33.521430 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.521400    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrv58_63bf53bd-bef5-451d-9734-72dca9a94d3b/egress-router-binary-copy/0.log"
Jun 09 16:14:33.540847 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.540813    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrv58_63bf53bd-bef5-451d-9734-72dca9a94d3b/cni-plugins/0.log"
Jun 09 16:14:33.561087 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.561060    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrv58_63bf53bd-bef5-451d-9734-72dca9a94d3b/bond-cni-plugin/0.log"
Jun 09 16:14:33.582162 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.582133    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrv58_63bf53bd-bef5-451d-9734-72dca9a94d3b/routeoverride-cni/0.log"
Jun 09 16:14:33.604911 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.604878    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrv58_63bf53bd-bef5-451d-9734-72dca9a94d3b/whereabouts-cni-bincopy/0.log"
Jun 09 16:14:33.626296 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.626265    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jrv58_63bf53bd-bef5-451d-9734-72dca9a94d3b/whereabouts-cni/0.log"
Jun 09 16:14:33.994556 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:33.994506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h7slj_de628c55-ab74-4e39-bfe1-e8267fba5d14/kube-multus/0.log"
Jun 09 16:14:34.144036 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:34.143916    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v69vq_75782ece-32fd-45d1-9d86-38283259fd4e/network-metrics-daemon/0.log"
Jun 09 16:14:34.166634 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:34.166597    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v69vq_75782ece-32fd-45d1-9d86-38283259fd4e/kube-rbac-proxy/0.log"
Jun 09 16:14:35.465386 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.465348    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-controller/0.log"
Jun 09 16:14:35.481726 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.481693    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/0.log"
Jun 09 16:14:35.481726 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.481701    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovn-acl-logging/1.log"
Jun 09 16:14:35.500526 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.500498    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/kube-rbac-proxy-node/0.log"
Jun 09 16:14:35.520770 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.520736    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/kube-rbac-proxy-ovn-metrics/0.log"
Jun 09 16:14:35.537228 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.537193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/northd/0.log"
Jun 09 16:14:35.556582 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.556543    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/nbdb/0.log"
Jun 09 16:14:35.575313 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.575285    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/sbdb/0.log"
Jun 09 16:14:35.620070 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:35.620037    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pqzgm_199ed6cb-f5f5-4bdd-a422-80c88c583c12/ovnkube-controller/0.log"
Jun 09 16:14:36.657890 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:36.657810    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-82cm9_f31e5939-6be3-4e77-8de7-d83b57d22461/network-check-target-container/0.log"
Jun 09 16:14:37.489163 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:37.489128    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7rflf_6bf7f958-f112-4bd3-951d-082cbc9e8f2e/iptables-alerter/0.log"
Jun 09 16:14:38.096755 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:38.096709    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-668ct_ac3118e2-7a36-4774-b806-b274334aed61/tuned/0.log"
Jun 09 16:14:41.472676 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:41.472631    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s8wc7_a0ffaf55-4375-4ffe-b009-e07a43e281b7/csi-driver/0.log"
Jun 09 16:14:41.492171 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:41.492133    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s8wc7_a0ffaf55-4375-4ffe-b009-e07a43e281b7/csi-node-driver-registrar/0.log"
Jun 09 16:14:41.512438 ip-10-0-128-73 kubenswrapper[2576]: I0609 16:14:41.512397    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s8wc7_a0ffaf55-4375-4ffe-b009-e07a43e281b7/csi-liveness-probe/0.log"