Jun 06 05:06:06.797893 ip-10-0-139-94 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 06 05:06:06.797903 ip-10-0-139-94 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 06 05:06:06.797910 ip-10-0-139-94 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 06 05:06:06.798054 ip-10-0-139-94 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 06 05:06:16.979311 ip-10-0-139-94 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 06 05:06:16.979332 ip-10-0-139-94 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 73b0f81ecc4544919fc3824cd610272d --
Jun 06 05:08:57.838058 ip-10-0-139-94 systemd[1]: Starting Kubernetes Kubelet...
Jun 06 05:08:58.220088 ip-10-0-139-94 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 05:08:58.220088 ip-10-0-139-94 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 06 05:08:58.220088 ip-10-0-139-94 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 05:08:58.220088 ip-10-0-139-94 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 06 05:08:58.220088 ip-10-0-139-94 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 05:08:58.222340 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.222253    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 06 05:08:58.226661 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226636    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226665    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226669    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226672    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226676    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226680    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226683    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226685    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226688    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226691    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226694    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226696    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226699    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226702    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226705    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:58.226702 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226708    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226711    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226715    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226718    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226725    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226728    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226731    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226733    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226736    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226738    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226741    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226744    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226746    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226749    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226752    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226754    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226757    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226760    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226762    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226765    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:58.227061 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226768    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226770    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226773    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226775    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226778    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226781    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226783    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226786    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226788    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226791    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226793    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226796    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226798    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226801    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226804    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226807    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226810    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226813    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226816    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226818    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:58.227571 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226820    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226823    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226826    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226828    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226831    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226833    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226836    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226839    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226841    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226844    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226846    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226849    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226851    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226854    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226856    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226859    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226862    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226866    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226869    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:58.228066 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226873    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226877    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226880    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226883    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226886    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226889    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226891    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226895    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226898    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226901    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226909    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226912    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226915    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226917    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226920    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226922    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226925    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226929    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226932    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:58.228545 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226935    2568 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226939    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226943    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226946    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226948    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.226951    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227643    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227650    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227667    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227671    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227675    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227677    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227680    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227683    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227686    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227688    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227691    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227694    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227697    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:58.229013 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227700    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227703    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227706    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227709    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227712    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227715    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227718    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227721    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227723    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227726    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227729    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227731    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227734    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227737    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227739    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227742    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227744    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227747    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227750    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227753    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:58.229466 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227756    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227759    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227761    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227764    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227766    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227769    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227772    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227776    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227779    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227782    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227785    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227787    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227790    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227793    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227795    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227798    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227801    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227803    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227807    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227809    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:58.229979 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227812    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227814    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227817    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227819    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227822    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227825    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227827    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227829    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227832    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227835    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227837    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227840    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227843    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227846    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227848    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227851    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227854    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227856    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227861    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227863    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:58.230461 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227866    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227868    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227873    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227876    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227879    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227883    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227886    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227888    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227891    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227893    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227896    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227903    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227907    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227911    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227913    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227916    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227919    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227921    2568 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227924    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:58.230959 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227926    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227929    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227931    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227934    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227937    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227940    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.227942    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228329    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228334    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228337    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228339    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228342    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228345    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228348    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228351    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228353    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228356    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228358    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228361    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228364    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:58.231518 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228367    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228370    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228372    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228375    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228378    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228381    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228383    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228386    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228390    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228393    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228395    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228398    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228400    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228403    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228405    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228409    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228411    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228414    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228416    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228419    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:58.232028 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228421    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228424    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228426    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228429    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228431    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228434    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228436    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228439    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228442    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228444    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228447    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228450    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228452    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228455    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228457    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228460    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228462    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228465    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228468    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228470    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:58.232519 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228473    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228475    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228478    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228481    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228484    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228486    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228489    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228492    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228495    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228497    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228500    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228503    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228505    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228508    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228510    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228513    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228515    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228518    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228520    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228525    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:58.233050 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228528    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228531    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228534    2568 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228538    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228540    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228543    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228546    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228550    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228553    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228555    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228558    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228561    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228564    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228566    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228570    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228574    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228576    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228579    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228582    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:58.233552 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228585    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228588    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228591    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228594    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228596    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228599    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.228602    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228689    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228696    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228703    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228708    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228712    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228715    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228719    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228723    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228729    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228732    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228736    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228739    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228742    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228745    2568 flags.go:64] FLAG: --cgroup-root=""
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228748    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228752    2568 flags.go:64] FLAG: --client-ca-file=""
Jun 06 05:08:58.234032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228754    2568 flags.go:64] FLAG: --cloud-provider="external"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228758    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228763    2568 flags.go:64] FLAG: --cluster-domain=""
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228766    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228769    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228772    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228776    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228779    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228782    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228785    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228789    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228792    2568 flags.go:64] FLAG: --contention-profiling="false"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228795    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228798    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228801    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228804    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228808    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228811    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228815    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228817    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228820    2568 flags.go:64] FLAG: --enable-server="true"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228823    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228829    2568 flags.go:64] FLAG: --event-burst="100"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228832    2568 flags.go:64] FLAG: --event-qps="50"
Jun 06 05:08:58.234589 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228837    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228840    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228843    2568 flags.go:64] FLAG: --eviction-hard=""
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228846    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228849    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228852    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228855    2568 flags.go:64] FLAG: --eviction-soft=""
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228858    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228861    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228866    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228869    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228872    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228875    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228878    2568 flags.go:64] FLAG: --feature-gates=""
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228882    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228885    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228888    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228891    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228894    2568 flags.go:64] FLAG: --healthz-port="10248"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228897    2568 flags.go:64] FLAG: --help="false"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228900    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228904    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228907    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 06 05:08:58.235174 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228909    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228913    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228916    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228919    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228922    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228925    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228928    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228931    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228934    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228938    2568 flags.go:64] FLAG: --kube-reserved=""
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228941    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228944    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228947    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228950    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228953    2568 flags.go:64] FLAG: --lock-file=""
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228955    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228958    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228961    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228968    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228970    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228974    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228977    2568 flags.go:64] FLAG: --logging-format="text"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228980    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228983    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 06 05:08:58.235780 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228986    2568 flags.go:64] FLAG: --manifest-url=""
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228989    2568 flags.go:64] FLAG: --manifest-url-header=""
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228993    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.228997    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229001    2568 flags.go:64] FLAG: --max-pods="110"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229004    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229007    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229010    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229013    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229017    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229020    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229023    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229030    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229033    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229036    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229039    2568 flags.go:64] FLAG: --pod-cidr=""
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229042    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229047    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229051    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229055    2568 flags.go:64] FLAG: --pods-per-core="0"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229058    2568 flags.go:64] FLAG: --port="10250"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229061    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229064    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aea9adf398873be7"
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229067    2568 flags.go:64] FLAG: --qos-reserved=""
Jun 06 05:08:58.236469 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229070    2568 flags.go:64] FLAG: --read-only-port="10255"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229073    2568 flags.go:64] FLAG: --register-node="true"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229077    2568 flags.go:64] FLAG: --register-with-taints=""
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229085    2568 flags.go:64] FLAG: --registry-burst="10"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229088    2568 flags.go:64] FLAG: --registry-qps="5"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229091    2568 flags.go:64] FLAG: --reserved-cpus=""
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229094    2568 flags.go:64] FLAG: --reserved-memory=""
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229098    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229100    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229103    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229106    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229109    2568 flags.go:64] FLAG: --runonce="false"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229112    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229115    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229118    2568 flags.go:64] FLAG: --seccomp-default="false"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229121    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229124    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229127    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229130    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229133    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229136    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229139    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229152    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229156    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229159    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 06 05:08:58.237474 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229162    2568 flags.go:64] FLAG: --system-cgroups=""
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229166    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229171    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229174    2568 flags.go:64] FLAG: --tls-cert-file=""
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229177    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229181    2568 flags.go:64] FLAG: --tls-min-version=""
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229185    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229188    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229191    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229196    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229199    2568 flags.go:64] FLAG: --v="2"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229203    2568 flags.go:64] FLAG: --version="false"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229207    2568 flags.go:64] FLAG: --vmodule=""
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229211    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.229215    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229331    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229335    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229338    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229341    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229344    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229346    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229349    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229352    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:58.238112 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229355    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229357    2568 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229360    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229362    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229365    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229368    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229370    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229373    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229375    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229378    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229381    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229383    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229386    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229389    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229392    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229394    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229397    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229399    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229403    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229406    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:58.238692 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229409    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229411    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229414    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229417    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229419    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229422    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229425    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229427    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229430    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229432    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229435    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229437    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229440    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229443    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229445    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229448    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229450    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229453    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229455    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:58.239231 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229459    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229463    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229466    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229469    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229472    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229475    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229478    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229480    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229483    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229485    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229488    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229493    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229496    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229499    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229502    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229504    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229506    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229509    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229512    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:58.239843 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229514    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229517    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229520    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229524    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229526    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229529    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229532    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229534    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229537    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229540    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229542    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229545    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229547    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229550    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229555    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229557    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229560    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229563    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229565    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:58.240326 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229568    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229570    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229573    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229576    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229578    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229582    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229585    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229587    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229590    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229592    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229595    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229597    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229600    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.229603    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.230340    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 05:08:58.240790 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.239331    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.239447    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.239467    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.239472    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239533    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239538    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239542    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239545    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239548    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239551    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239554    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239557    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239559    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239562    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239565    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239568    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239571    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239573    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239576    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:58.241171 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239579    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239582    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239585    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239587    2568 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239590    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239593    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239596    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239598    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239601    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239604    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239606    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239609    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239612    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239616    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239621    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239624    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239627    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239630    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239633    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:58.241634 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239636    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239639    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239642    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239645    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239648    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239691    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239696    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239700    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239703    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239706    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239709    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239712    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239715    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239718    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239721    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239723    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239726    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239728    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239731    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239734    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:58.242121 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239737    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239739    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239743    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239745    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239748    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239750    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239753    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239756    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239759    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239762    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239765    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239767    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239769    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239773    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239777    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239781    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239785    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239788    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239795    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:58.242613 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239798    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239801    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239804    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239807    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239810    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239813    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239817    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239820    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239823    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239825    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239828    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239831    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239834    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239836    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239839    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239841    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239844    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239847    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239850    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239853    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:58.243109 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239856    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239859    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239861    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239864    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239867    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239869    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.239874    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239992    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.239998    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240000    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240003    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240006    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240009    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240011    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240014    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 05:08:58.243642 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240016    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240020    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240022    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240025    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240028    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240031    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240034    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240037    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240039    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240042    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240045    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240048    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240050    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240053    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240055    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240058    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240061    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240064    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240069    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 05:08:58.244063 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240072    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240074    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240077    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240080    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240082    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240085    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240088    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240091    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240094    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240096    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240099    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240101    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240103    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240106    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240109    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240112    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240114    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240117    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240120    2568 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240123    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 05:08:58.244688 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240125    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240128    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240131    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240133    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240136    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240138    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240141    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240143    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240146    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240148    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240151    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240154    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240156    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240159    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240161    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240164    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240167    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240169    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240172    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240174    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 05:08:58.245181 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240177    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240179    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240182    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240184    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240187    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240190    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240193    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240195    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240198    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240200    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240212    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240217    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240219    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240222    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240225    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240228    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240231    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240234    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240237    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 05:08:58.245987 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240240    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240243    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240245    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240248    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240251    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240255    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240258    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240261    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240265    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240268    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240271    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240274    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:58.240277    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.240282    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 05:08:58.246583 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.240410    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 06 05:08:58.247016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.242888    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 06 05:08:58.247016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.244233    2568 server.go:1019] "Starting client certificate rotation"
Jun 06 05:08:58.247016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.244348    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 06 05:08:58.247016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.244401    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 06 05:08:58.247016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.246857    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 06 05:08:58.248088 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.248057    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 06 05:08:58.260287 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.260267    2568 log.go:25] "Validated CRI v1 runtime API"
Jun 06 05:08:58.264358 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.264341    2568 log.go:25] "Validated CRI v1 image API"
Jun 06 05:08:58.265215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.265199    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 06 05:08:58.267550 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.267526    2568 fs.go:135] Filesystem UUIDs: map[18d886d3-0dcf-43e2-97a1-d69cc603f88b:/dev/nvme0n1p4 28d690e3-a138-431a-9768-a3ed466261a3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jun 06 05:08:58.267625 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.267550    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 06 05:08:58.273233 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.273068    2568 manager.go:216] Machine: {Timestamp:2026-06-06 05:08:58.271447009 +0000 UTC m=+0.319312673 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108889 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec218d92c06f9414353dedea2f5d9635 SystemUUID:ec218d92-c06f-9414-353d-edea2f5d9635 BootID:73b0f81e-cc45-4491-9fc3-824cd610272d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:1c:99:d3:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:1c:99:d3:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:e7:d4:35:62:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 06 05:08:58.273233 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.273225    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 06 05:08:58.273383 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.273370    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 06 05:08:58.276044 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.276028    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 06 05:08:58.276570 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.276540    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 06 05:08:58.276720 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.276574    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 06 05:08:58.277273 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.277264    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jun 06 05:08:58.277311 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.277275    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jun 06 05:08:58.277311 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.277283    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 06 05:08:58.277882 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.277872    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 06 05:08:58.278609 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.278600    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 06 05:08:58.281571 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.281561    2568 state_mem.go:36] "Initialized new in-memory state store"
Jun 06 05:08:58.281702 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.281692    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 06 05:08:58.281733 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.281722    2568 kubelet.go:486] "Attempting to sync node with API server"
Jun 06 05:08:58.281733 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.281733    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 06 05:08:58.281794 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.281750    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 06 05:08:58.281794 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.281761    2568 kubelet.go:398] "Adding apiserver pod source"
Jun 06 05:08:58.281794 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.281770    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 06 05:08:58.282136 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.282124    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 06 05:08:58.282172 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.282141    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 06 05:08:58.284988 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.284971    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 06 05:08:58.286287 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286273    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 06 05:08:58.286359 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286303    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 06 05:08:58.286914 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286901    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 06 05:08:58.286966 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286924    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 06 05:08:58.286966 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286931    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 06 05:08:58.286966 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286940    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 06 05:08:58.286966 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286952    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 06 05:08:58.286966 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.286959    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 06 05:08:58.287098 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287075    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 06 05:08:58.287098 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287082    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 06 05:08:58.287098 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287088    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 06 05:08:58.287098 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287094    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 06 05:08:58.287198 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287103    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 06 05:08:58.287198 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287111    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 06 05:08:58.287198 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287138    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 06 05:08:58.287198 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.287143    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 06 05:08:58.290400 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.290386    2568 server.go:1268] "Started kubelet"
Jun 06 05:08:58.290508 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.290485    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 06 05:08:58.290570 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.290533    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 06 05:08:58.290602 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.290589    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 06 05:08:58.292245 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.292215    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 06 05:08:58.292743 ip-10-0-139-94 systemd[1]: Started Kubernetes Kubelet.
Jun 06 05:08:58.293138 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.292885    2568 server.go:310] "Adding debug handlers to kubelet server"
Jun 06 05:08:58.293581 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.293530    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 06 05:08:58.294030 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.294010    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 06 05:08:58.294087 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.294013    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 06 05:08:58.297783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.297764    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 06 05:08:58.297783 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.296860    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-94.ec2.internal.18b665b6c2542292  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-94.ec2.internal,UID:ip-10-0-139-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-94.ec2.internal,},FirstTimestamp:2026-06-06 05:08:58.290356882 +0000 UTC m=+0.338222540,LastTimestamp:2026-06-06 05:08:58.290356882 +0000 UTC m=+0.338222540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-94.ec2.internal,}"
Jun 06 05:08:58.297921 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.297790    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mpmjz"
Jun 06 05:08:58.298269 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.298249    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 06 05:08:58.298372 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.298356    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 06 05:08:58.298452 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.298434    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.298943 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.298928    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 06 05:08:58.299053 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.298921    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 06 05:08:58.299053 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299054    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 06 05:08:58.299200 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299069    2568 factory.go:55] Registering systemd factory
Jun 06 05:08:58.299200 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299081    2568 factory.go:223] Registration of the systemd container factory successfully
Jun 06 05:08:58.299200 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299191    2568 reconstruct.go:97] "Volume reconstruction finished"
Jun 06 05:08:58.299339 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299214    2568 reconciler.go:29] "Reconciler: start to sync state"
Jun 06 05:08:58.299339 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299317    2568 factory.go:153] Registering CRI-O factory
Jun 06 05:08:58.299339 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299328    2568 factory.go:223] Registration of the crio container factory successfully
Jun 06 05:08:58.299456 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299366    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 06 05:08:58.299456 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299388    2568 factory.go:103] Registering Raw factory
Jun 06 05:08:58.299456 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299399    2568 manager.go:1196] Started watching for new ooms in manager
Jun 06 05:08:58.299837 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.299822    2568 manager.go:349] Starting recovery of all containers
Jun 06 05:08:58.301011 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.300982    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 06 05:08:58.301098 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.301081    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 06 05:08:58.304805 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.304778    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mpmjz"
Jun 06 05:08:58.311828 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.311808    2568 manager.go:354] Recovery completed
Jun 06 05:08:58.316087 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.316075    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:58.318462 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.318445    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:58.318548 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.318478    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:58.318548 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.318492    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:58.319014 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.319001    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 06 05:08:58.319014 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.319013    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 06 05:08:58.319100 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.319029    2568 state_mem.go:36] "Initialized new in-memory state store"
Jun 06 05:08:58.319100 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.319012    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:58.319843 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.319747    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:58.319843 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.319773    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:58.319843 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.319783    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:58.320132 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.320120    2568 policy_none.go:49] "None policy: Start"
Jun 06 05:08:58.320168 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.320139    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 06 05:08:58.320168 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.320154    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 06 05:08:58.320781 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.320718    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-94.ec2.internal.18b665b6c400fcea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-94.ec2.internal,UID:ip-10-0-139-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-94.ec2.internal,},FirstTimestamp:2026-06-06 05:08:58.318462186 +0000 UTC m=+0.366327848,LastTimestamp:2026-06-06 05:08:58.318462186 +0000 UTC m=+0.366327848,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-94.ec2.internal,}"
Jun 06 05:08:58.321265 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.321251    2568 policy_none.go:47] "Start"
Jun 06 05:08:58.362709 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.362683    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.363318    2568 manager.go:337] "Starting Device Plugin manager"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.363393    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.363406    2568 server.go:87] "Starting device plugin registration server"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.363674    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.363687    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.363779    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.363854    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.363864    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.364271    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.364310    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.364337    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.364417    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.365074    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 06 05:08:58.365182 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.365128    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.366432 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.366404    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:58.464468 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.464440    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:58.464588 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.464530    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal"]
Jun 06 05:08:58.464679 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.464599    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:58.465436 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.465419    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:58.465519 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.465456    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:58.465519 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.465472    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:58.465519 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.465513    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.466063 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.466047    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:58.466132 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.466080    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:58.466132 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.466094    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:58.467203 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467191    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:58.467322 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467307    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.467393 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467357    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:58.467927 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467909    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:58.468022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467914    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:58.468022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467939    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:58.468022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467949    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:58.468022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467956    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:58.468022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.467967    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:58.469115 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.469092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.469115 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.469117    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 05:08:58.469779 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.469765    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 05:08:58.469853 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.469789    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 05:08:58.469853 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.469797    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeHasSufficientPID"
Jun 06 05:08:58.473985 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.473971    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.474062 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.473995    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-94.ec2.internal\": node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.487482 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.487466    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.501386 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.501366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e2aebb7e3495f5089b25765a239a5d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal\" (UID: \"7e2aebb7e3495f5089b25765a239a5d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.501463 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.501399    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e2aebb7e3495f5089b25765a239a5d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal\" (UID: \"7e2aebb7e3495f5089b25765a239a5d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.501463 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.501434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4df2d57bbce72652886cb8d629b1afd-config\") pod \"kube-apiserver-proxy-ip-10-0-139-94.ec2.internal\" (UID: \"f4df2d57bbce72652886cb8d629b1afd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.501463 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.501441    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-94.ec2.internal\" not found" node="ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.505963 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.505944    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-94.ec2.internal\" not found" node="ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.587750 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.587724    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.601666 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.601633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e2aebb7e3495f5089b25765a239a5d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal\" (UID: \"7e2aebb7e3495f5089b25765a239a5d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.601743 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.601682    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4df2d57bbce72652886cb8d629b1afd-config\") pod \"kube-apiserver-proxy-ip-10-0-139-94.ec2.internal\" (UID: \"f4df2d57bbce72652886cb8d629b1afd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.601743 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.601724    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e2aebb7e3495f5089b25765a239a5d0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal\" (UID: \"7e2aebb7e3495f5089b25765a239a5d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.601817 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.601771    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4df2d57bbce72652886cb8d629b1afd-config\") pod \"kube-apiserver-proxy-ip-10-0-139-94.ec2.internal\" (UID: \"f4df2d57bbce72652886cb8d629b1afd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.601817 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.601792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e2aebb7e3495f5089b25765a239a5d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal\" (UID: \"7e2aebb7e3495f5089b25765a239a5d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.601817 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.601811    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e2aebb7e3495f5089b25765a239a5d0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal\" (UID: \"7e2aebb7e3495f5089b25765a239a5d0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.688420 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.688386    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.789185 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.789157    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.807640 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.807602    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.810989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:58.810634    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:58.889334 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.889295    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:58.989838 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:58.989812    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:59.090427 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:59.090358    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:59.191113 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:59.191083    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:59.243561 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.243528    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 06 05:08:59.244132 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.243707    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 06 05:08:59.292050 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:59.292020    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:59.308742 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.308698    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 05:03:58 +0000 UTC" deadline="2027-12-09 11:52:46.051618081 +0000 UTC"
Jun 06 05:08:59.308742 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.308741    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13230h43m46.74288173s"
Jun 06 05:08:59.358244 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:59.358082    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4df2d57bbce72652886cb8d629b1afd.slice/crio-61039ded9b95a519e001ef269e1c6043da53190872ee4e42452303d7d9308bf6 WatchSource:0}: Error finding container 61039ded9b95a519e001ef269e1c6043da53190872ee4e42452303d7d9308bf6: Status 404 returned error can't find the container with id 61039ded9b95a519e001ef269e1c6043da53190872ee4e42452303d7d9308bf6
Jun 06 05:08:59.358564 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:08:59.358540    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2aebb7e3495f5089b25765a239a5d0.slice/crio-553fb472e6358c4bb39390cc4c97469ad887b0a39d53e10a5f09a8f59f3fdcfa WatchSource:0}: Error finding container 553fb472e6358c4bb39390cc4c97469ad887b0a39d53e10a5f09a8f59f3fdcfa: Status 404 returned error can't find the container with id 553fb472e6358c4bb39390cc4c97469ad887b0a39d53e10a5f09a8f59f3fdcfa
Jun 06 05:08:59.362575 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.362556    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:08:59.362909 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.362888    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:59.367197 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.367159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal" event={"ID":"7e2aebb7e3495f5089b25765a239a5d0","Type":"ContainerStarted","Data":"553fb472e6358c4bb39390cc4c97469ad887b0a39d53e10a5f09a8f59f3fdcfa"}
Jun 06 05:08:59.368816 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.368778    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal" event={"ID":"f4df2d57bbce72652886cb8d629b1afd","Type":"ContainerStarted","Data":"61039ded9b95a519e001ef269e1c6043da53190872ee4e42452303d7d9308bf6"}
Jun 06 05:08:59.393021 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:08:59.393000    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-94.ec2.internal\" not found"
Jun 06 05:08:59.400779 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.400760    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:08:59.499415 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.499395    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:59.508994 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.508972    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 06 05:08:59.510844 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.510830    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal"
Jun 06 05:08:59.516324 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.516310    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 06 05:08:59.679099 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:08:59.679031    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:09:00.156666 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.156623    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 05:09:00.283778 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.283734    2568 apiserver.go:52] "Watching apiserver"
Jun 06 05:09:00.291077 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.291046    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 06 05:09:00.291528 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.291500    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-qt2fv","kube-system/global-pull-secret-syncer-db5w4","kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal","openshift-image-registry/node-ca-wtzwc","openshift-multus/multus-additional-cni-plugins-pdx6l","openshift-multus/multus-vz7gv","openshift-multus/network-metrics-daemon-tmwx5","openshift-network-diagnostics/network-check-target-nlgq9","openshift-network-operator/iptables-alerter-f4fft","kube-system/konnectivity-agent-hvsjv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f","openshift-cluster-node-tuning-operator/tuned-cwm5c","openshift-dns/node-resolver-5knmq"]
Jun 06 05:09:00.293293 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.293266    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.294979 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.294918    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.295215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.295180    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:09:00.295215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.295210    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 06 05:09:00.295347 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.295263    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 06 05:09:00.295347 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.295297    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hmw4t\""
Jun 06 05:09:00.296109 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.295992    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.296109 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.296083    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:00.296811 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.296789    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:09:00.297527 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.297032    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 06 05:09:00.297527 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.297202    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r4n8g\""
Jun 06 05:09:00.297527 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.297263    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.298738 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.298078    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 06 05:09:00.299017 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.298994    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h4ln8\""
Jun 06 05:09:00.299106 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.299040    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 06 05:09:00.299272 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.299256    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 06 05:09:00.300749 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.300730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.302137 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.302116    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.302478 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.302459    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 06 05:09:00.302702 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.302682    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rg49\""
Jun 06 05:09:00.303030 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.303011    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 06 05:09:00.303183 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.303014    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 06 05:09:00.303484 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.303462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:00.303581 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.303543    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:00.304147 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.304114    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 06 05:09:00.304319 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.304121    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 06 05:09:00.304421 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.304333    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 06 05:09:00.304484 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.304431    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 06 05:09:00.304668 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.304633    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 06 05:09:00.304740 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.304724    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pr97g\""
Jun 06 05:09:00.305192 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.305175    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.306737 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.306700    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 06 05:09:00.306924 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.306906    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wlht6\""
Jun 06 05:09:00.308418 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.308402    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.309770 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.309751    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:00.309863 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.309820    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:00.310226 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.310206    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 06 05:09:00.310320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.310251    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9l66b\""
Jun 06 05:09:00.310381 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.310254    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 06 05:09:00.310867 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.310604    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 06 05:09:00.310867 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.310633    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 06 05:09:00.310867 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.310703    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 06 05:09:00.310867 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.310736    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 06 05:09:00.311483 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.311462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.311998 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.311975    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 06 05:09:00.312475 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-host-slash\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.312556 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-lib-modules\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.312612 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312571    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-tuned\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.312679 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-kubelet-config\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.312679 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e790f8-f227-4eb6-87ad-78214669307e-serviceca\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.312785 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312697    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-var-lib-kubelet\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.312785 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312765    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-modprobe-d\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.312930 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-kubernetes\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.312930 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.312930 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312854    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcffw\" (UniqueName: \"kubernetes.io/projected/96e790f8-f227-4eb6-87ad-78214669307e-kube-api-access-gcffw\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.312930 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-iptables-alerter-script\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-run\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.312984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-595kw\" (UniqueName: \"kubernetes.io/projected/d4c2d825-1373-498b-9e1b-9ef920cf7115-kube-api-access-595kw\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313020    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db32dfd8-7a12-4e09-8afd-85acac271067-hosts-file\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313028    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313045    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96e790f8-f227-4eb6-87ad-78214669307e-host\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313028    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313073    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysconfig\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313095    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-sys\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313115    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-222t4\""
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313117    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-host\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313172    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d825-1373-498b-9e1b-9ef920cf7115-tmp\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysctl-d\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313227    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-systemd\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313249    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5nht\" (UniqueName: \"kubernetes.io/projected/db32dfd8-7a12-4e09-8afd-85acac271067-kube-api-access-x5nht\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313272    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysctl-conf\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db32dfd8-7a12-4e09-8afd-85acac271067-tmp-dir\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrml8\" (UniqueName: \"kubernetes.io/projected/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-kube-api-access-wrml8\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313351    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 06 05:09:00.313479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.313364    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-dbus\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.314689 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.314671    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 06 05:09:00.314894 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.314873    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 06 05:09:00.314987 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.314901    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m94zn\""
Jun 06 05:09:00.314987 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.314920    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 06 05:09:00.327794 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.327770    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6fvnp"
Jun 06 05:09:00.332912 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.332894    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6fvnp"
Jun 06 05:09:00.400002 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.399972    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 06 05:09:00.414195 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrml8\" (UniqueName: \"kubernetes.io/projected/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-kube-api-access-wrml8\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.414195 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-cni-bin\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.414195 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-cni-multus\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414202    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-daemon-config\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414218    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovnkube-script-lib\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414240    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-device-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-tuned\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e790f8-f227-4eb6-87ad-78214669307e-serviceca\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-multus-certs\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414335    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-modprobe-d\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-kubernetes\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414378    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.414448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovnkube-config\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a5a9f60-8e3e-4b14-9e88-24141a99b4e7-agent-certs\") pod \"konnectivity-agent-hvsjv\" (UID: \"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7\") " pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414502    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-system-cni-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-netns\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db32dfd8-7a12-4e09-8afd-85acac271067-hosts-file\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414561    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96e790f8-f227-4eb6-87ad-78214669307e-host\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-os-release\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414609    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d825-1373-498b-9e1b-9ef920cf7115-tmp\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414712    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cnibin\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-etc-kubernetes\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414737    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414849    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-modprobe-d\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414895    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96e790f8-f227-4eb6-87ad-78214669307e-serviceca\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.414965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414929    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-kubernetes\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.414741    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-slash\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-etc-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415061    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96e790f8-f227-4eb6-87ad-78214669307e-host\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415105    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-env-overrides\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415129    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovn-node-metrics-cert\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415188    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysctl-d\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415196    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db32dfd8-7a12-4e09-8afd-85acac271067-hosts-file\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-systemd\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8qx6\" (UniqueName: \"kubernetes.io/projected/d7fb619c-a89f-4bf1-8252-be0daadaf38f-kube-api-access-r8qx6\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-systemd\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415315    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysctl-d\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysctl-conf\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-cnibin\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-k8s-cni-cncf-io\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.415711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415453    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysctl-conf\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415487    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-systemd\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-var-lib-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415529    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-cni-bin\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-sys-fs\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-dbus\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415742    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-dbus\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415776    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-host-slash\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415800    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-lib-modules\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415849    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-host-slash\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-kubelet-config\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-log-socket\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415952    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-registration-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.415980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-var-lib-kubelet\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416002    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdzxr\" (UniqueName: \"kubernetes.io/projected/3a35b0fa-cf88-449d-a64a-a23dfad602a5-kube-api-access-mdzxr\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416005    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-kubelet-config\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.416531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416025    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-socket-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416045    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-lib-modules\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416061    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htdk4\" (UniqueName: \"kubernetes.io/projected/1e371764-aab1-4b3c-b767-1e778d1bca51-kube-api-access-htdk4\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416066    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-var-lib-kubelet\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcffw\" (UniqueName: \"kubernetes.io/projected/96e790f8-f227-4eb6-87ad-78214669307e-kube-api-access-gcffw\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416172    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-os-release\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.416193    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.416255    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret podName:75dce24e-ff56-42ef-bbc7-a2bb0db4b024 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:00.916234417 +0000 UTC m=+2.964100083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret") pod "global-pull-secret-syncer-db5w4" (UID: "75dce24e-ff56-42ef-bbc7-a2bb0db4b024") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-socket-dir-parent\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416292    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-etc-selinux\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416317    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-cni-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-hostroot\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416368    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-iptables-alerter-script\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416392    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-run\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416415    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-595kw\" (UniqueName: \"kubernetes.io/projected/d4c2d825-1373-498b-9e1b-9ef920cf7115-kube-api-access-595kw\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.417328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysconfig\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-sys\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416524    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-run\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416529    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-host\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jms2\" (UniqueName: \"kubernetes.io/projected/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-kube-api-access-4jms2\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416574    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-sysconfig\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7fb619c-a89f-4bf1-8252-be0daadaf38f-cni-binary-copy\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416640    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-kubelet\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416642    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-host\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5nht\" (UniqueName: \"kubernetes.io/projected/db32dfd8-7a12-4e09-8afd-85acac271067-kube-api-access-x5nht\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416711    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxgqg\" (UniqueName: \"kubernetes.io/projected/6b26181d-73f0-4e9c-9079-7a29e4e0d337-kube-api-access-fxgqg\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416712    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4c2d825-1373-498b-9e1b-9ef920cf7115-sys\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a5a9f60-8e3e-4b14-9e88-24141a99b4e7-konnectivity-ca\") pod \"konnectivity-agent-hvsjv\" (UID: \"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7\") " pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-kubelet\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416816    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-systemd-units\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416838    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-run-netns\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416885    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-cni-netd\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416927    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db32dfd8-7a12-4e09-8afd-85acac271067-tmp-dir\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.416953    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-system-cni-dir\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.417036    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-conf-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.417096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-ovn\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.417131    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-node-log\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.417165    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-iptables-alerter-script\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.417221    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db32dfd8-7a12-4e09-8afd-85acac271067-tmp-dir\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.418007    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d825-1373-498b-9e1b-9ef920cf7115-etc-tuned\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.418755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.418080    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4c2d825-1373-498b-9e1b-9ef920cf7115-tmp\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.420944 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.420916    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrml8\" (UniqueName: \"kubernetes.io/projected/15e36a6d-dccf-41b6-b9a0-9fe37a3817a1-kube-api-access-wrml8\") pod \"iptables-alerter-f4fft\" (UID: \"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1\") " pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.425517 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.425478    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcffw\" (UniqueName: \"kubernetes.io/projected/96e790f8-f227-4eb6-87ad-78214669307e-kube-api-access-gcffw\") pod \"node-ca-wtzwc\" (UID: \"96e790f8-f227-4eb6-87ad-78214669307e\") " pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.425957 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.425939    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5nht\" (UniqueName: \"kubernetes.io/projected/db32dfd8-7a12-4e09-8afd-85acac271067-kube-api-access-x5nht\") pod \"node-resolver-5knmq\" (UID: \"db32dfd8-7a12-4e09-8afd-85acac271067\") " pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.426038 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.425953    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-595kw\" (UniqueName: \"kubernetes.io/projected/d4c2d825-1373-498b-9e1b-9ef920cf7115-kube-api-access-595kw\") pod \"tuned-cwm5c\" (UID: \"d4c2d825-1373-498b-9e1b-9ef920cf7115\") " pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.518215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518179    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8qx6\" (UniqueName: \"kubernetes.io/projected/d7fb619c-a89f-4bf1-8252-be0daadaf38f-kube-api-access-r8qx6\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.518215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-systemd\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518278    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-cnibin\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518297    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-k8s-cni-cncf-io\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518307    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-systemd\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518313    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-var-lib-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518351    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-var-lib-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518356    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-cni-bin\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518386    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-cni-bin\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518394    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518428    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-k8s-cni-cncf-io\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518436    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.518453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518453    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-cnibin\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518495    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-sys-fs\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518519    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-log-socket\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518544    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-registration-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518554    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-log-socket\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518560    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-sys-fs\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdzxr\" (UniqueName: \"kubernetes.io/projected/3a35b0fa-cf88-449d-a64a-a23dfad602a5-kube-api-access-mdzxr\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-socket-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518614    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-registration-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518624    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htdk4\" (UniqueName: \"kubernetes.io/projected/1e371764-aab1-4b3c-b767-1e778d1bca51-kube-api-access-htdk4\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518700    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-os-release\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-socket-dir-parent\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-etc-selinux\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-cni-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518804    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-os-release\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-hostroot\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519016 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518746    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-socket-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518817    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-socket-dir-parent\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518842    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-hostroot\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518862    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-etc-selinux\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.518898    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518901    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-cni-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.518950    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:01.018935708 +0000 UTC m=+3.066801358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.518971    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519014    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jms2\" (UniqueName: \"kubernetes.io/projected/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-kube-api-access-4jms2\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7fb619c-a89f-4bf1-8252-be0daadaf38f-cni-binary-copy\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519094    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-kubelet\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxgqg\" (UniqueName: \"kubernetes.io/projected/6b26181d-73f0-4e9c-9079-7a29e4e0d337-kube-api-access-fxgqg\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519177    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a5a9f60-8e3e-4b14-9e88-24141a99b4e7-konnectivity-ca\") pod \"konnectivity-agent-hvsjv\" (UID: \"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7\") " pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-kubelet\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519216    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-kubelet\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.519759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-systemd-units\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519251    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-run-netns\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519292    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-kubelet\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519301    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-systemd-units\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519306    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519343    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-run-netns\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519361    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-cni-netd\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519366    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519396    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-system-cni-dir\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519397    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-cni-netd\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-conf-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519450    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-system-cni-dir\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-ovn\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519471    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-conf-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519489    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-node-log\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-cni-bin\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519524    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-run-ovn\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-cni-multus\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.520596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519567    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-daemon-config\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519570    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-node-log\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519567    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-cni-bin\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519596    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-var-lib-cni-multus\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovnkube-script-lib\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519648    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7fb619c-a89f-4bf1-8252-be0daadaf38f-cni-binary-copy\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519680    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-device-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519715    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a5a9f60-8e3e-4b14-9e88-24141a99b4e7-konnectivity-ca\") pod \"konnectivity-agent-hvsjv\" (UID: \"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7\") " pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-multus-certs\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519754    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-multus-certs\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519764    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519790    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovnkube-config\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519722    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-device-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519838    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a5a9f60-8e3e-4b14-9e88-24141a99b4e7-agent-certs\") pod \"konnectivity-agent-hvsjv\" (UID: \"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7\") " pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519868    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-system-cni-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519893    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-netns\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521336 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-os-release\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.519970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520036    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cnibin\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520057    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-etc-kubernetes\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520092    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-etc-kubernetes\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-slash\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520062    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7fb619c-a89f-4bf1-8252-be0daadaf38f-multus-daemon-config\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-etc-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520158    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-system-cni-dir\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520182    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-etc-openvswitch\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-env-overrides\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520193    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7fb619c-a89f-4bf1-8252-be0daadaf38f-host-run-netns\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520216    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovn-node-metrics-cert\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520469    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-os-release\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520502    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovnkube-config\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.521984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520520    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cnibin\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520187    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovnkube-script-lib\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520563    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a35b0fa-cf88-449d-a64a-a23dfad602a5-host-slash\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520597    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a35b0fa-cf88-449d-a64a-a23dfad602a5-env-overrides\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520644    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e371764-aab1-4b3c-b767-1e778d1bca51-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520673    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.520731    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.522694 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.522463    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a5a9f60-8e3e-4b14-9e88-24141a99b4e7-agent-certs\") pod \"konnectivity-agent-hvsjv\" (UID: \"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7\") " pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.522973 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.522695    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a35b0fa-cf88-449d-a64a-a23dfad602a5-ovn-node-metrics-cert\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.524721 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.524558    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:00.524721 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.524585    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:00.524721 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.524599    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gdjqt for pod openshift-network-diagnostics/network-check-target-nlgq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:00.524721 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.524684    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt podName:fdbc123f-5509-4692-97c6-259afc83d9e1 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:01.024649332 +0000 UTC m=+3.072515005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gdjqt" (UniqueName: "kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt") pod "network-check-target-nlgq9" (UID: "fdbc123f-5509-4692-97c6-259afc83d9e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:00.530703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.527786    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdzxr\" (UniqueName: \"kubernetes.io/projected/3a35b0fa-cf88-449d-a64a-a23dfad602a5-kube-api-access-mdzxr\") pod \"ovnkube-node-qt2fv\" (UID: \"3a35b0fa-cf88-449d-a64a-a23dfad602a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.530703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.527900    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxgqg\" (UniqueName: \"kubernetes.io/projected/6b26181d-73f0-4e9c-9079-7a29e4e0d337-kube-api-access-fxgqg\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:00.530703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.528514    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htdk4\" (UniqueName: \"kubernetes.io/projected/1e371764-aab1-4b3c-b767-1e778d1bca51-kube-api-access-htdk4\") pod \"aws-ebs-csi-driver-node-p284f\" (UID: \"1e371764-aab1-4b3c-b767-1e778d1bca51\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.531379 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.531355    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jms2\" (UniqueName: \"kubernetes.io/projected/d64bf082-4ce4-47ed-bb8f-4c5c1a915da7-kube-api-access-4jms2\") pod \"multus-additional-cni-plugins-pdx6l\" (UID: \"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7\") " pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.531618 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.531593    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8qx6\" (UniqueName: \"kubernetes.io/projected/d7fb619c-a89f-4bf1-8252-be0daadaf38f-kube-api-access-r8qx6\") pod \"multus-vz7gv\" (UID: \"d7fb619c-a89f-4bf1-8252-be0daadaf38f\") " pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.608353 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.608314    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f4fft"
Jun 06 05:09:00.615961 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.615939    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cwm5c"
Jun 06 05:09:00.623724 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.623699    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5knmq"
Jun 06 05:09:00.629244 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.629222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtzwc"
Jun 06 05:09:00.636831 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.636812    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pdx6l"
Jun 06 05:09:00.643480 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.643458    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vz7gv"
Jun 06 05:09:00.649119 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.649098    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:00.655634 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.655613    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:00.662128 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.662109    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f"
Jun 06 05:09:00.924133 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:00.924096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:00.924306 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.924286    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:00.924383 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:00.924370    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret podName:75dce24e-ff56-42ef-bbc7-a2bb0db4b024 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:01.924354157 +0000 UTC m=+3.972219824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret") pod "global-pull-secret-syncer-db5w4" (UID: "75dce24e-ff56-42ef-bbc7-a2bb0db4b024") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:01.024644 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.024615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:01.024814 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.024771    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:01.024876 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.024837    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:02.024817429 +0000 UTC m=+4.072683075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:01.125358 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.125332    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:01.125474 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.125462    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:01.125519 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.125478    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:01.125519 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.125487    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gdjqt for pod openshift-network-diagnostics/network-check-target-nlgq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:01.125583 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.125530    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt podName:fdbc123f-5509-4692-97c6-259afc83d9e1 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:02.125518749 +0000 UTC m=+4.173384395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdjqt" (UniqueName: "kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt") pod "network-check-target-nlgq9" (UID: "fdbc123f-5509-4692-97c6-259afc83d9e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:01.134084 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.134062    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c2d825_1373_498b_9e1b_9ef920cf7115.slice/crio-6d416005de48fa0aabcf7328cf83cc6049d4033ca3067b7fbccc8dc01f3c1fc6 WatchSource:0}: Error finding container 6d416005de48fa0aabcf7328cf83cc6049d4033ca3067b7fbccc8dc01f3c1fc6: Status 404 returned error can't find the container with id 6d416005de48fa0aabcf7328cf83cc6049d4033ca3067b7fbccc8dc01f3c1fc6
Jun 06 05:09:01.135881 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.135776    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e371764_aab1_4b3c_b767_1e778d1bca51.slice/crio-1ae7f82112722c982c7819c7ae139d62ba119d7a55156aad20be3fe5132db1a7 WatchSource:0}: Error finding container 1ae7f82112722c982c7819c7ae139d62ba119d7a55156aad20be3fe5132db1a7: Status 404 returned error can't find the container with id 1ae7f82112722c982c7819c7ae139d62ba119d7a55156aad20be3fe5132db1a7
Jun 06 05:09:01.138412 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.138387    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5a9f60_8e3e_4b14_9e88_24141a99b4e7.slice/crio-23f680e9dd65d7d7bafd0b7f0d884e9f564bc932375bc175c133dd6df3e8e741 WatchSource:0}: Error finding container 23f680e9dd65d7d7bafd0b7f0d884e9f564bc932375bc175c133dd6df3e8e741: Status 404 returned error can't find the container with id 23f680e9dd65d7d7bafd0b7f0d884e9f564bc932375bc175c133dd6df3e8e741
Jun 06 05:09:01.139531 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.139475    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd64bf082_4ce4_47ed_bb8f_4c5c1a915da7.slice/crio-20a2dae9ffdcb22330c72971f42e1b3eeef5e6aba9d5eb2b13ba125436b5bdb3 WatchSource:0}: Error finding container 20a2dae9ffdcb22330c72971f42e1b3eeef5e6aba9d5eb2b13ba125436b5bdb3: Status 404 returned error can't find the container with id 20a2dae9ffdcb22330c72971f42e1b3eeef5e6aba9d5eb2b13ba125436b5bdb3
Jun 06 05:09:01.140391 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.140335    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e36a6d_dccf_41b6_b9a0_9fe37a3817a1.slice/crio-ec8cb58a8da5e4b48c062e9bdb4727889b7567b6d1b736137851ad8da89880c8 WatchSource:0}: Error finding container ec8cb58a8da5e4b48c062e9bdb4727889b7567b6d1b736137851ad8da89880c8: Status 404 returned error can't find the container with id ec8cb58a8da5e4b48c062e9bdb4727889b7567b6d1b736137851ad8da89880c8
Jun 06 05:09:01.142892 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.142864    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e790f8_f227_4eb6_87ad_78214669307e.slice/crio-39dc3110535ddad042d54c73b10d2bc50ba536e92e1d4bbf27b792bb1eb76bff WatchSource:0}: Error finding container 39dc3110535ddad042d54c73b10d2bc50ba536e92e1d4bbf27b792bb1eb76bff: Status 404 returned error can't find the container with id 39dc3110535ddad042d54c73b10d2bc50ba536e92e1d4bbf27b792bb1eb76bff
Jun 06 05:09:01.143525 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.143496    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb32dfd8_7a12_4e09_8afd_85acac271067.slice/crio-b2cc3aa744a339d8eea259dfbffe22d10693e29a0a8e34019ede21d3205828e2 WatchSource:0}: Error finding container b2cc3aa744a339d8eea259dfbffe22d10693e29a0a8e34019ede21d3205828e2: Status 404 returned error can't find the container with id b2cc3aa744a339d8eea259dfbffe22d10693e29a0a8e34019ede21d3205828e2
Jun 06 05:09:01.144292 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.144271    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a35b0fa_cf88_449d_a64a_a23dfad602a5.slice/crio-3a57d82e4b3a0aff4ffb7aa5be630f5a80232b0865be82c3c3380740ec288edc WatchSource:0}: Error finding container 3a57d82e4b3a0aff4ffb7aa5be630f5a80232b0865be82c3c3380740ec288edc: Status 404 returned error can't find the container with id 3a57d82e4b3a0aff4ffb7aa5be630f5a80232b0865be82c3c3380740ec288edc
Jun 06 05:09:01.145670 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:01.145634    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fb619c_a89f_4bf1_8252_be0daadaf38f.slice/crio-ad7814f993a86119cb37bbefc87fa41ed16a63b0df268db41d2184e4ce2e79e3 WatchSource:0}: Error finding container ad7814f993a86119cb37bbefc87fa41ed16a63b0df268db41d2184e4ce2e79e3: Status 404 returned error can't find the container with id ad7814f993a86119cb37bbefc87fa41ed16a63b0df268db41d2184e4ce2e79e3
Jun 06 05:09:01.335865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.335786    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 05:04:00 +0000 UTC" deadline="2027-12-21 11:46:32.456790898 +0000 UTC"
Jun 06 05:09:01.335865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.335865    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13518h37m31.120934813s"
Jun 06 05:09:01.374248 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.374208    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vz7gv" event={"ID":"d7fb619c-a89f-4bf1-8252-be0daadaf38f","Type":"ContainerStarted","Data":"ad7814f993a86119cb37bbefc87fa41ed16a63b0df268db41d2184e4ce2e79e3"}
Jun 06 05:09:01.375266 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.375237    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerStarted","Data":"20a2dae9ffdcb22330c72971f42e1b3eeef5e6aba9d5eb2b13ba125436b5bdb3"}
Jun 06 05:09:01.376382 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.376360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"3a57d82e4b3a0aff4ffb7aa5be630f5a80232b0865be82c3c3380740ec288edc"}
Jun 06 05:09:01.377303 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.377287    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5knmq" event={"ID":"db32dfd8-7a12-4e09-8afd-85acac271067","Type":"ContainerStarted","Data":"b2cc3aa744a339d8eea259dfbffe22d10693e29a0a8e34019ede21d3205828e2"}
Jun 06 05:09:01.378207 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.378188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hvsjv" event={"ID":"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7","Type":"ContainerStarted","Data":"23f680e9dd65d7d7bafd0b7f0d884e9f564bc932375bc175c133dd6df3e8e741"}
Jun 06 05:09:01.379082 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.379062    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f" event={"ID":"1e371764-aab1-4b3c-b767-1e778d1bca51","Type":"ContainerStarted","Data":"1ae7f82112722c982c7819c7ae139d62ba119d7a55156aad20be3fe5132db1a7"}
Jun 06 05:09:01.379946 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.379919    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwm5c" event={"ID":"d4c2d825-1373-498b-9e1b-9ef920cf7115","Type":"ContainerStarted","Data":"6d416005de48fa0aabcf7328cf83cc6049d4033ca3067b7fbccc8dc01f3c1fc6"}
Jun 06 05:09:01.381255 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.381237    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal" event={"ID":"f4df2d57bbce72652886cb8d629b1afd","Type":"ContainerStarted","Data":"df7c9569a31c2856148fcff60383852c556667bc40f911e75f0b0f478b513860"}
Jun 06 05:09:01.382353 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.382335    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtzwc" event={"ID":"96e790f8-f227-4eb6-87ad-78214669307e","Type":"ContainerStarted","Data":"39dc3110535ddad042d54c73b10d2bc50ba536e92e1d4bbf27b792bb1eb76bff"}
Jun 06 05:09:01.383368 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.383348    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f4fft" event={"ID":"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1","Type":"ContainerStarted","Data":"ec8cb58a8da5e4b48c062e9bdb4727889b7567b6d1b736137851ad8da89880c8"}
Jun 06 05:09:01.393012 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.392968    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-94.ec2.internal" podStartSLOduration=2.392955251 podStartE2EDuration="2.392955251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:01.392324041 +0000 UTC m=+3.440189712" watchObservedRunningTime="2026-06-06 05:09:01.392955251 +0000 UTC m=+3.440820918"
Jun 06 05:09:01.932364 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:01.932326    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:01.932603 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.932490    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:01.932603 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:01.932559    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret podName:75dce24e-ff56-42ef-bbc7-a2bb0db4b024 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:03.932540906 +0000 UTC m=+5.980406566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret") pod "global-pull-secret-syncer-db5w4" (UID: "75dce24e-ff56-42ef-bbc7-a2bb0db4b024") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:02.033622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.033581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:02.033801 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.033755    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:02.033857 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.033830    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:04.033810884 +0000 UTC m=+6.081676535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:02.133958 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.133917    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:02.134162 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.134143    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:02.134223 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.134172    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:02.134223 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.134186    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gdjqt for pod openshift-network-diagnostics/network-check-target-nlgq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:02.134315 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.134249    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt podName:fdbc123f-5509-4692-97c6-259afc83d9e1 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:04.134229256 +0000 UTC m=+6.182094903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdjqt" (UniqueName: "kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt") pod "network-check-target-nlgq9" (UID: "fdbc123f-5509-4692-97c6-259afc83d9e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:02.336995 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.336952    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 05:04:00 +0000 UTC" deadline="2027-11-30 02:06:37.580447298 +0000 UTC"
Jun 06 05:09:02.336995 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.336993    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13004h57m35.243458806s"
Jun 06 05:09:02.366547 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.365779    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:02.366547 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.365943    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:02.366547 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.366361    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:02.366547 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.366473    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:02.367146 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.366989    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:02.367146 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:02.367078    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:02.395551 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.395515    2568 generic.go:356] "Generic (PLEG): container finished" podID="7e2aebb7e3495f5089b25765a239a5d0" containerID="f4f6e95032a2ead03c5756a3b2b3d299c4ff7d2737e6e20ce6503a15fc84c50c" exitCode=0
Jun 06 05:09:02.396800 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:02.396397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal" event={"ID":"7e2aebb7e3495f5089b25765a239a5d0","Type":"ContainerDied","Data":"f4f6e95032a2ead03c5756a3b2b3d299c4ff7d2737e6e20ce6503a15fc84c50c"}
Jun 06 05:09:03.422201 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:03.422159    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal" event={"ID":"7e2aebb7e3495f5089b25765a239a5d0","Type":"ContainerStarted","Data":"6740ac0b7c8ce2f4e1a9b44ad6673439b4a2fd9e810bd8029ee1397df3715377"}
Jun 06 05:09:03.436737 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:03.436679    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-94.ec2.internal" podStartSLOduration=4.436597569 podStartE2EDuration="4.436597569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:03.435690119 +0000 UTC m=+5.483555789" watchObservedRunningTime="2026-06-06 05:09:03.436597569 +0000 UTC m=+5.484463238"
Jun 06 05:09:03.950618 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:03.950578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:03.950824 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:03.950748    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:03.950824 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:03.950812    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret podName:75dce24e-ff56-42ef-bbc7-a2bb0db4b024 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:07.950794231 +0000 UTC m=+9.998659879 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret") pod "global-pull-secret-syncer-db5w4" (UID: "75dce24e-ff56-42ef-bbc7-a2bb0db4b024") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:04.052013 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:04.051966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:04.052192 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.052172    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:04.052271 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.052238    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:08.052218278 +0000 UTC m=+10.100083928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:04.153127 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:04.153085    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:04.153331 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.153286    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:04.153331 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.153307    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:04.153331 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.153327    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gdjqt for pod openshift-network-diagnostics/network-check-target-nlgq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:04.153486 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.153385    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt podName:fdbc123f-5509-4692-97c6-259afc83d9e1 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:08.153366601 +0000 UTC m=+10.201232252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdjqt" (UniqueName: "kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt") pod "network-check-target-nlgq9" (UID: "fdbc123f-5509-4692-97c6-259afc83d9e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:04.364747 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:04.364715    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:04.364920 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:04.364715    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:04.364920 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.364850    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:04.364920 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:04.364885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:04.365071 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.364955    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:04.365071 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:04.365031    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:06.365087 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:06.365037    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:06.365484 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:06.365167    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:06.365568 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:06.365550    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:06.365703 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:06.365643    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:06.365844 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:06.365813    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:06.365961 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:06.365930    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:07.984411 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:07.984364    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:07.984895 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:07.984582    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:07.984895 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:07.984650    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret podName:75dce24e-ff56-42ef-bbc7-a2bb0db4b024 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:15.984630521 +0000 UTC m=+18.032496179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret") pod "global-pull-secret-syncer-db5w4" (UID: "75dce24e-ff56-42ef-bbc7-a2bb0db4b024") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:08.085314 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:08.085144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:08.085475 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.085327    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:08.085475 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.085397    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:16.085377121 +0000 UTC m=+18.133242768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:08.186467 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:08.186357    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:08.186646 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.186532    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:08.186646 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.186553    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:08.186646 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.186565    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gdjqt for pod openshift-network-diagnostics/network-check-target-nlgq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:08.186646 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.186622    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt podName:fdbc123f-5509-4692-97c6-259afc83d9e1 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:16.186604769 +0000 UTC m=+18.234470417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdjqt" (UniqueName: "kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt") pod "network-check-target-nlgq9" (UID: "fdbc123f-5509-4692-97c6-259afc83d9e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:08.365675 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:08.365620    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:08.365835 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.365738    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:08.365957 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:08.365937    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:08.366298 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.366039    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:08.366298 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:08.366129    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:08.366298 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:08.366253    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:10.364590 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:10.364555    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:10.365059 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:10.364713    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:10.365059 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:10.364559    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:10.365169 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:10.365133    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:10.365169 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:10.365165    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:10.365283 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:10.365255    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:12.365470 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:12.365434    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:12.366027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:12.365439    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:12.366027 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:12.365561    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:12.366027 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:12.365637    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:12.366027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:12.365434    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:12.366027 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:12.365724    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:14.364818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:14.364742    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:14.364818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:14.364801    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:14.365327 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:14.364887    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:14.365327 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:14.364945    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:14.365327 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:14.364971    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:14.365327 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:14.365036    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:16.048786 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:16.048539    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:16.049331 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.048705    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:16.049331 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.048967    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret podName:75dce24e-ff56-42ef-bbc7-a2bb0db4b024 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:32.048939232 +0000 UTC m=+34.096804894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret") pod "global-pull-secret-syncer-db5w4" (UID: "75dce24e-ff56-42ef-bbc7-a2bb0db4b024") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:16.149529 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:16.149485    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:16.149733 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.149649    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:16.149797 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.149743    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:32.149723282 +0000 UTC m=+34.197588948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:16.250793 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:16.250748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:16.250969 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.250920    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:16.250969 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.250937    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:16.250969 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.250946    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gdjqt for pod openshift-network-diagnostics/network-check-target-nlgq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:16.251109 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.251004    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt podName:fdbc123f-5509-4692-97c6-259afc83d9e1 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:32.250989989 +0000 UTC m=+34.298855641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdjqt" (UniqueName: "kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt") pod "network-check-target-nlgq9" (UID: "fdbc123f-5509-4692-97c6-259afc83d9e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:16.364861 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:16.364778    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:16.365033 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.364917    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:16.365103 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:16.365049    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:16.365157 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.365122    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:16.365226 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:16.365200    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:16.365360 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:16.365335    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:18.366312 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:18.366275    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:18.366760 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:18.366361    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:18.366760 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:18.366395    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:18.366760 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:18.366413    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:18.366760 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:18.366472    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:18.366760 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:18.366567    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:20.365839 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.365591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:20.366801 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.365591    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:20.366801 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.365646    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:20.366801 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:20.365959    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:20.366801 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:20.365994    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:20.366801 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:20.366070    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:20.456325 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.456213    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtzwc" event={"ID":"96e790f8-f227-4eb6-87ad-78214669307e","Type":"ContainerStarted","Data":"51892dc9d6bb3deafdbb2b6ffd3e1295a340a89efd8c5021a31fac86a9634a2e"}
Jun 06 05:09:20.458693 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.458646    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vz7gv" event={"ID":"d7fb619c-a89f-4bf1-8252-be0daadaf38f","Type":"ContainerStarted","Data":"959f4203dcf0566560e9c4fcaeb84509747d407eb446f1975d1cb2286481669c"}
Jun 06 05:09:20.460630 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.460600    2568 generic.go:356] "Generic (PLEG): container finished" podID="d64bf082-4ce4-47ed-bb8f-4c5c1a915da7" containerID="bed2900f4931d4fff393571f7576f6e410f89ebc3a888a62b5c2fdc7b0c919af" exitCode=0
Jun 06 05:09:20.460772 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.460719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerDied","Data":"bed2900f4931d4fff393571f7576f6e410f89ebc3a888a62b5c2fdc7b0c919af"}
Jun 06 05:09:20.464048 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464023    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:09:20.464418 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464382    2568 generic.go:356] "Generic (PLEG): container finished" podID="3a35b0fa-cf88-449d-a64a-a23dfad602a5" containerID="9f253ad55081d295bb06b11f6a555a4e3ec5896371ec4c70d3baf4e0def6bae1" exitCode=1
Jun 06 05:09:20.464513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464432    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"339596b256abecb67a65d55cc9527f3bd14c8c1b42a18d28fa4f1e40ed847cc1"}
Jun 06 05:09:20.464571 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"b0f15dced46cc2a15254f95767db404d5dcee1cc01643542c8d41c3afe531c9a"}
Jun 06 05:09:20.464624 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"c899a5f6bfb9b0650e4c1b1735c5f9e5193e4a19e15b9e9e16c09ceced710a07"}
Jun 06 05:09:20.464687 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464633    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"0a201d39230467677b1f2369a96290a149d2b31043ca507ad0c147211aa50dfe"}
Jun 06 05:09:20.464752 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerDied","Data":"9f253ad55081d295bb06b11f6a555a4e3ec5896371ec4c70d3baf4e0def6bae1"}
Jun 06 05:09:20.464806 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.464768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"f1446dbc4bfdbf73129bcd6632ee9426a2c2b522bfd93ef4a8e1b24a95564148"}
Jun 06 05:09:20.466000 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.465977    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5knmq" event={"ID":"db32dfd8-7a12-4e09-8afd-85acac271067","Type":"ContainerStarted","Data":"60135d0198417992c2f862141b298961873118cda45c68479a89b08d6a7eda20"}
Jun 06 05:09:20.467599 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.467493    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hvsjv" event={"ID":"3a5a9f60-8e3e-4b14-9e88-24141a99b4e7","Type":"ContainerStarted","Data":"d643a96e7e395c7368b892a37e9588d59c9f355bfa1778eee1c965bab0026898"}
Jun 06 05:09:20.469257 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.469235    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f" event={"ID":"1e371764-aab1-4b3c-b767-1e778d1bca51","Type":"ContainerStarted","Data":"b2eaabc7fd8cca864e009d1a97c537b02d756e24a73776b593c7bf1407398632"}
Jun 06 05:09:20.469528 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.469484    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wtzwc" podStartSLOduration=3.9048501509999998 podStartE2EDuration="22.469465695s" totalImagesPullingTime="18.564615544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:20.468444815 +0000 UTC m=+22.516310496" watchObservedRunningTime="2026-06-06 05:09:20.469465695 +0000 UTC m=+22.517331363"
Jun 06 05:09:20.471608 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.471583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cwm5c" event={"ID":"d4c2d825-1373-498b-9e1b-9ef920cf7115","Type":"ContainerStarted","Data":"2e0caec43b3b122dca826063f33c79b50daf63f19e65cc473937f6746a1b3161"}
Jun 06 05:09:20.493292 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.493230    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hvsjv" podStartSLOduration=8.626139064 podStartE2EDuration="22.493212754s" totalImagesPullingTime="13.86707369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:20.492930954 +0000 UTC m=+22.540796625" watchObservedRunningTime="2026-06-06 05:09:20.493212754 +0000 UTC m=+22.541078423"
Jun 06 05:09:20.493439 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.493420    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5knmq" podStartSLOduration=3.929811106 podStartE2EDuration="22.493414517s" totalImagesPullingTime="18.563603411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:20.481702261 +0000 UTC m=+22.529567924" watchObservedRunningTime="2026-06-06 05:09:20.493414517 +0000 UTC m=+22.541280184"
Jun 06 05:09:20.539967 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.539909    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vz7gv" podStartSLOduration=3.93126936 podStartE2EDuration="22.539893003s" totalImagesPullingTime="18.608623643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:20.522838341 +0000 UTC m=+22.570704009" watchObservedRunningTime="2026-06-06 05:09:20.539893003 +0000 UTC m=+22.587758727"
Jun 06 05:09:20.540240 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.540216    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cwm5c" podStartSLOduration=3.967070986 podStartE2EDuration="22.540208514s" totalImagesPullingTime="18.573137528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:20.539722058 +0000 UTC m=+22.587587727" watchObservedRunningTime="2026-06-06 05:09:20.540208514 +0000 UTC m=+22.588074182"
Jun 06 05:09:20.665483 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.665436    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvsjv_3a5a9f60-8e3e-4b14-9e88-24141a99b4e7/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:20.744700 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.744602    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvsjv_3a5a9f60-8e3e-4b14-9e88-24141a99b4e7/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:20.845098 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:20.845062    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvsjv_3a5a9f60-8e3e-4b14-9e88-24141a99b4e7/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:21.143302 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.143106    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 06 05:09:21.320783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.320749    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:21.321422 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.321402    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:21.375672 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.375543    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T05:09:21.143289331Z","UUID":"231bf23e-03e5-45b3-82e1-253b3e1bea05","Handler":null,"Name":"","Endpoint":""}
Jun 06 05:09:21.377485 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.377462    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 06 05:09:21.377614 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.377507    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 06 05:09:21.475783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.475750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f4fft" event={"ID":"15e36a6d-dccf-41b6-b9a0-9fe37a3817a1","Type":"ContainerStarted","Data":"07fda04003b7bd54a1dbaf9884405123a882a11d3ede4645f205e486746f2dc0"}
Jun 06 05:09:21.477898 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.477869    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f" event={"ID":"1e371764-aab1-4b3c-b767-1e778d1bca51","Type":"ContainerStarted","Data":"a671569baaa09067ff0ef308fa639743ea3b184cf3cbadfaf4e652ec2075ccc2"}
Jun 06 05:09:21.478907 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.478886    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:21.479382 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.479366    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hvsjv"
Jun 06 05:09:21.487559 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.487517    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f4fft" podStartSLOduration=4.920461027 podStartE2EDuration="23.48750027s" totalImagesPullingTime="18.567039243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:21.487441063 +0000 UTC m=+23.535306730" watchObservedRunningTime="2026-06-06 05:09:21.48750027 +0000 UTC m=+23.535365938"
Jun 06 05:09:21.607466 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.607370    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvsjv_3a5a9f60-8e3e-4b14-9e88-24141a99b4e7/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:21.709089 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.709056    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvsjv_3a5a9f60-8e3e-4b14-9e88-24141a99b4e7/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:21.807737 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:21.807695    2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hvsjv_3a5a9f60-8e3e-4b14-9e88-24141a99b4e7/konnectivity-agent/0.log" limit=1024
Jun 06 05:09:22.364682 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:22.364581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:22.364682 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:22.364581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:22.364900 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:22.364734    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:22.364900 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:22.364835    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:22.364994 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:22.364965    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:22.365048 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:22.365031    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:22.482738 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:22.482695    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f" event={"ID":"1e371764-aab1-4b3c-b767-1e778d1bca51","Type":"ContainerStarted","Data":"1d9d792d8bced09a9116419ae29135b823511fb73684e11cb8618b157c6ba26b"}
Jun 06 05:09:22.499028 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:22.498979    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p284f" podStartSLOduration=4.09081084 podStartE2EDuration="24.498965235s" totalImagesPullingTime="20.408154395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:22.498711494 +0000 UTC m=+24.546577161" watchObservedRunningTime="2026-06-06 05:09:22.498965235 +0000 UTC m=+24.546830899"
Jun 06 05:09:23.488518 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:23.488479    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:09:23.489145 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:23.488954    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"9b8a8a37b89f3c5855a35f857b0295fcdbb7269f52ccd2015e237dae8743fe9f"}
Jun 06 05:09:24.365130 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:24.365096    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:24.365328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:24.365096    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:24.365328 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:24.365219    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:24.365328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:24.365231    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:24.365499 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:24.365321    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:24.365499 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:24.365432    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:25.495736 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:25.495546    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:09:25.496161 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:25.496077    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"3d52e23c8fa5f2475e1b86eaad545f28bb9b9fac80cd2f00f2cf38d3869437c7"}
Jun 06 05:09:25.496812 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:25.496689    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:25.497517 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:25.497466    2568 scope.go:117] "RemoveContainer" containerID="9f253ad55081d295bb06b11f6a555a4e3ec5896371ec4c70d3baf4e0def6bae1"
Jun 06 05:09:25.501301 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:25.501275    2568 generic.go:356] "Generic (PLEG): container finished" podID="d64bf082-4ce4-47ed-bb8f-4c5c1a915da7" containerID="6e5bd1c5383f16c78ba7965966555fdf3ef7b538a2639714381e2eac6f8791d6" exitCode=0
Jun 06 05:09:25.501395 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:25.501311    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerDied","Data":"6e5bd1c5383f16c78ba7965966555fdf3ef7b538a2639714381e2eac6f8791d6"}
Jun 06 05:09:25.515399 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:25.515379    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:26.189551 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.189520    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:26.365026 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.364997    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:26.365181 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.364995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:26.365181 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:26.365128    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:26.365181 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.365166    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:26.365282 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:26.365237    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:26.365328 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:26.365302    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:26.507009 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.506881    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:09:26.507342 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.507321    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" event={"ID":"3a35b0fa-cf88-449d-a64a-a23dfad602a5","Type":"ContainerStarted","Data":"689f77d46cd46df5a77143a11aa382210ec6fe69f5ad2b13506eadac6363a6a4"}
Jun 06 05:09:26.508799 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.508748    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:26.526717 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.526694    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:09:26.532175 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.532111    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv" podStartSLOduration=9.879177364 podStartE2EDuration="28.532090201s" totalImagesPullingTime="18.652912837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:26.530956772 +0000 UTC m=+28.578822452" watchObservedRunningTime="2026-06-06 05:09:26.532090201 +0000 UTC m=+28.579955870"
Jun 06 05:09:26.677538 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.677505    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nlgq9"]
Jun 06 05:09:26.677712 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.677680    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:26.677816 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:26.677783    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:26.679939 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.679918    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tmwx5"]
Jun 06 05:09:26.680051 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.680023    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:26.680144 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:26.680125    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:26.689703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.689679    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-db5w4"]
Jun 06 05:09:26.689793 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:26.689759    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:26.689838 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:26.689821    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:27.512002 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:27.511969    2568 generic.go:356] "Generic (PLEG): container finished" podID="d64bf082-4ce4-47ed-bb8f-4c5c1a915da7" containerID="1eb36245d2c69d2e8cbd3fd33d696fb7edb1c9506bb476e730f1bdb3fbbbb8a8" exitCode=0
Jun 06 05:09:27.512572 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:27.512045    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerDied","Data":"1eb36245d2c69d2e8cbd3fd33d696fb7edb1c9506bb476e730f1bdb3fbbbb8a8"}
Jun 06 05:09:28.365883 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:28.365854    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:28.366068 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:28.365943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:28.366068 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:28.365975    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:28.366068 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:28.366006    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:28.366068 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:28.366027    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:28.366295 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:28.366101    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:29.519398 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:29.519364    2568 generic.go:356] "Generic (PLEG): container finished" podID="d64bf082-4ce4-47ed-bb8f-4c5c1a915da7" containerID="bbf69976d9843254209069ebe9fe54f6883a726abf0d32727a110ccb37006e56" exitCode=0
Jun 06 05:09:29.520038 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:29.519422    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerDied","Data":"bbf69976d9843254209069ebe9fe54f6883a726abf0d32727a110ccb37006e56"}
Jun 06 05:09:30.365150 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:30.365113    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:30.365326 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:30.365123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:30.365326 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:30.365249    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:30.365326 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:30.365277    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:30.365451 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:30.365380    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:30.365488 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:30.365446    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:32.071339 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:32.071295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:32.071758 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.071443    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:32.071758 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.071500    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret podName:75dce24e-ff56-42ef-bbc7-a2bb0db4b024 nodeName:}" failed. No retries permitted until 2026-06-06 05:10:04.071485053 +0000 UTC m=+66.119350701 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret") pod "global-pull-secret-syncer-db5w4" (UID: "75dce24e-ff56-42ef-bbc7-a2bb0db4b024") : object "kube-system"/"original-pull-secret" not registered
Jun 06 05:09:32.171757 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:32.171723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:32.171920 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.171902    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:32.171998 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.171984    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:10:04.171963037 +0000 UTC m=+66.219828708 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 05:09:32.272650 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:32.272612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:32.272823 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.272780    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 05:09:32.272823 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.272805    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 05:09:32.272823 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.272817    2568 projected.go:196] Error preparing data for projected volume kube-api-access-gdjqt for pod openshift-network-diagnostics/network-check-target-nlgq9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:32.272988 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.272870    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt podName:fdbc123f-5509-4692-97c6-259afc83d9e1 nodeName:}" failed. No retries permitted until 2026-06-06 05:10:04.272855313 +0000 UTC m=+66.320720972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gdjqt" (UniqueName: "kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt") pod "network-check-target-nlgq9" (UID: "fdbc123f-5509-4692-97c6-259afc83d9e1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 05:09:32.365472 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:32.365392    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:32.365644 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:32.365392    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:32.365644 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.365522    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:09:32.365644 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:32.365605    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:32.365972 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.365734    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-db5w4" podUID="75dce24e-ff56-42ef-bbc7-a2bb0db4b024"
Jun 06 05:09:32.365972 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:32.365825    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nlgq9" podUID="fdbc123f-5509-4692-97c6-259afc83d9e1"
Jun 06 05:09:33.778186 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.778014    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-94.ec2.internal" event="NodeReady"
Jun 06 05:09:33.778552 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.778285    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 06 05:09:33.821427 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.821394    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v9grf"]
Jun 06 05:09:33.844904 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.844865    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-csrv7"]
Jun 06 05:09:33.845066 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.844989    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:33.846810 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.846781    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 06 05:09:33.846810 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.846800    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 06 05:09:33.847001 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.846881    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qbbkp\""
Jun 06 05:09:33.852848 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.852757    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v9grf"]
Jun 06 05:09:33.852848 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.852799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-csrv7"]
Jun 06 05:09:33.852976 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.852854    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:33.854447 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.854428    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fzsg2\""
Jun 06 05:09:33.854699 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.854677    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 06 05:09:33.854699 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.854700    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 06 05:09:33.854886 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.854806    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 06 05:09:33.982513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.982478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f42df47c-6638-466f-b341-b0dbccbfa299-config-volume\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:33.982703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.982522    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42df47c-6638-466f-b341-b0dbccbfa299-tmp-dir\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:33.982703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.982544    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:33.982703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.982564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfw4x\" (UniqueName: \"kubernetes.io/projected/4f79c52e-deb5-493c-a141-676094ef9597-kube-api-access-tfw4x\") pod \"ingress-canary-csrv7\" (UID: \"4f79c52e-deb5-493c-a141-676094ef9597\") " pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:33.982703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.982596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vdcx\" (UniqueName: \"kubernetes.io/projected/f42df47c-6638-466f-b341-b0dbccbfa299-kube-api-access-5vdcx\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:33.982703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:33.982624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f79c52e-deb5-493c-a141-676094ef9597-cert\") pod \"ingress-canary-csrv7\" (UID: \"4f79c52e-deb5-493c-a141-676094ef9597\") " pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:34.083920 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.083888    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f79c52e-deb5-493c-a141-676094ef9597-cert\") pod \"ingress-canary-csrv7\" (UID: \"4f79c52e-deb5-493c-a141-676094ef9597\") " pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:34.084022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.083951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f42df47c-6638-466f-b341-b0dbccbfa299-config-volume\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.084022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.083976    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42df47c-6638-466f-b341-b0dbccbfa299-tmp-dir\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.084022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.083999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.084022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.084017    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfw4x\" (UniqueName: \"kubernetes.io/projected/4f79c52e-deb5-493c-a141-676094ef9597-kube-api-access-tfw4x\") pod \"ingress-canary-csrv7\" (UID: \"4f79c52e-deb5-493c-a141-676094ef9597\") " pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:34.084172 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.084062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdcx\" (UniqueName: \"kubernetes.io/projected/f42df47c-6638-466f-b341-b0dbccbfa299-kube-api-access-5vdcx\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.084209 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:34.084161    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:34.084248 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:34.084240    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:34.584217409 +0000 UTC m=+36.632083065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:34.084434 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.084412    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f42df47c-6638-466f-b341-b0dbccbfa299-tmp-dir\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.084605 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.084581    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f42df47c-6638-466f-b341-b0dbccbfa299-config-volume\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.088007 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.087985    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f79c52e-deb5-493c-a141-676094ef9597-cert\") pod \"ingress-canary-csrv7\" (UID: \"4f79c52e-deb5-493c-a141-676094ef9597\") " pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:34.091743 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.091720    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfw4x\" (UniqueName: \"kubernetes.io/projected/4f79c52e-deb5-493c-a141-676094ef9597-kube-api-access-tfw4x\") pod \"ingress-canary-csrv7\" (UID: \"4f79c52e-deb5-493c-a141-676094ef9597\") " pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:34.092042 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.092023    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vdcx\" (UniqueName: \"kubernetes.io/projected/f42df47c-6638-466f-b341-b0dbccbfa299-kube-api-access-5vdcx\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.162772 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.162726    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-csrv7"
Jun 06 05:09:34.311750 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.311675    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-csrv7"]
Jun 06 05:09:34.315141 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:34.315113    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f79c52e_deb5_493c_a141_676094ef9597.slice/crio-ce7abc43d38bd1a1bc4a112aa802fe9485860ddf78028345570129e386a3c0b5 WatchSource:0}: Error finding container ce7abc43d38bd1a1bc4a112aa802fe9485860ddf78028345570129e386a3c0b5: Status 404 returned error can't find the container with id ce7abc43d38bd1a1bc4a112aa802fe9485860ddf78028345570129e386a3c0b5
Jun 06 05:09:34.365526 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.365491    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:09:34.365699 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.365491    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:09:34.365816 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.365796    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:09:34.367509 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.367491    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 06 05:09:34.367634 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.367554    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 06 05:09:34.367634 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.367604    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l6jm8\""
Jun 06 05:09:34.368079 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.368058    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 06 05:09:34.368183 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.368101    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 06 05:09:34.368183 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.368103    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-smjds\""
Jun 06 05:09:34.533719 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.533683    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-csrv7" event={"ID":"4f79c52e-deb5-493c-a141-676094ef9597","Type":"ContainerStarted","Data":"ce7abc43d38bd1a1bc4a112aa802fe9485860ddf78028345570129e386a3c0b5"}
Jun 06 05:09:34.536364 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.536330    2568 generic.go:356] "Generic (PLEG): container finished" podID="d64bf082-4ce4-47ed-bb8f-4c5c1a915da7" containerID="c09674dd561cb83d1ae76ba90141158886d9812b4663f2f25cf9ef3f1f7d7771" exitCode=0
Jun 06 05:09:34.536482 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.536387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerDied","Data":"c09674dd561cb83d1ae76ba90141158886d9812b4663f2f25cf9ef3f1f7d7771"}
Jun 06 05:09:34.588027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:34.588000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:34.588178 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:34.588157    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:34.588233 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:34.588224    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:35.588210709 +0000 UTC m=+37.636076354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:35.542812 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:35.542771    2568 generic.go:356] "Generic (PLEG): container finished" podID="d64bf082-4ce4-47ed-bb8f-4c5c1a915da7" containerID="704483feef446ac54ec720ce4445737ebc553ef4bae616432d35e500f46ed884" exitCode=0
Jun 06 05:09:35.543211 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:35.542812    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerDied","Data":"704483feef446ac54ec720ce4445737ebc553ef4bae616432d35e500f46ed884"}
Jun 06 05:09:35.597882 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:35.597849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:35.598028 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:35.597998    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:35.598101 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:35.598090    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:37.598069545 +0000 UTC m=+39.645935211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:36.547004 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:36.546922    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-csrv7" event={"ID":"4f79c52e-deb5-493c-a141-676094ef9597","Type":"ContainerStarted","Data":"3ac6410d3e9958ecf66607dfb30027cc94aa0c18ab71eba46455f509efc7f759"}
Jun 06 05:09:36.550350 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:36.550314    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" event={"ID":"d64bf082-4ce4-47ed-bb8f-4c5c1a915da7","Type":"ContainerStarted","Data":"766f1f5671c9dca45512036a0d27732c33bdd74c2933dce4401fdc19a39ad72b"}
Jun 06 05:09:36.580636 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:36.580578    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-csrv7" podStartSLOduration=1.5502251139999998 podStartE2EDuration="3.580563003s" totalImagesPullingTime="2.030337889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:36.58011926 +0000 UTC m=+38.627984940" watchObservedRunningTime="2026-06-06 05:09:36.580563003 +0000 UTC m=+38.628428671"
Jun 06 05:09:36.601693 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:36.601618    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pdx6l" podStartSLOduration=8.980087229 podStartE2EDuration="38.601603744s" totalImagesPullingTime="29.621516515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:36.60098793 +0000 UTC m=+38.648853623" watchObservedRunningTime="2026-06-06 05:09:36.601603744 +0000 UTC m=+38.649469412"
Jun 06 05:09:37.614498 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:37.614456    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:37.614922 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:37.614621    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:37.614922 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:37.614704    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:41.61468866 +0000 UTC m=+43.662554310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:38.594335 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.594300    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"]
Jun 06 05:09:38.596200 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.596182    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.598331 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.598307    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jun 06 05:09:38.598463 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.598307    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 06 05:09:38.598463 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.598307    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jun 06 05:09:38.598463 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.598310    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jun 06 05:09:38.598676 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.598629    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 06 05:09:38.598733 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.598693    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 06 05:09:38.598811 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.598798    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jun 06 05:09:38.605789 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.605764    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"]
Jun 06 05:09:38.720848 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.720809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.720848 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.720853    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.721286 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.720877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-ca\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.721286 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.720902    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fswzc\" (UniqueName: \"kubernetes.io/projected/d5d4d434-6e39-409e-b3ef-be1dd519a356-kube-api-access-fswzc\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.721286 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.720944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-hub\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.721286 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.720983    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d4d434-6e39-409e-b3ef-be1dd519a356-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.821381 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.821349    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-hub\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.821512 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.821394    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d4d434-6e39-409e-b3ef-be1dd519a356-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.821512 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.821429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.821512 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.821470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.821512 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.821499    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-ca\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.821726 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.821520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fswzc\" (UniqueName: \"kubernetes.io/projected/d5d4d434-6e39-409e-b3ef-be1dd519a356-kube-api-access-fswzc\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.822176 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.822151    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5d4d434-6e39-409e-b3ef-be1dd519a356-additional-service-ca\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.825186 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.825158    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-hub\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.825287 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.825162    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.825287 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.825164    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-ca\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.825287 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.825272    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5d4d434-6e39-409e-b3ef-be1dd519a356-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.828018 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.827997    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fswzc\" (UniqueName: \"kubernetes.io/projected/d5d4d434-6e39-409e-b3ef-be1dd519a356-kube-api-access-fswzc\") pod \"cluster-proxy-proxy-agent-56f6bf7955-vfcvr\" (UID: \"d5d4d434-6e39-409e-b3ef-be1dd519a356\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:38.919267 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:38.919173    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:09:39.040607 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:39.040570    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"]
Jun 06 05:09:39.043815 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:09:39.043787    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5d4d434_6e39_409e_b3ef_be1dd519a356.slice/crio-17be475ae19c391026894eafd6842d6bb7a9ea62df02c3c9bdfbf68843350336 WatchSource:0}: Error finding container 17be475ae19c391026894eafd6842d6bb7a9ea62df02c3c9bdfbf68843350336: Status 404 returned error can't find the container with id 17be475ae19c391026894eafd6842d6bb7a9ea62df02c3c9bdfbf68843350336
Jun 06 05:09:39.558774 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:39.558739    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" event={"ID":"d5d4d434-6e39-409e-b3ef-be1dd519a356","Type":"ContainerStarted","Data":"17be475ae19c391026894eafd6842d6bb7a9ea62df02c3c9bdfbf68843350336"}
Jun 06 05:09:41.643741 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:41.643701    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:41.644225 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:41.643888    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:41.644225 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:41.643962    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:09:49.64394554 +0000 UTC m=+51.691811186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:43.571163 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:43.571130    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" event={"ID":"d5d4d434-6e39-409e-b3ef-be1dd519a356","Type":"ContainerStarted","Data":"77274c750ac7679db29d3f7fc9c8c1901814d0efd39fae3b1b5d3d911192b8c8"}
Jun 06 05:09:43.571527 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:43.571187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" event={"ID":"d5d4d434-6e39-409e-b3ef-be1dd519a356","Type":"ContainerStarted","Data":"8f91bb3b991bf6ae8f64acc44494aaf06e3f67d9692550f84456969a01be0de9"}
Jun 06 05:09:44.575515 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:44.575479    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" event={"ID":"d5d4d434-6e39-409e-b3ef-be1dd519a356","Type":"ContainerStarted","Data":"b2d9ab350b6d1e4b648d5163155f252c4d5545db72000d02f2bca099e8cc0d80"}
Jun 06 05:09:44.590956 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:44.590909    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" podStartSLOduration=2.184385362 podStartE2EDuration="6.590894125s" totalImagesPullingTime="4.406508763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:09:44.590346408 +0000 UTC m=+46.638212075" watchObservedRunningTime="2026-06-06 05:09:44.590894125 +0000 UTC m=+46.638759792"
Jun 06 05:09:49.703062 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:49.703016    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:09:49.703560 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:49.703175    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:09:49.703560 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:09:49.703242    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:10:05.70322676 +0000 UTC m=+67.751092420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:09:58.525130 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:09:58.525097    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt2fv"
Jun 06 05:10:04.097717 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.097649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:10:04.100249 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.100232    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 06 05:10:04.110690 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.110667    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75dce24e-ff56-42ef-bbc7-a2bb0db4b024-original-pull-secret\") pod \"global-pull-secret-syncer-db5w4\" (UID: \"75dce24e-ff56-42ef-bbc7-a2bb0db4b024\") " pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:10:04.198711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.198669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:10:04.201164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.201141    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 06 05:10:04.209600 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:10:04.209579    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 06 05:10:04.209696 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:10:04.209651    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:08.209628893 +0000 UTC m=+130.257494539 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : secret "metrics-daemon-secret" not found
Jun 06 05:10:04.299446 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.299401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:10:04.301247 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.301227    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 06 05:10:04.312471 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.312444    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 06 05:10:04.323305 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.323273    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjqt\" (UniqueName: \"kubernetes.io/projected/fdbc123f-5509-4692-97c6-259afc83d9e1-kube-api-access-gdjqt\") pod \"network-check-target-nlgq9\" (UID: \"fdbc123f-5509-4692-97c6-259afc83d9e1\") " pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:10:04.377894 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.377822    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-smjds\""
Jun 06 05:10:04.381127 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.381112    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-db5w4"
Jun 06 05:10:04.386435 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.386416    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:10:04.509803 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.509775    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-db5w4"]
Jun 06 05:10:04.513101 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:10:04.513075    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75dce24e_ff56_42ef_bbc7_a2bb0db4b024.slice/crio-5002ba3bf2a3aba3152029419633fae3f7f26b0e34e32ef484341fda663eba67 WatchSource:0}: Error finding container 5002ba3bf2a3aba3152029419633fae3f7f26b0e34e32ef484341fda663eba67: Status 404 returned error can't find the container with id 5002ba3bf2a3aba3152029419633fae3f7f26b0e34e32ef484341fda663eba67
Jun 06 05:10:04.529902 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.529876    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nlgq9"]
Jun 06 05:10:04.533859 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:10:04.533833    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbc123f_5509_4692_97c6_259afc83d9e1.slice/crio-5e823b663b9e585561aa05ff07fdfbd21132495520f18db183765ff75922a69c WatchSource:0}: Error finding container 5e823b663b9e585561aa05ff07fdfbd21132495520f18db183765ff75922a69c: Status 404 returned error can't find the container with id 5e823b663b9e585561aa05ff07fdfbd21132495520f18db183765ff75922a69c
Jun 06 05:10:04.624114 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.624081    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-db5w4" event={"ID":"75dce24e-ff56-42ef-bbc7-a2bb0db4b024","Type":"ContainerStarted","Data":"5002ba3bf2a3aba3152029419633fae3f7f26b0e34e32ef484341fda663eba67"}
Jun 06 05:10:04.625032 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:04.625011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nlgq9" event={"ID":"fdbc123f-5509-4692-97c6-259afc83d9e1","Type":"ContainerStarted","Data":"5e823b663b9e585561aa05ff07fdfbd21132495520f18db183765ff75922a69c"}
Jun 06 05:10:05.709889 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:05.709853    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:10:05.710351 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:10:05.710036    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:10:05.710351 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:10:05.710116    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:10:37.710093446 +0000 UTC m=+99.757959116 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:10:09.640561 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:09.640519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nlgq9" event={"ID":"fdbc123f-5509-4692-97c6-259afc83d9e1","Type":"ContainerStarted","Data":"7dd566c5bcca29734f1ec6db8e1e44cfbe6b9fd854748bd7a5de7d72f3c79529"}
Jun 06 05:10:09.641055 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:09.640634    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:10:09.641885 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:09.641865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-db5w4" event={"ID":"75dce24e-ff56-42ef-bbc7-a2bb0db4b024","Type":"ContainerStarted","Data":"5b2baba10a3c1bab956a2af28a04a5a70c03bfb0ee9ca4e82559cef329d4e476"}
Jun 06 05:10:09.654568 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:09.654523    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nlgq9" podStartSLOduration=67.394104102 podStartE2EDuration="1m11.654508569s" totalImagesPullingTime="4.260404467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:10:09.653842815 +0000 UTC m=+71.701708496" watchObservedRunningTime="2026-06-06 05:10:09.654508569 +0000 UTC m=+71.702374237"
Jun 06 05:10:09.666353 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:09.666303    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-db5w4" podStartSLOduration=67.381989309 podStartE2EDuration="1m11.666286605s" totalImagesPullingTime="4.284297296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:10:09.665887065 +0000 UTC m=+71.713752738" watchObservedRunningTime="2026-06-06 05:10:09.666286605 +0000 UTC m=+71.714152272"
Jun 06 05:10:37.729315 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:37.729276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:10:37.729786 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:10:37.729405    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:10:37.729786 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:10:37.729457    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:11:41.729445186 +0000 UTC m=+163.777310831 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:10:40.646942 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:10:40.646912    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nlgq9"
Jun 06 05:11:08.239547 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:08.239497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:11:08.240078 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:08.239630    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 06 05:11:08.240078 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:08.239741    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs podName:6b26181d-73f0-4e9c-9079-7a29e4e0d337 nodeName:}" failed. No retries permitted until 2026-06-06 05:13:10.239726033 +0000 UTC m=+252.287591680 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs") pod "network-metrics-daemon-tmwx5" (UID: "6b26181d-73f0-4e9c-9079-7a29e4e0d337") : secret "metrics-daemon-secret" not found
Jun 06 05:11:36.856680 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:36.856603    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v9grf" podUID="f42df47c-6638-466f-b341-b0dbccbfa299"
Jun 06 05:11:36.887886 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:36.887857    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9grf"
Jun 06 05:11:37.385299 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:37.385215    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tmwx5" podUID="6b26181d-73f0-4e9c-9079-7a29e4e0d337"
Jun 06 05:11:41.769727 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:41.769614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:11:41.770290 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:41.769793    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 05:11:41.770290 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:41.769890    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls podName:f42df47c-6638-466f-b341-b0dbccbfa299 nodeName:}" failed. No retries permitted until 2026-06-06 05:13:43.769867042 +0000 UTC m=+285.817732703 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls") pod "dns-default-v9grf" (UID: "f42df47c-6638-466f-b341-b0dbccbfa299") : secret "dns-default-metrics-tls" not found
Jun 06 05:11:50.364960 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:50.364917    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:11:54.920297 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.920259    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8s7h4"]
Jun 06 05:11:54.922835 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.922818    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:54.924515 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.924487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 06 05:11:54.925081 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.925062    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 06 05:11:54.925144 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.925111    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-p8g87\""
Jun 06 05:11:54.925353 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.925340    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 06 05:11:54.926243 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.926227    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 06 05:11:54.931150 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.931131    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 06 05:11:54.932284 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.932250    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8s7h4"]
Jun 06 05:11:54.953466 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.953439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5q94\" (UniqueName: \"kubernetes.io/projected/218705eb-2c30-4d53-8ac8-c78bb4ead465-kube-api-access-s5q94\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:54.953591 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.953481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218705eb-2c30-4d53-8ac8-c78bb4ead465-serving-cert\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:54.953591 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.953505    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/218705eb-2c30-4d53-8ac8-c78bb4ead465-trusted-ca\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:54.953591 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:54.953542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218705eb-2c30-4d53-8ac8-c78bb4ead465-config\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.054737 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.054705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218705eb-2c30-4d53-8ac8-c78bb4ead465-serving-cert\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.054901 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.054746    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/218705eb-2c30-4d53-8ac8-c78bb4ead465-trusted-ca\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.054901 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.054773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218705eb-2c30-4d53-8ac8-c78bb4ead465-config\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.054901 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.054837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5q94\" (UniqueName: \"kubernetes.io/projected/218705eb-2c30-4d53-8ac8-c78bb4ead465-kube-api-access-s5q94\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.055561 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.055532    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/218705eb-2c30-4d53-8ac8-c78bb4ead465-config\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.055690 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.055598    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/218705eb-2c30-4d53-8ac8-c78bb4ead465-trusted-ca\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.057077 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.057057    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/218705eb-2c30-4d53-8ac8-c78bb4ead465-serving-cert\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.071610 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.071589    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5q94\" (UniqueName: \"kubernetes.io/projected/218705eb-2c30-4d53-8ac8-c78bb4ead465-kube-api-access-s5q94\") pod \"console-operator-668fdbf85c-8s7h4\" (UID: \"218705eb-2c30-4d53-8ac8-c78bb4ead465\") " pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.232675 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.232574    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:11:55.347714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.347681    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8s7h4"]
Jun 06 05:11:55.350891 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:11:55.350866    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218705eb_2c30_4d53_8ac8_c78bb4ead465.slice/crio-6ab6b38831676daf6d48f4034f79e0d5b1383900108e5890436cdd4b68be18e0 WatchSource:0}: Error finding container 6ab6b38831676daf6d48f4034f79e0d5b1383900108e5890436cdd4b68be18e0: Status 404 returned error can't find the container with id 6ab6b38831676daf6d48f4034f79e0d5b1383900108e5890436cdd4b68be18e0
Jun 06 05:11:55.938003 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:55.937967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" event={"ID":"218705eb-2c30-4d53-8ac8-c78bb4ead465","Type":"ContainerStarted","Data":"6ab6b38831676daf6d48f4034f79e0d5b1383900108e5890436cdd4b68be18e0"}
Jun 06 05:11:57.946609 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:57.946529    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/0.log"
Jun 06 05:11:57.946609 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:57.946570    2568 generic.go:356] "Generic (PLEG): container finished" podID="218705eb-2c30-4d53-8ac8-c78bb4ead465" containerID="0d98f3e9e446eebdfb8795eca571576047107936b53cb481eabb7b864cbd6d30" exitCode=255
Jun 06 05:11:57.947025 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:57.946626    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" event={"ID":"218705eb-2c30-4d53-8ac8-c78bb4ead465","Type":"ContainerDied","Data":"0d98f3e9e446eebdfb8795eca571576047107936b53cb481eabb7b864cbd6d30"}
Jun 06 05:11:57.947025 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:57.946870    2568 scope.go:117] "RemoveContainer" containerID="0d98f3e9e446eebdfb8795eca571576047107936b53cb481eabb7b864cbd6d30"
Jun 06 05:11:58.950941 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.950916    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:11:58.951346 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.951326    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/0.log"
Jun 06 05:11:58.951410 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.951389    2568 generic.go:356] "Generic (PLEG): container finished" podID="218705eb-2c30-4d53-8ac8-c78bb4ead465" containerID="623eb57e53276c816fe9973b991debb25274670144a117cce60a691d392fc10b" exitCode=255
Jun 06 05:11:58.951476 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.951449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" event={"ID":"218705eb-2c30-4d53-8ac8-c78bb4ead465","Type":"ContainerDied","Data":"623eb57e53276c816fe9973b991debb25274670144a117cce60a691d392fc10b"}
Jun 06 05:11:58.951536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.951510    2568 scope.go:117] "RemoveContainer" containerID="0d98f3e9e446eebdfb8795eca571576047107936b53cb481eabb7b864cbd6d30"
Jun 06 05:11:58.951732 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.951714    2568 scope.go:117] "RemoveContainer" containerID="623eb57e53276c816fe9973b991debb25274670144a117cce60a691d392fc10b"
Jun 06 05:11:58.951905 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:58.951885    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8s7h4_openshift-console-operator(218705eb-2c30-4d53-8ac8-c78bb4ead465)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" podUID="218705eb-2c30-4d53-8ac8-c78bb4ead465"
Jun 06 05:11:58.995758 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.995729    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"]
Jun 06 05:11:58.997906 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.997890    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"
Jun 06 05:11:58.999634 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.999614    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 06 05:11:58.999828 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.999809    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8rwj7\""
Jun 06 05:11:58.999900 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:58.999860    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 06 05:11:59.007364 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.007343    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"]
Jun 06 05:11:59.082297 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.082257    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfxb4\" (UniqueName: \"kubernetes.io/projected/8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b-kube-api-access-dfxb4\") pod \"migrator-955ffdf5f-wkx88\" (UID: \"8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"
Jun 06 05:11:59.183323 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.183293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfxb4\" (UniqueName: \"kubernetes.io/projected/8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b-kube-api-access-dfxb4\") pod \"migrator-955ffdf5f-wkx88\" (UID: \"8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"
Jun 06 05:11:59.190241 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.190213    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfxb4\" (UniqueName: \"kubernetes.io/projected/8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b-kube-api-access-dfxb4\") pod \"migrator-955ffdf5f-wkx88\" (UID: \"8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"
Jun 06 05:11:59.308619 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.308583    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"
Jun 06 05:11:59.424005 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.423836    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88"]
Jun 06 05:11:59.426478 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:11:59.426450    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3d51d9_2bc6_4af6_a2cf_0e0baca9872b.slice/crio-877096c7fe0382b37c8316e8f4a4b97de0b3e2e7d1980516bb7a4f55207b327b WatchSource:0}: Error finding container 877096c7fe0382b37c8316e8f4a4b97de0b3e2e7d1980516bb7a4f55207b327b: Status 404 returned error can't find the container with id 877096c7fe0382b37c8316e8f4a4b97de0b3e2e7d1980516bb7a4f55207b327b
Jun 06 05:11:59.955140 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.955107    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88" event={"ID":"8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b","Type":"ContainerStarted","Data":"877096c7fe0382b37c8316e8f4a4b97de0b3e2e7d1980516bb7a4f55207b327b"}
Jun 06 05:11:59.956579 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.956558    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:11:59.956872 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:11:59.956859    2568 scope.go:117] "RemoveContainer" containerID="623eb57e53276c816fe9973b991debb25274670144a117cce60a691d392fc10b"
Jun 06 05:11:59.957037 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:11:59.957020    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8s7h4_openshift-console-operator(218705eb-2c30-4d53-8ac8-c78bb4ead465)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" podUID="218705eb-2c30-4d53-8ac8-c78bb4ead465"
Jun 06 05:12:00.315374 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:00.315348    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5knmq_db32dfd8-7a12-4e09-8afd-85acac271067/dns-node-resolver/0.log"
Jun 06 05:12:00.961159 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:00.961078    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88" event={"ID":"8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b","Type":"ContainerStarted","Data":"74ac28268987c3373781bc92f6d4204b8ad745022c4aec307adceb057e605f03"}
Jun 06 05:12:00.961159 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:00.961128    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88" event={"ID":"8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b","Type":"ContainerStarted","Data":"e804371368ed40f28007e1bcc561195cbe84c31f9437026ac195463517a53f67"}
Jun 06 05:12:00.973959 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:00.973908    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-wkx88" podStartSLOduration=1.716345475 podStartE2EDuration="2.973892795s" totalImagesPullingTime="1.25754732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:00.97309216 +0000 UTC m=+183.020957821" watchObservedRunningTime="2026-06-06 05:12:00.973892795 +0000 UTC m=+183.021758462"
Jun 06 05:12:01.715736 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:01.715705    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtzwc_96e790f8-f227-4eb6-87ad-78214669307e/node-ca/0.log"
Jun 06 05:12:02.316246 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:02.316215    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-csrv7_4f79c52e-deb5-493c-a141-676094ef9597/serve-healthcheck-canary/0.log"
Jun 06 05:12:05.233005 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:05.232967    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:12:05.233385 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:05.233028    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:12:05.233385 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:05.233344    2568 scope.go:117] "RemoveContainer" containerID="623eb57e53276c816fe9973b991debb25274670144a117cce60a691d392fc10b"
Jun 06 05:12:05.233495 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:05.233475    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8s7h4_openshift-console-operator(218705eb-2c30-4d53-8ac8-c78bb4ead465)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" podUID="218705eb-2c30-4d53-8ac8-c78bb4ead465"
Jun 06 05:12:15.365762 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:15.365721    2568 scope.go:117] "RemoveContainer" containerID="623eb57e53276c816fe9973b991debb25274670144a117cce60a691d392fc10b"
Jun 06 05:12:16.007564 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:16.007537    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:12:16.007833 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:16.007610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" event={"ID":"218705eb-2c30-4d53-8ac8-c78bb4ead465","Type":"ContainerStarted","Data":"ca4859e447ffa5ff6630da1ab05d75aae7525327f702382ac04dd96bccd28101"}
Jun 06 05:12:16.007921 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:16.007893    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:12:16.022141 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:16.022097    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4" podStartSLOduration=19.798845466 podStartE2EDuration="22.022082477s" totalImagesPullingTime="2.223237011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:16.020877563 +0000 UTC m=+198.068743233" watchObservedRunningTime="2026-06-06 05:12:16.022082477 +0000 UTC m=+198.069948145"
Jun 06 05:12:16.062741 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:16.062714    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-8s7h4"
Jun 06 05:12:23.169795 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.169758    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ctqd6"]
Jun 06 05:12:23.172917 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.172895    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.174863 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.174832    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 06 05:12:23.174990 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.174832    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 06 05:12:23.174990 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.174895    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 06 05:12:23.174990 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.174914    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 06 05:12:23.174990 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.174916    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p7ddh\""
Jun 06 05:12:23.185352 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.185327    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctqd6"]
Jun 06 05:12:23.256242 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.256211    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a57686f-534d-4d73-8357-7a97f5d532ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.256412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.256267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a57686f-534d-4d73-8357-7a97f5d532ad-crio-socket\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.256412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.256292    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a57686f-534d-4d73-8357-7a97f5d532ad-data-volume\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.256412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.256320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a57686f-534d-4d73-8357-7a97f5d532ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.256412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.256398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r866q\" (UniqueName: \"kubernetes.io/projected/5a57686f-534d-4d73-8357-7a97f5d532ad-kube-api-access-r866q\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.357630 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.357591    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a57686f-534d-4d73-8357-7a97f5d532ad-crio-socket\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.357630 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.357634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a57686f-534d-4d73-8357-7a97f5d532ad-data-volume\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.357901 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.357676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a57686f-534d-4d73-8357-7a97f5d532ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.357901 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.357763    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5a57686f-534d-4d73-8357-7a97f5d532ad-crio-socket\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.357901 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.357843    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r866q\" (UniqueName: \"kubernetes.io/projected/5a57686f-534d-4d73-8357-7a97f5d532ad-kube-api-access-r866q\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.358017 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.357904    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a57686f-534d-4d73-8357-7a97f5d532ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.358053 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.358038    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a57686f-534d-4d73-8357-7a97f5d532ad-data-volume\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.358234 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.358218    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5a57686f-534d-4d73-8357-7a97f5d532ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.360209 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.360189    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5a57686f-534d-4d73-8357-7a97f5d532ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.364981 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.364957    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r866q\" (UniqueName: \"kubernetes.io/projected/5a57686f-534d-4d73-8357-7a97f5d532ad-kube-api-access-r866q\") pod \"insights-runtime-extractor-ctqd6\" (UID: \"5a57686f-534d-4d73-8357-7a97f5d532ad\") " pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.481000 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.480912    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctqd6"
Jun 06 05:12:23.603045 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:23.603013    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctqd6"]
Jun 06 05:12:23.605835 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:12:23.605801    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a57686f_534d_4d73_8357_7a97f5d532ad.slice/crio-b31b9731d7cb8a13eaf1d7dd3b0ca9cdee63df87109004062bc9ec3172d4bc4c WatchSource:0}: Error finding container b31b9731d7cb8a13eaf1d7dd3b0ca9cdee63df87109004062bc9ec3172d4bc4c: Status 404 returned error can't find the container with id b31b9731d7cb8a13eaf1d7dd3b0ca9cdee63df87109004062bc9ec3172d4bc4c
Jun 06 05:12:24.033087 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:24.033047    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctqd6" event={"ID":"5a57686f-534d-4d73-8357-7a97f5d532ad","Type":"ContainerStarted","Data":"b98af9c7d412f5a93397e79a0007c86add22efde382606e56b044212367ed607"}
Jun 06 05:12:24.033230 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:24.033105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctqd6" event={"ID":"5a57686f-534d-4d73-8357-7a97f5d532ad","Type":"ContainerStarted","Data":"b31b9731d7cb8a13eaf1d7dd3b0ca9cdee63df87109004062bc9ec3172d4bc4c"}
Jun 06 05:12:25.038273 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.038228    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctqd6" event={"ID":"5a57686f-534d-4d73-8357-7a97f5d532ad","Type":"ContainerStarted","Data":"21f17100467d178d97b11b4df99f140562d263804e26f44fa2dc7ca1537cdf7d"}
Jun 06 05:12:25.160500 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.160467    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65cc87c954-nhlgc"]
Jun 06 05:12:25.163639 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.163613    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.165615 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.165578    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvmzr\""
Jun 06 05:12:25.165615 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.165591    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 06 05:12:25.166617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.166157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 06 05:12:25.166617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.166476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 06 05:12:25.166617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.166502    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 06 05:12:25.166617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.166508    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 06 05:12:25.166617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.166561    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 06 05:12:25.166617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.166571    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 06 05:12:25.174006 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.173984    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cc87c954-nhlgc"]
Jun 06 05:12:25.270435 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.270404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-oauth-serving-cert\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.270435 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.270438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-service-ca\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.270686 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.270562    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-serving-cert\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.270686 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.270615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmb7v\" (UniqueName: \"kubernetes.io/projected/c9791314-2bb0-4a91-a2af-0ca2a7063e79-kube-api-access-hmb7v\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.270686 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.270671    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-config\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.270852 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.270706    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-oauth-config\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.372073 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.371979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-serving-cert\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.372073 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.372050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmb7v\" (UniqueName: \"kubernetes.io/projected/c9791314-2bb0-4a91-a2af-0ca2a7063e79-kube-api-access-hmb7v\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.372299 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.372094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-config\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.372299 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.372123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-oauth-config\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.372299 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.372170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-oauth-serving-cert\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.372299 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.372190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-service-ca\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.373142 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.373075    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-config\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.373142 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.373083    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-service-ca\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.373380 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.373204    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-oauth-serving-cert\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.375101 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.375069    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-serving-cert\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.375420 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.375402    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-oauth-config\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.378898 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.378878    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmb7v\" (UniqueName: \"kubernetes.io/projected/c9791314-2bb0-4a91-a2af-0ca2a7063e79-kube-api-access-hmb7v\") pod \"console-65cc87c954-nhlgc\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") " pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.473504 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.473470    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:25.597292 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.597250    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"]
Jun 06 05:12:25.603922 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.603893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.606146 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.606119    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 06 05:12:25.606146 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.606141    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gbwpk\""
Jun 06 05:12:25.606317 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.606170    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 06 05:12:25.606317 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.606132    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 06 05:12:25.606641 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.606624    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 06 05:12:25.606709 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.606684    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 06 05:12:25.611962 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.611931    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"]
Jun 06 05:12:25.674475 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.674177    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.674475 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.674252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.674475 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.674320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dzj\" (UniqueName: \"kubernetes.io/projected/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-kube-api-access-l8dzj\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.674475 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.674373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.749113 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.749085    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cc87c954-nhlgc"]
Jun 06 05:12:25.753084 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:12:25.753059    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9791314_2bb0_4a91_a2af_0ca2a7063e79.slice/crio-00e6e523b0e8e3002ec9c35def33c104dc0f42ae355dd9334a098dfa240f412e WatchSource:0}: Error finding container 00e6e523b0e8e3002ec9c35def33c104dc0f42ae355dd9334a098dfa240f412e: Status 404 returned error can't find the container with id 00e6e523b0e8e3002ec9c35def33c104dc0f42ae355dd9334a098dfa240f412e
Jun 06 05:12:25.774839 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.774813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.774950 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.774864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dzj\" (UniqueName: \"kubernetes.io/projected/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-kube-api-access-l8dzj\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.774950 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.774892    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.774950 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.774926    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.775110 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:25.775027    2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 06 05:12:25.775110 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:25.775079    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls podName:973d8bd5-ad60-4e90-ab5a-d1fb27a20b44 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:26.275064666 +0000 UTC m=+208.322930313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-b49bq" (UID: "973d8bd5-ad60-4e90-ab5a-d1fb27a20b44") : secret "prometheus-operator-tls" not found
Jun 06 05:12:25.775509 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.775493    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.776990 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.776968    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:25.781488 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:25.781470    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dzj\" (UniqueName: \"kubernetes.io/projected/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-kube-api-access-l8dzj\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:26.043096 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:26.043065    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctqd6" event={"ID":"5a57686f-534d-4d73-8357-7a97f5d532ad","Type":"ContainerStarted","Data":"ba82b8d5107bc6cf48fa7f33d089e4d0feb10d48c8e9aa64ba8e3483d8e5693a"}
Jun 06 05:12:26.044234 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:26.044207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc87c954-nhlgc" event={"ID":"c9791314-2bb0-4a91-a2af-0ca2a7063e79","Type":"ContainerStarted","Data":"00e6e523b0e8e3002ec9c35def33c104dc0f42ae355dd9334a098dfa240f412e"}
Jun 06 05:12:26.058544 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:26.058502    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ctqd6" podStartSLOduration=1.091696566 podStartE2EDuration="3.058487847s" totalImagesPullingTime="1.966791281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:12:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:26.057764336 +0000 UTC m=+208.105630005" watchObservedRunningTime="2026-06-06 05:12:26.058487847 +0000 UTC m=+208.106353515"
Jun 06 05:12:26.279182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:26.279140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:26.279381 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:26.279313    2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jun 06 05:12:26.279450 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:26.279391    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls podName:973d8bd5-ad60-4e90-ab5a-d1fb27a20b44 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:27.279370862 +0000 UTC m=+209.327236526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-b49bq" (UID: "973d8bd5-ad60-4e90-ab5a-d1fb27a20b44") : secret "prometheus-operator-tls" not found
Jun 06 05:12:27.288915 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:27.288871    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:27.291560 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:27.291531    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973d8bd5-ad60-4e90-ab5a-d1fb27a20b44-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-b49bq\" (UID: \"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:27.419315 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:27.419278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"
Jun 06 05:12:27.547158 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:27.547058    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-b49bq"]
Jun 06 05:12:27.550333 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:12:27.550303    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973d8bd5_ad60_4e90_ab5a_d1fb27a20b44.slice/crio-f21c9730bb775fa6d784f8559a9f44446e8b25cdba6e12f96d1f2235cecee182 WatchSource:0}: Error finding container f21c9730bb775fa6d784f8559a9f44446e8b25cdba6e12f96d1f2235cecee182: Status 404 returned error can't find the container with id f21c9730bb775fa6d784f8559a9f44446e8b25cdba6e12f96d1f2235cecee182
Jun 06 05:12:28.052900 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:28.052833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq" event={"ID":"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44","Type":"ContainerStarted","Data":"f21c9730bb775fa6d784f8559a9f44446e8b25cdba6e12f96d1f2235cecee182"}
Jun 06 05:12:28.921074 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:28.921010    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" podUID="d5d4d434-6e39-409e-b3ef-be1dd519a356" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 06 05:12:30.060149 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:30.060106    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc87c954-nhlgc" event={"ID":"c9791314-2bb0-4a91-a2af-0ca2a7063e79","Type":"ContainerStarted","Data":"61cbae1a63e316eea36778b2ead8056910a3ab563ccee51baa85cdb0e788a810"}
Jun 06 05:12:30.061801 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:30.061777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq" event={"ID":"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44","Type":"ContainerStarted","Data":"aeeebdcead608bfd219669dce70ee05d899afc238c45aa067c82239d7e6974d6"}
Jun 06 05:12:30.061887 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:30.061829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq" event={"ID":"973d8bd5-ad60-4e90-ab5a-d1fb27a20b44","Type":"ContainerStarted","Data":"5e44f24405b46e1770564d22943f6931e1814cb283886a067d1c96a309f83a64"}
Jun 06 05:12:30.078489 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:30.078438    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65cc87c954-nhlgc" podStartSLOduration=1.334110114 podStartE2EDuration="5.078424725s" totalImagesPullingTime="3.744314611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:30.077715218 +0000 UTC m=+212.125580898" watchObservedRunningTime="2026-06-06 05:12:30.078424725 +0000 UTC m=+212.126290393"
Jun 06 05:12:30.091234 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:30.091190    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-b49bq" podStartSLOduration=3.146533518 podStartE2EDuration="5.091176247s" totalImagesPullingTime="1.944642729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:30.090581737 +0000 UTC m=+212.138447406" watchObservedRunningTime="2026-06-06 05:12:30.091176247 +0000 UTC m=+212.139041914"
Jun 06 05:12:31.939959 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.939923    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"]
Jun 06 05:12:31.944192 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.944175    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:31.946297 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.946273    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 06 05:12:31.946297 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.946289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 06 05:12:31.946454 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.946306    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-plhc5\""
Jun 06 05:12:31.955842 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.955820    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"]
Jun 06 05:12:31.975058 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.975029    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nwhtp"]
Jun 06 05:12:31.978062 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.978047    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:31.980229 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.980209    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 06 05:12:31.980470 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.980445    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 06 05:12:31.980744 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.980731    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v7p6h\""
Jun 06 05:12:31.980962 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:31.980947    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 06 05:12:32.026866 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.026841    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.026879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-tls\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.026899    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.027010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.026914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72dff\" (UniqueName: \"kubernetes.io/projected/81bd0a66-3de2-4692-b104-95f4846c1c2b-kube-api-access-72dff\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.027010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.026940    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmj4\" (UniqueName: \"kubernetes.io/projected/53469dad-04ae-4a39-85eb-df175148d3d6-kube-api-access-sjmj4\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027013    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027041    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.027167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81bd0a66-3de2-4692-b104-95f4846c1c2b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.027167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027074    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-root\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027111    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-wtmp\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53469dad-04ae-4a39-85eb-df175148d3d6-metrics-client-ca\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027156    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-sys\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.027402 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.027206    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-textfile\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128139 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128105    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmj4\" (UniqueName: \"kubernetes.io/projected/53469dad-04ae-4a39-85eb-df175148d3d6-kube-api-access-sjmj4\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128296 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128296 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128183    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.128296 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128209    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81bd0a66-3de2-4692-b104-95f4846c1c2b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.128296 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128225    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-root\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128296 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-wtmp\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128296 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53469dad-04ae-4a39-85eb-df175148d3d6-metrics-client-ca\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128611 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128345    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-root\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128611 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:32.128356    2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 06 05:12:32.128611 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128415    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-wtmp\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128611 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:32.128426    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-tls podName:81bd0a66-3de2-4692-b104-95f4846c1c2b nodeName:}" failed. No retries permitted until 2026-06-06 05:12:32.62840639 +0000 UTC m=+214.676272039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-sxzl2" (UID: "81bd0a66-3de2-4692-b104-95f4846c1c2b") : secret "openshift-state-metrics-tls" not found
Jun 06 05:12:32.128611 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-sys\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128611 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128512    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-textfile\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128611 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128568    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-tls\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128643    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.128989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72dff\" (UniqueName: \"kubernetes.io/projected/81bd0a66-3de2-4692-b104-95f4846c1c2b-kube-api-access-72dff\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.128989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128866    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.128989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.128934    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53469dad-04ae-4a39-85eb-df175148d3d6-sys\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.129258 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:32.129015    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 06 05:12:32.129258 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.129024    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53469dad-04ae-4a39-85eb-df175148d3d6-metrics-client-ca\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.129258 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.129061    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81bd0a66-3de2-4692-b104-95f4846c1c2b-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.129258 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:12:32.129084    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-tls podName:53469dad-04ae-4a39-85eb-df175148d3d6 nodeName:}" failed. No retries permitted until 2026-06-06 05:12:32.629071808 +0000 UTC m=+214.676937458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-tls") pod "node-exporter-nwhtp" (UID: "53469dad-04ae-4a39-85eb-df175148d3d6") : secret "node-exporter-tls" not found
Jun 06 05:12:32.129258 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.129201    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-textfile\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.130885 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.130863    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.131097 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.131080    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.135393 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.135368    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72dff\" (UniqueName: \"kubernetes.io/projected/81bd0a66-3de2-4692-b104-95f4846c1c2b-kube-api-access-72dff\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.135519 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.135503    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmj4\" (UniqueName: \"kubernetes.io/projected/53469dad-04ae-4a39-85eb-df175148d3d6-kube-api-access-sjmj4\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.633499 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.633466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.633709 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.633542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-tls\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.635930 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.635901    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/53469dad-04ae-4a39-85eb-df175148d3d6-node-exporter-tls\") pod \"node-exporter-nwhtp\" (UID: \"53469dad-04ae-4a39-85eb-df175148d3d6\") " pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.636039 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.635954    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81bd0a66-3de2-4692-b104-95f4846c1c2b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-sxzl2\" (UID: \"81bd0a66-3de2-4692-b104-95f4846c1c2b\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.853504 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.853467    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"
Jun 06 05:12:32.887974 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.887892    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwhtp"
Jun 06 05:12:32.899080 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:12:32.899041    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53469dad_04ae_4a39_85eb_df175148d3d6.slice/crio-69c4a4ad69e8ba6243372f321355d4c85d1d65d87fef95a3b3505c2f108cd93a WatchSource:0}: Error finding container 69c4a4ad69e8ba6243372f321355d4c85d1d65d87fef95a3b3505c2f108cd93a: Status 404 returned error can't find the container with id 69c4a4ad69e8ba6243372f321355d4c85d1d65d87fef95a3b3505c2f108cd93a
Jun 06 05:12:32.985546 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:32.985512    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2"]
Jun 06 05:12:32.989879 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:12:32.989853    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81bd0a66_3de2_4692_b104_95f4846c1c2b.slice/crio-51db304c2f29fd3fdd1133267f67ba9a0ad63734a0b09f38f9b11cad7944d3c6 WatchSource:0}: Error finding container 51db304c2f29fd3fdd1133267f67ba9a0ad63734a0b09f38f9b11cad7944d3c6: Status 404 returned error can't find the container with id 51db304c2f29fd3fdd1133267f67ba9a0ad63734a0b09f38f9b11cad7944d3c6
Jun 06 05:12:33.080104 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:33.080065    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2" event={"ID":"81bd0a66-3de2-4692-b104-95f4846c1c2b","Type":"ContainerStarted","Data":"ec75b05842f848f33da644c351fa77a3cbaf0f20e4b5f9823cf75a3be013ab9f"}
Jun 06 05:12:33.080307 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:33.080177    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2" event={"ID":"81bd0a66-3de2-4692-b104-95f4846c1c2b","Type":"ContainerStarted","Data":"51db304c2f29fd3fdd1133267f67ba9a0ad63734a0b09f38f9b11cad7944d3c6"}
Jun 06 05:12:33.081674 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:33.081634    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwhtp" event={"ID":"53469dad-04ae-4a39-85eb-df175148d3d6","Type":"ContainerStarted","Data":"69c4a4ad69e8ba6243372f321355d4c85d1d65d87fef95a3b3505c2f108cd93a"}
Jun 06 05:12:34.087488 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:34.087452    2568 generic.go:356] "Generic (PLEG): container finished" podID="53469dad-04ae-4a39-85eb-df175148d3d6" containerID="2a8359c1e67b870a142d60572c80faea9ef36454657e5f25478b18f1e6fc1ec8" exitCode=0
Jun 06 05:12:34.087974 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:34.087527    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwhtp" event={"ID":"53469dad-04ae-4a39-85eb-df175148d3d6","Type":"ContainerDied","Data":"2a8359c1e67b870a142d60572c80faea9ef36454657e5f25478b18f1e6fc1ec8"}
Jun 06 05:12:34.089803 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:34.089778    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2" event={"ID":"81bd0a66-3de2-4692-b104-95f4846c1c2b","Type":"ContainerStarted","Data":"534e015f0aeacca195f24f712773d60b5142c59a0e8c5ba290c1a16a0b996287"}
Jun 06 05:12:35.095322 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.095283    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2" event={"ID":"81bd0a66-3de2-4692-b104-95f4846c1c2b","Type":"ContainerStarted","Data":"ae37fb84c8f4d158c6c7aa16828e0e9bda3ca9c8a0dba4821971127af9bb6ade"}
Jun 06 05:12:35.097306 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.097284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwhtp" event={"ID":"53469dad-04ae-4a39-85eb-df175148d3d6","Type":"ContainerStarted","Data":"fd896bebbea1cdea965fd32e4f07ede7937031655d898c5dd67e6c1521d566a0"}
Jun 06 05:12:35.097416 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.097324    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwhtp" event={"ID":"53469dad-04ae-4a39-85eb-df175148d3d6","Type":"ContainerStarted","Data":"2ce778e54fe4843bbe51a5d6ee4bdd0381f77dfd85fdf098e856fe7748fea886"}
Jun 06 05:12:35.111039 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.110985    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-sxzl2" podStartSLOduration=3.026880234 podStartE2EDuration="4.11096827s" totalImagesPullingTime="1.084088036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:35.109765279 +0000 UTC m=+217.157630948" watchObservedRunningTime="2026-06-06 05:12:35.11096827 +0000 UTC m=+217.158833937"
Jun 06 05:12:35.124817 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.124764    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nwhtp" podStartSLOduration=3.278042051 podStartE2EDuration="4.124748789s" totalImagesPullingTime="774.92227ms" totalInitContainerRuntime="71.784468ms" isStatefulPod=true podCreationTimestamp="2026-06-06 05:12:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:12:35.12435311 +0000 UTC m=+217.172218778" watchObservedRunningTime="2026-06-06 05:12:35.124748789 +0000 UTC m=+217.172614448"
Jun 06 05:12:35.474066 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.473977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:35.474286 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.474251    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:12:35.475503 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.475480    2568 patch_prober.go:28] interesting pod/console-65cc87c954-nhlgc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused" start-of-body=
Jun 06 05:12:35.475584 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:35.475524    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-65cc87c954-nhlgc" podUID="c9791314-2bb0-4a91-a2af-0ca2a7063e79" containerName="console" probeResult="failure" output="Get \"https://10.133.0.12:8443/health\": dial tcp 10.133.0.12:8443: connect: connection refused"
Jun 06 05:12:36.745617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:36.745575    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cc87c954-nhlgc"]
Jun 06 05:12:38.920183 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:38.920134    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" podUID="d5d4d434-6e39-409e-b3ef-be1dd519a356" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 06 05:12:48.920606 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:48.920564    2568 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" podUID="d5d4d434-6e39-409e-b3ef-be1dd519a356" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 06 05:12:48.921095 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:48.920634    2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr"
Jun 06 05:12:48.921160 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:48.921122    2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b2d9ab350b6d1e4b648d5163155f252c4d5545db72000d02f2bca099e8cc0d80"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jun 06 05:12:48.921215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:48.921182    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" podUID="d5d4d434-6e39-409e-b3ef-be1dd519a356" containerName="service-proxy" containerID="cri-o://b2d9ab350b6d1e4b648d5163155f252c4d5545db72000d02f2bca099e8cc0d80" gracePeriod=30
Jun 06 05:12:49.145054 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:49.145021    2568 generic.go:356] "Generic (PLEG): container finished" podID="d5d4d434-6e39-409e-b3ef-be1dd519a356" containerID="b2d9ab350b6d1e4b648d5163155f252c4d5545db72000d02f2bca099e8cc0d80" exitCode=2
Jun 06 05:12:49.145205 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:49.145076    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" event={"ID":"d5d4d434-6e39-409e-b3ef-be1dd519a356","Type":"ContainerDied","Data":"b2d9ab350b6d1e4b648d5163155f252c4d5545db72000d02f2bca099e8cc0d80"}
Jun 06 05:12:49.145205 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:12:49.145110    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56f6bf7955-vfcvr" event={"ID":"d5d4d434-6e39-409e-b3ef-be1dd519a356","Type":"ContainerStarted","Data":"6439a7a538cd801c9a5d5d757f9d8c2381deade54fcdd44c163437c4f375abcd"}
Jun 06 05:13:02.123215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:02.123172    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65cc87c954-nhlgc" podUID="c9791314-2bb0-4a91-a2af-0ca2a7063e79" containerName="console" containerID="cri-o://61cbae1a63e316eea36778b2ead8056910a3ab563ccee51baa85cdb0e788a810" gracePeriod=15
Jun 06 05:13:10.336759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:10.336719    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:13:10.339055 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:10.339029    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b26181d-73f0-4e9c-9079-7a29e4e0d337-metrics-certs\") pod \"network-metrics-daemon-tmwx5\" (UID: \"6b26181d-73f0-4e9c-9079-7a29e4e0d337\") " pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:13:10.467256 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:10.467224    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l6jm8\""
Jun 06 05:13:10.475680 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:10.475643    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tmwx5"
Jun 06 05:13:10.596568 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:10.596491    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tmwx5"]
Jun 06 05:13:10.599412 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:13:10.599386    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b26181d_73f0_4e9c_9079_7a29e4e0d337.slice/crio-35a8b5d8b3536d52f5d80626aa483f9675254b41704e008e7c73de04ce33d1ae WatchSource:0}: Error finding container 35a8b5d8b3536d52f5d80626aa483f9675254b41704e008e7c73de04ce33d1ae: Status 404 returned error can't find the container with id 35a8b5d8b3536d52f5d80626aa483f9675254b41704e008e7c73de04ce33d1ae
Jun 06 05:13:11.218741 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:11.218686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tmwx5" event={"ID":"6b26181d-73f0-4e9c-9079-7a29e4e0d337","Type":"ContainerStarted","Data":"35a8b5d8b3536d52f5d80626aa483f9675254b41704e008e7c73de04ce33d1ae"}
Jun 06 05:13:12.224086 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:12.224046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tmwx5" event={"ID":"6b26181d-73f0-4e9c-9079-7a29e4e0d337","Type":"ContainerStarted","Data":"07f860d4e39320aa1488413839e31e2db9d2990f1f568b5fb741fac317f4f3a0"}
Jun 06 05:13:12.224593 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:12.224151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tmwx5" event={"ID":"6b26181d-73f0-4e9c-9079-7a29e4e0d337","Type":"ContainerStarted","Data":"91a849b74ef77a31f123e79b318351ff47d25d442e31c7e3b37d0966a5d05b0b"}
Jun 06 05:13:12.238267 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:12.238206    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tmwx5" podStartSLOduration=253.285338863 podStartE2EDuration="4m14.238189987s" totalImagesPullingTime="952.851124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:13:12.236970085 +0000 UTC m=+254.284835766" watchObservedRunningTime="2026-06-06 05:13:12.238189987 +0000 UTC m=+254.286055655"
Jun 06 05:13:13.988749 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:13.988720    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwhtp_53469dad-04ae-4a39-85eb-df175148d3d6/init-textfile/0.log"
Jun 06 05:13:14.189317 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:14.189280    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwhtp_53469dad-04ae-4a39-85eb-df175148d3d6/node-exporter/0.log"
Jun 06 05:13:14.388312 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:14.388284    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwhtp_53469dad-04ae-4a39-85eb-df175148d3d6/kube-rbac-proxy/0.log"
Jun 06 05:13:15.788465 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:15.788435    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sxzl2_81bd0a66-3de2-4692-b104-95f4846c1c2b/kube-rbac-proxy-main/0.log"
Jun 06 05:13:15.990096 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:15.990067    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sxzl2_81bd0a66-3de2-4692-b104-95f4846c1c2b/kube-rbac-proxy-self/0.log"
Jun 06 05:13:16.188753 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:16.188680    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sxzl2_81bd0a66-3de2-4692-b104-95f4846c1c2b/openshift-state-metrics/0.log"
Jun 06 05:13:17.243154 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.243133    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65cc87c954-nhlgc_c9791314-2bb0-4a91-a2af-0ca2a7063e79/console/0.log"
Jun 06 05:13:17.243451 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.243177    2568 generic.go:356] "Generic (PLEG): container finished" podID="c9791314-2bb0-4a91-a2af-0ca2a7063e79" containerID="61cbae1a63e316eea36778b2ead8056910a3ab563ccee51baa85cdb0e788a810" exitCode=137
Jun 06 05:13:17.243451 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.243213    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc87c954-nhlgc" event={"ID":"c9791314-2bb0-4a91-a2af-0ca2a7063e79","Type":"ContainerDied","Data":"61cbae1a63e316eea36778b2ead8056910a3ab563ccee51baa85cdb0e788a810"}
Jun 06 05:13:17.255542 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.255518    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65cc87c954-nhlgc_c9791314-2bb0-4a91-a2af-0ca2a7063e79/console/0.log"
Jun 06 05:13:17.257163 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.257148    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:13:17.286276 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286250    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-config\") pod \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") "
Jun 06 05:13:17.286422 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286295    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-oauth-serving-cert\") pod \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") "
Jun 06 05:13:17.286422 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286320    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-serving-cert\") pod \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") "
Jun 06 05:13:17.286422 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286355    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-oauth-config\") pod \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") "
Jun 06 05:13:17.286422 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286374    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-service-ca\") pod \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") "
Jun 06 05:13:17.286619 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286427    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmb7v\" (UniqueName: \"kubernetes.io/projected/c9791314-2bb0-4a91-a2af-0ca2a7063e79-kube-api-access-hmb7v\") pod \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\" (UID: \"c9791314-2bb0-4a91-a2af-0ca2a7063e79\") "
Jun 06 05:13:17.286773 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286743    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9791314-2bb0-4a91-a2af-0ca2a7063e79" (UID: "c9791314-2bb0-4a91-a2af-0ca2a7063e79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:13:17.286773 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286753    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-config" (OuterVolumeSpecName: "console-config") pod "c9791314-2bb0-4a91-a2af-0ca2a7063e79" (UID: "c9791314-2bb0-4a91-a2af-0ca2a7063e79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:13:17.286908 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.286838    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9791314-2bb0-4a91-a2af-0ca2a7063e79" (UID: "c9791314-2bb0-4a91-a2af-0ca2a7063e79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:13:17.288668 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.288635    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9791314-2bb0-4a91-a2af-0ca2a7063e79" (UID: "c9791314-2bb0-4a91-a2af-0ca2a7063e79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:17.288733 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.288685    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9791314-2bb0-4a91-a2af-0ca2a7063e79-kube-api-access-hmb7v" (OuterVolumeSpecName: "kube-api-access-hmb7v") pod "c9791314-2bb0-4a91-a2af-0ca2a7063e79" (UID: "c9791314-2bb0-4a91-a2af-0ca2a7063e79"). InnerVolumeSpecName "kube-api-access-hmb7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:13:17.288821 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.288798    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9791314-2bb0-4a91-a2af-0ca2a7063e79" (UID: "c9791314-2bb0-4a91-a2af-0ca2a7063e79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:13:17.387383 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.387213    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmb7v\" (UniqueName: \"kubernetes.io/projected/c9791314-2bb0-4a91-a2af-0ca2a7063e79-kube-api-access-hmb7v\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:13:17.387383 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.387253    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-config\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:13:17.387383 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.387269    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-oauth-serving-cert\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:13:17.387383 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.387282    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-serving-cert\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:13:17.387383 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.387295    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9791314-2bb0-4a91-a2af-0ca2a7063e79-console-oauth-config\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:13:17.387383 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.387309    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9791314-2bb0-4a91-a2af-0ca2a7063e79-service-ca\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:13:17.789951 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.789923    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-b49bq_973d8bd5-ad60-4e90-ab5a-d1fb27a20b44/prometheus-operator/0.log"
Jun 06 05:13:17.988328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:17.988301    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-b49bq_973d8bd5-ad60-4e90-ab5a-d1fb27a20b44/kube-rbac-proxy/0.log"
Jun 06 05:13:18.247731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:18.247641    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65cc87c954-nhlgc_c9791314-2bb0-4a91-a2af-0ca2a7063e79/console/0.log"
Jun 06 05:13:18.248159 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:18.247745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc87c954-nhlgc" event={"ID":"c9791314-2bb0-4a91-a2af-0ca2a7063e79","Type":"ContainerDied","Data":"00e6e523b0e8e3002ec9c35def33c104dc0f42ae355dd9334a098dfa240f412e"}
Jun 06 05:13:18.248159 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:18.247764    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc87c954-nhlgc"
Jun 06 05:13:18.248159 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:18.247806    2568 scope.go:117] "RemoveContainer" containerID="61cbae1a63e316eea36778b2ead8056910a3ab563ccee51baa85cdb0e788a810"
Jun 06 05:13:18.266519 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:18.266493    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cc87c954-nhlgc"]
Jun 06 05:13:18.273282 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:18.271050    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65cc87c954-nhlgc"]
Jun 06 05:13:18.369424 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:18.369392    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9791314-2bb0-4a91-a2af-0ca2a7063e79" path="/var/lib/kubelet/pods/c9791314-2bb0-4a91-a2af-0ca2a7063e79/volumes"
Jun 06 05:13:19.788944 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:19.788919    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:13:19.993010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:19.992981    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/2.log"
Jun 06 05:13:22.188735 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:22.188707    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5knmq_db32dfd8-7a12-4e09-8afd-85acac271067/dns-node-resolver/0.log"
Jun 06 05:13:23.589595 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:23.589569    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtzwc_96e790f8-f227-4eb6-87ad-78214669307e/node-ca/0.log"
Jun 06 05:13:24.189169 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:24.189135    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-csrv7_4f79c52e-deb5-493c-a141-676094ef9597/serve-healthcheck-canary/0.log"
Jun 06 05:13:39.889136 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:13:39.889086    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-v9grf" podUID="f42df47c-6638-466f-b341-b0dbccbfa299"
Jun 06 05:13:40.321433 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:40.321399    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9grf"
Jun 06 05:13:43.793398 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:43.793333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:13:43.795573 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:43.795551    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f42df47c-6638-466f-b341-b0dbccbfa299-metrics-tls\") pod \"dns-default-v9grf\" (UID: \"f42df47c-6638-466f-b341-b0dbccbfa299\") " pod="openshift-dns/dns-default-v9grf"
Jun 06 05:13:43.924412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:43.924377    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qbbkp\""
Jun 06 05:13:43.932812 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:43.932787    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9grf"
Jun 06 05:13:44.058122 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:44.058022    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v9grf"]
Jun 06 05:13:44.061550 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:13:44.061523    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42df47c_6638_466f_b341_b0dbccbfa299.slice/crio-1d75794700da92fc09d244694eb27fa08bc96a94337c1c271689c3d7cd853dff WatchSource:0}: Error finding container 1d75794700da92fc09d244694eb27fa08bc96a94337c1c271689c3d7cd853dff: Status 404 returned error can't find the container with id 1d75794700da92fc09d244694eb27fa08bc96a94337c1c271689c3d7cd853dff
Jun 06 05:13:44.335795 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:44.335708    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9grf" event={"ID":"f42df47c-6638-466f-b341-b0dbccbfa299","Type":"ContainerStarted","Data":"1d75794700da92fc09d244694eb27fa08bc96a94337c1c271689c3d7cd853dff"}
Jun 06 05:13:46.345525 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:46.345483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9grf" event={"ID":"f42df47c-6638-466f-b341-b0dbccbfa299","Type":"ContainerStarted","Data":"3666b6af82345e2a74b8149cff7bd00ec31870e86a85a34c32c698bbf9296b38"}
Jun 06 05:13:46.345926 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:46.345542    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9grf" event={"ID":"f42df47c-6638-466f-b341-b0dbccbfa299","Type":"ContainerStarted","Data":"d92df52c2fde1e50826d8a6058d294f47f6c2b9ad2785f57628ff68462db1510"}
Jun 06 05:13:46.345926 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:46.345600    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v9grf"
Jun 06 05:13:46.359781 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:46.359726    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v9grf" podStartSLOduration=251.873156513 podStartE2EDuration="4m13.359707709s" totalImagesPullingTime="1.486551196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:13:46.359109935 +0000 UTC m=+288.406975602" watchObservedRunningTime="2026-06-06 05:13:46.359707709 +0000 UTC m=+288.407573378"
Jun 06 05:13:56.352084 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:56.352051    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v9grf"
Jun 06 05:13:58.310304 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:58.310275    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:13:58.310771 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:58.310352    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:13:58.316745 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:58.316719    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:13:58.317351 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:58.317274    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:13:58.322843 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:58.322824    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jun 06 05:13:59.517337 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.517301    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b4c5f458-528v4"]
Jun 06 05:13:59.519767 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.517696    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9791314-2bb0-4a91-a2af-0ca2a7063e79" containerName="console"
Jun 06 05:13:59.519767 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.517714    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9791314-2bb0-4a91-a2af-0ca2a7063e79" containerName="console"
Jun 06 05:13:59.519767 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.517797    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9791314-2bb0-4a91-a2af-0ca2a7063e79" containerName="console"
Jun 06 05:13:59.521134 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.521110    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.523234 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.523212    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 06 05:13:59.524590 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.524563    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 06 05:13:59.524734 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.524637    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 06 05:13:59.524853 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.524833    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 06 05:13:59.524961 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.524942    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 06 05:13:59.525047 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.525027    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 06 05:13:59.525177 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.524835    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvmzr\""
Jun 06 05:13:59.525583 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.525560    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 06 05:13:59.530228 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.530050    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 06 05:13:59.533214 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.532819    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b4c5f458-528v4"]
Jun 06 05:13:59.612369 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.612329    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-service-ca\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.612547 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.612378    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-serving-cert\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.612547 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.612419    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-console-config\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.612547 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.612484    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-oauth-config\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.612547 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.612537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-oauth-serving-cert\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.612735 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.612593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-trusted-ca-bundle\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.612735 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.612623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzkgx\" (UniqueName: \"kubernetes.io/projected/ca344372-dc18-4958-934f-e37505c147a8-kube-api-access-bzkgx\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.713030 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.712979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-trusted-ca-bundle\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.713030 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.713031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkgx\" (UniqueName: \"kubernetes.io/projected/ca344372-dc18-4958-934f-e37505c147a8-kube-api-access-bzkgx\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.713281 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.713060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-service-ca\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.713281 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.713089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-serving-cert\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.713281 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.713245    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-console-config\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.713429 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.713298    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-oauth-config\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.713429 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.713343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-oauth-serving-cert\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.714030 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.714002    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-console-config\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.714030 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.714022    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-service-ca\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.714210 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.714148    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-trusted-ca-bundle\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.714210 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.714148    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-oauth-serving-cert\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.716089 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.716068    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-serving-cert\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.716167 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.716116    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-oauth-config\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.719503 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.719482    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzkgx\" (UniqueName: \"kubernetes.io/projected/ca344372-dc18-4958-934f-e37505c147a8-kube-api-access-bzkgx\") pod \"console-8b4c5f458-528v4\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") " pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.833758 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.833678    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:13:59.963065 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:13:59.963032    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b4c5f458-528v4"]
Jun 06 05:13:59.965948 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:13:59.965917    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca344372_dc18_4958_934f_e37505c147a8.slice/crio-3859caa3cf41dba8f5381b1413900cbc80a5b8871f33c9012811c29c029a5de4 WatchSource:0}: Error finding container 3859caa3cf41dba8f5381b1413900cbc80a5b8871f33c9012811c29c029a5de4: Status 404 returned error can't find the container with id 3859caa3cf41dba8f5381b1413900cbc80a5b8871f33c9012811c29c029a5de4
Jun 06 05:14:00.397136 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:14:00.397101    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b4c5f458-528v4" event={"ID":"ca344372-dc18-4958-934f-e37505c147a8","Type":"ContainerStarted","Data":"9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d"}
Jun 06 05:14:00.397307 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:14:00.397149    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b4c5f458-528v4" event={"ID":"ca344372-dc18-4958-934f-e37505c147a8","Type":"ContainerStarted","Data":"3859caa3cf41dba8f5381b1413900cbc80a5b8871f33c9012811c29c029a5de4"}
Jun 06 05:14:00.416360 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:14:00.416314    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b4c5f458-528v4" podStartSLOduration=1.416296238 podStartE2EDuration="1.416296238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:14:00.415041552 +0000 UTC m=+302.462907252" watchObservedRunningTime="2026-06-06 05:14:00.416296238 +0000 UTC m=+302.464161955"
Jun 06 05:14:09.834669 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:14:09.834622    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:14:09.835145 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:14:09.834700    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:14:09.839419 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:14:09.839395    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:14:10.434306 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:14:10.434278    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:15:27.230932 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:27.230892    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b4c5f458-528v4"]
Jun 06 05:15:52.251294 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.251246    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8b4c5f458-528v4" podUID="ca344372-dc18-4958-934f-e37505c147a8" containerName="console" containerID="cri-o://9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d" gracePeriod=15
Jun 06 05:15:52.492116 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.492088    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:15:52.632876 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.632839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-oauth-config\") pod \"ca344372-dc18-4958-934f-e37505c147a8\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") "
Jun 06 05:15:52.632876 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.632883    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-service-ca\") pod \"ca344372-dc18-4958-934f-e37505c147a8\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") "
Jun 06 05:15:52.633104 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.632900    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-trusted-ca-bundle\") pod \"ca344372-dc18-4958-934f-e37505c147a8\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") "
Jun 06 05:15:52.633104 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.632927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzkgx\" (UniqueName: \"kubernetes.io/projected/ca344372-dc18-4958-934f-e37505c147a8-kube-api-access-bzkgx\") pod \"ca344372-dc18-4958-934f-e37505c147a8\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") "
Jun 06 05:15:52.633104 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.632957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-oauth-serving-cert\") pod \"ca344372-dc18-4958-934f-e37505c147a8\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") "
Jun 06 05:15:52.633104 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.633004    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-console-config\") pod \"ca344372-dc18-4958-934f-e37505c147a8\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") "
Jun 06 05:15:52.633104 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.633051    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-serving-cert\") pod \"ca344372-dc18-4958-934f-e37505c147a8\" (UID: \"ca344372-dc18-4958-934f-e37505c147a8\") "
Jun 06 05:15:52.633385 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.633260    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca344372-dc18-4958-934f-e37505c147a8" (UID: "ca344372-dc18-4958-934f-e37505c147a8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:15:52.633513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.633476    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-console-config" (OuterVolumeSpecName: "console-config") pod "ca344372-dc18-4958-934f-e37505c147a8" (UID: "ca344372-dc18-4958-934f-e37505c147a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:15:52.633566 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.633530    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca344372-dc18-4958-934f-e37505c147a8" (UID: "ca344372-dc18-4958-934f-e37505c147a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:15:52.633617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.633593    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca344372-dc18-4958-934f-e37505c147a8" (UID: "ca344372-dc18-4958-934f-e37505c147a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:15:52.635149 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.635122    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca344372-dc18-4958-934f-e37505c147a8" (UID: "ca344372-dc18-4958-934f-e37505c147a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:15:52.635149 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.635123    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca344372-dc18-4958-934f-e37505c147a8-kube-api-access-bzkgx" (OuterVolumeSpecName: "kube-api-access-bzkgx") pod "ca344372-dc18-4958-934f-e37505c147a8" (UID: "ca344372-dc18-4958-934f-e37505c147a8"). InnerVolumeSpecName "kube-api-access-bzkgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:15:52.635149 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.635137    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca344372-dc18-4958-934f-e37505c147a8" (UID: "ca344372-dc18-4958-934f-e37505c147a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:15:52.733637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.733586    2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-oauth-serving-cert\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:15:52.733637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.733629    2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-console-config\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:15:52.733637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.733641    2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-serving-cert\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:15:52.733637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.733650    2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca344372-dc18-4958-934f-e37505c147a8-console-oauth-config\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:15:52.733637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.733674    2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-service-ca\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:15:52.733637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.733681    2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca344372-dc18-4958-934f-e37505c147a8-trusted-ca-bundle\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:15:52.733989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.733690    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzkgx\" (UniqueName: \"kubernetes.io/projected/ca344372-dc18-4958-934f-e37505c147a8-kube-api-access-bzkgx\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:15:52.774534 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.774496    2568 generic.go:356] "Generic (PLEG): container finished" podID="ca344372-dc18-4958-934f-e37505c147a8" containerID="9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d" exitCode=0
Jun 06 05:15:52.774750 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.774545    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b4c5f458-528v4"
Jun 06 05:15:52.774750 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.774578    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b4c5f458-528v4" event={"ID":"ca344372-dc18-4958-934f-e37505c147a8","Type":"ContainerDied","Data":"9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d"}
Jun 06 05:15:52.774750 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.774629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b4c5f458-528v4" event={"ID":"ca344372-dc18-4958-934f-e37505c147a8","Type":"ContainerDied","Data":"3859caa3cf41dba8f5381b1413900cbc80a5b8871f33c9012811c29c029a5de4"}
Jun 06 05:15:52.774750 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.774649    2568 scope.go:117] "RemoveContainer" containerID="9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d"
Jun 06 05:15:52.783539 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.783519    2568 scope.go:117] "RemoveContainer" containerID="9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d"
Jun 06 05:15:52.783844 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:15:52.783823    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d\": container with ID starting with 9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d not found: ID does not exist" containerID="9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d"
Jun 06 05:15:52.783910 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.783857    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d"} err="failed to get container status \"9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d\": rpc error: code = NotFound desc = could not find container \"9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d\": container with ID starting with 9a94ce9c0b8b9405f5648bd03b1e74b41b47afaaf832f020bf5944d9b8600a7d not found: ID does not exist"
Jun 06 05:15:52.793072 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.793048    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b4c5f458-528v4"]
Jun 06 05:15:52.796984 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:52.796959    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b4c5f458-528v4"]
Jun 06 05:15:54.369232 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:15:54.369198    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca344372-dc18-4958-934f-e37505c147a8" path="/var/lib/kubelet/pods/ca344372-dc18-4958-934f-e37505c147a8/volumes"
Jun 06 05:18:58.331131 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:18:58.331099    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:18:58.332911 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:18:58.332893    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:18:58.337094 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:18:58.337078    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:18:58.338561 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:18:58.338543    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:19:02.350097 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.350064    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-669599797f-8djw8"]
Jun 06 05:19:02.352308 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.350357    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca344372-dc18-4958-934f-e37505c147a8" containerName="console"
Jun 06 05:19:02.352308 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.350369    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca344372-dc18-4958-934f-e37505c147a8" containerName="console"
Jun 06 05:19:02.352308 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.350421    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca344372-dc18-4958-934f-e37505c147a8" containerName="console"
Jun 06 05:19:02.353175 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.353152    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.355052 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.355024    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 06 05:19:02.355175 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.355119    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 06 05:19:02.355282 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.355257    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 06 05:19:02.355720 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.355698    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 06 05:19:02.355836 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.355813    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvmzr\""
Jun 06 05:19:02.355911 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.355885    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 06 05:19:02.356036 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.356019    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 06 05:19:02.356360 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.356342    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 06 05:19:02.362103 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.362064    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669599797f-8djw8"]
Jun 06 05:19:02.362375 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.362252    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 06 05:19:02.468464 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.468429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-service-ca\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.468638 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.468474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-config\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.468638 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.468505    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-oauth-serving-cert\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.468751 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.468713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-trusted-ca-bundle\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.468800 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.468787    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-oauth-config\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.468874 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.468854    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dpqs\" (UniqueName: \"kubernetes.io/projected/b669f259-46f2-4810-b18f-7dfbf18bc86d-kube-api-access-7dpqs\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.468960 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.468943    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-serving-cert\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.569741 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.569703    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-oauth-config\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.569924 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.569754    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dpqs\" (UniqueName: \"kubernetes.io/projected/b669f259-46f2-4810-b18f-7dfbf18bc86d-kube-api-access-7dpqs\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.569924 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.569791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-serving-cert\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.569924 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.569814    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-service-ca\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.569924 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.569842    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-config\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.569924 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.569872    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-oauth-serving-cert\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.570161 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.570013    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-trusted-ca-bundle\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.570538 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.570514    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-config\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.570637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.570601    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-oauth-serving-cert\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.570637 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.570623    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-service-ca\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.571088 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.571065    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b669f259-46f2-4810-b18f-7dfbf18bc86d-trusted-ca-bundle\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.572217 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.572194    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-oauth-config\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.572360 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.572343    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b669f259-46f2-4810-b18f-7dfbf18bc86d-console-serving-cert\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.576591 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.576570    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dpqs\" (UniqueName: \"kubernetes.io/projected/b669f259-46f2-4810-b18f-7dfbf18bc86d-kube-api-access-7dpqs\") pod \"console-669599797f-8djw8\" (UID: \"b669f259-46f2-4810-b18f-7dfbf18bc86d\") " pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.669877 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.669790    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:02.795756 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:02.795731    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669599797f-8djw8"]
Jun 06 05:19:02.798453 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:19:02.798425    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb669f259_46f2_4810_b18f_7dfbf18bc86d.slice/crio-d5fe79d8aa22ba84a87bfb333f04d6103f719a2a42ee1d19ebf0c310f5adeea8 WatchSource:0}: Error finding container d5fe79d8aa22ba84a87bfb333f04d6103f719a2a42ee1d19ebf0c310f5adeea8: Status 404 returned error can't find the container with id d5fe79d8aa22ba84a87bfb333f04d6103f719a2a42ee1d19ebf0c310f5adeea8
Jun 06 05:19:03.408081 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:03.408045    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669599797f-8djw8" event={"ID":"b669f259-46f2-4810-b18f-7dfbf18bc86d","Type":"ContainerStarted","Data":"b53af13fbe8550ae318dbe3f48e214d50a2e498e4c3d8a615f3470141454fc85"}
Jun 06 05:19:03.408476 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:03.408108    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669599797f-8djw8" event={"ID":"b669f259-46f2-4810-b18f-7dfbf18bc86d","Type":"ContainerStarted","Data":"d5fe79d8aa22ba84a87bfb333f04d6103f719a2a42ee1d19ebf0c310f5adeea8"}
Jun 06 05:19:03.424193 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:03.424136    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-669599797f-8djw8" podStartSLOduration=1.424118516 podStartE2EDuration="1.424118516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:19:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:19:03.4222363 +0000 UTC m=+605.470101978" watchObservedRunningTime="2026-06-06 05:19:03.424118516 +0000 UTC m=+605.471984187"
Jun 06 05:19:12.670394 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:12.670302    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:12.670394 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:12.670372    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:12.675230 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:12.675210    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:19:13.444800 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:19:13.444771    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669599797f-8djw8"
Jun 06 05:23:11.252131 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.252097    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-wvxkf"]
Jun 06 05:23:11.255184 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.255164    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.257197 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.257155    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 06 05:23:11.257335 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.257159    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 06 05:23:11.257335 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.257225    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-bhqtj\""
Jun 06 05:23:11.257449 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.257366    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 06 05:23:11.264228 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.264206    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wvxkf"]
Jun 06 05:23:11.275936 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.275911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdxb\" (UniqueName: \"kubernetes.io/projected/bad06983-d656-4ce5-a442-15aa2b357df9-kube-api-access-nsdxb\") pod \"postgres-864846d4f5-wvxkf\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") " pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.276037 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.275942    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/bad06983-d656-4ce5-a442-15aa2b357df9-postgresdata\") pod \"postgres-864846d4f5-wvxkf\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") " pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.377156 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.377119    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdxb\" (UniqueName: \"kubernetes.io/projected/bad06983-d656-4ce5-a442-15aa2b357df9-kube-api-access-nsdxb\") pod \"postgres-864846d4f5-wvxkf\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") " pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.377156 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.377159    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/bad06983-d656-4ce5-a442-15aa2b357df9-postgresdata\") pod \"postgres-864846d4f5-wvxkf\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") " pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.377491 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.377476    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/bad06983-d656-4ce5-a442-15aa2b357df9-postgresdata\") pod \"postgres-864846d4f5-wvxkf\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") " pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.384060 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.384030    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdxb\" (UniqueName: \"kubernetes.io/projected/bad06983-d656-4ce5-a442-15aa2b357df9-kube-api-access-nsdxb\") pod \"postgres-864846d4f5-wvxkf\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") " pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.565810 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.565776    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:23:11.689698 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.689635    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wvxkf"]
Jun 06 05:23:11.692768 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:23:11.692737    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbad06983_d656_4ce5_a442_15aa2b357df9.slice/crio-5ae92c975c3d91ee10a5e2ce5e442117c93cf2b04b73eae983b025596cb5b20a WatchSource:0}: Error finding container 5ae92c975c3d91ee10a5e2ce5e442117c93cf2b04b73eae983b025596cb5b20a: Status 404 returned error can't find the container with id 5ae92c975c3d91ee10a5e2ce5e442117c93cf2b04b73eae983b025596cb5b20a
Jun 06 05:23:11.694574 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:11.694558    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:23:12.265395 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:12.265364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wvxkf" event={"ID":"bad06983-d656-4ce5-a442-15aa2b357df9","Type":"ContainerStarted","Data":"5ae92c975c3d91ee10a5e2ce5e442117c93cf2b04b73eae983b025596cb5b20a"}
Jun 06 05:23:18.291249 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:18.291211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wvxkf" event={"ID":"bad06983-d656-4ce5-a442-15aa2b357df9","Type":"ContainerStarted","Data":"479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60"}
Jun 06 05:23:18.304090 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:18.304041    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-wvxkf" podStartSLOduration=1.7060604179999999 podStartE2EDuration="7.30402514s" totalImagesPullingTime="5.597964722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:23:18.302998183 +0000 UTC m=+860.350863875" watchObservedRunningTime="2026-06-06 05:23:18.30402514 +0000 UTC m=+860.351890807"
Jun 06 05:23:44.680268 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.680229    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-7nn42"]
Jun 06 05:23:44.683294 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.683275    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7nn42"
Jun 06 05:23:44.685258 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.685235    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 06 05:23:44.685350 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.685332    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-7fhlw\""
Jun 06 05:23:44.689951 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.689915    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-7nn42"]
Jun 06 05:23:44.833676 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.833616    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwgcg\" (UniqueName: \"kubernetes.io/projected/ba3d2510-ed03-4f27-9043-ed4fee807476-kube-api-access-nwgcg\") pod \"feast-test-apply-7nn42\" (UID: \"ba3d2510-ed03-4f27-9043-ed4fee807476\") " pod="test-ns-feast/feast-test-apply-7nn42"
Jun 06 05:23:44.934412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.934326    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwgcg\" (UniqueName: \"kubernetes.io/projected/ba3d2510-ed03-4f27-9043-ed4fee807476-kube-api-access-nwgcg\") pod \"feast-test-apply-7nn42\" (UID: \"ba3d2510-ed03-4f27-9043-ed4fee807476\") " pod="test-ns-feast/feast-test-apply-7nn42"
Jun 06 05:23:44.941205 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.941179    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwgcg\" (UniqueName: \"kubernetes.io/projected/ba3d2510-ed03-4f27-9043-ed4fee807476-kube-api-access-nwgcg\") pod \"feast-test-apply-7nn42\" (UID: \"ba3d2510-ed03-4f27-9043-ed4fee807476\") " pod="test-ns-feast/feast-test-apply-7nn42"
Jun 06 05:23:44.993164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:44.993129    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7nn42"
Jun 06 05:23:45.114012 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:45.113977    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-7nn42"]
Jun 06 05:23:45.117077 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:23:45.117050    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba3d2510_ed03_4f27_9043_ed4fee807476.slice/crio-3f8b56df760a4c53a0f369517beb2fd3346a75acb5e8e297288f412ab297c5e1 WatchSource:0}: Error finding container 3f8b56df760a4c53a0f369517beb2fd3346a75acb5e8e297288f412ab297c5e1: Status 404 returned error can't find the container with id 3f8b56df760a4c53a0f369517beb2fd3346a75acb5e8e297288f412ab297c5e1
Jun 06 05:23:45.384420 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:45.384386    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7nn42" event={"ID":"ba3d2510-ed03-4f27-9043-ed4fee807476","Type":"ContainerStarted","Data":"3f8b56df760a4c53a0f369517beb2fd3346a75acb5e8e297288f412ab297c5e1"}
Jun 06 05:23:51.409914 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:51.409873    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7nn42" event={"ID":"ba3d2510-ed03-4f27-9043-ed4fee807476","Type":"ContainerStarted","Data":"213caaf80ff2710884a66aeb1f528ad55f1e1bd18028972e5fa0b07ac88d4b23"}
Jun 06 05:23:57.433375 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:57.433286    2568 generic.go:356] "Generic (PLEG): container finished" podID="ba3d2510-ed03-4f27-9043-ed4fee807476" containerID="213caaf80ff2710884a66aeb1f528ad55f1e1bd18028972e5fa0b07ac88d4b23" exitCode=0
Jun 06 05:23:57.433375 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:57.433361    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7nn42" event={"ID":"ba3d2510-ed03-4f27-9043-ed4fee807476","Type":"ContainerDied","Data":"213caaf80ff2710884a66aeb1f528ad55f1e1bd18028972e5fa0b07ac88d4b23"}
Jun 06 05:23:58.353283 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:58.353253    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:23:58.353986 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:58.353960    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:23:58.359230 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:58.359209    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:23:58.359918 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:58.359899    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:23:58.438762 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:58.438729    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7nn42" event={"ID":"ba3d2510-ed03-4f27-9043-ed4fee807476","Type":"ContainerStarted","Data":"065b7c688fc54b645e2aa1978021c7d9eaba9b130cdc0ffc7fd8ff15539793cc"}
Jun 06 05:23:58.451964 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:23:58.451916    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-7nn42" podStartSLOduration=2.5995332749999998 podStartE2EDuration="14.451901399s" totalImagesPullingTime="5.593745365s" totalInitContainerRuntime="6.258622759s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:23:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:23:58.451544036 +0000 UTC m=+900.499409703" watchObservedRunningTime="2026-06-06 05:23:58.451901399 +0000 UTC m=+900.499767066"
Jun 06 05:24:07.473610 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:07.473568    2568 generic.go:356] "Generic (PLEG): container finished" podID="ba3d2510-ed03-4f27-9043-ed4fee807476" containerID="065b7c688fc54b645e2aa1978021c7d9eaba9b130cdc0ffc7fd8ff15539793cc" exitCode=0
Jun 06 05:24:07.474054 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:07.473640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7nn42" event={"ID":"ba3d2510-ed03-4f27-9043-ed4fee807476","Type":"ContainerDied","Data":"065b7c688fc54b645e2aa1978021c7d9eaba9b130cdc0ffc7fd8ff15539793cc"}
Jun 06 05:24:08.606406 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:08.606379    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7nn42"
Jun 06 05:24:08.615215 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:08.615192    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwgcg\" (UniqueName: \"kubernetes.io/projected/ba3d2510-ed03-4f27-9043-ed4fee807476-kube-api-access-nwgcg\") pod \"ba3d2510-ed03-4f27-9043-ed4fee807476\" (UID: \"ba3d2510-ed03-4f27-9043-ed4fee807476\") "
Jun 06 05:24:08.617200 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:08.617178    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba3d2510-ed03-4f27-9043-ed4fee807476-kube-api-access-nwgcg" (OuterVolumeSpecName: "kube-api-access-nwgcg") pod "ba3d2510-ed03-4f27-9043-ed4fee807476" (UID: "ba3d2510-ed03-4f27-9043-ed4fee807476"). InnerVolumeSpecName "kube-api-access-nwgcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:24:08.716401 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:08.716365    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwgcg\" (UniqueName: \"kubernetes.io/projected/ba3d2510-ed03-4f27-9043-ed4fee807476-kube-api-access-nwgcg\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:24:09.482542 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:09.482504    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7nn42" event={"ID":"ba3d2510-ed03-4f27-9043-ed4fee807476","Type":"ContainerDied","Data":"3f8b56df760a4c53a0f369517beb2fd3346a75acb5e8e297288f412ab297c5e1"}
Jun 06 05:24:09.482542 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:09.482545    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f8b56df760a4c53a0f369517beb2fd3346a75acb5e8e297288f412ab297c5e1"
Jun 06 05:24:09.482769 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:09.482548    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7nn42"
Jun 06 05:24:09.655897 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:09.655867    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-7nn42_ba3d2510-ed03-4f27-9043-ed4fee807476/feast-0/0.log"
Jun 06 05:24:09.664180 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:09.664158    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-7nn42_ba3d2510-ed03-4f27-9043-ed4fee807476/feast-1/0.log"
Jun 06 05:24:45.204206 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.204173    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-7nn42"]
Jun 06 05:24:45.212363 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.212335    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-7nn42"]
Jun 06 05:24:45.216360 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.216338    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wvxkf"]
Jun 06 05:24:45.216551 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.216528    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-wvxkf" podUID="bad06983-d656-4ce5-a442-15aa2b357df9" containerName="postgres" containerID="cri-o://479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60" gracePeriod=30
Jun 06 05:24:45.450970 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.450942    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:24:45.576131 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.576097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/bad06983-d656-4ce5-a442-15aa2b357df9-postgresdata\") pod \"bad06983-d656-4ce5-a442-15aa2b357df9\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") "
Jun 06 05:24:45.576325 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.576144    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsdxb\" (UniqueName: \"kubernetes.io/projected/bad06983-d656-4ce5-a442-15aa2b357df9-kube-api-access-nsdxb\") pod \"bad06983-d656-4ce5-a442-15aa2b357df9\" (UID: \"bad06983-d656-4ce5-a442-15aa2b357df9\") "
Jun 06 05:24:45.578127 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.578092    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad06983-d656-4ce5-a442-15aa2b357df9-kube-api-access-nsdxb" (OuterVolumeSpecName: "kube-api-access-nsdxb") pod "bad06983-d656-4ce5-a442-15aa2b357df9" (UID: "bad06983-d656-4ce5-a442-15aa2b357df9"). InnerVolumeSpecName "kube-api-access-nsdxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:24:45.605646 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.605595    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bad06983-d656-4ce5-a442-15aa2b357df9-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "bad06983-d656-4ce5-a442-15aa2b357df9" (UID: "bad06983-d656-4ce5-a442-15aa2b357df9"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:24:45.613818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.613791    2568 generic.go:356] "Generic (PLEG): container finished" podID="bad06983-d656-4ce5-a442-15aa2b357df9" containerID="479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60" exitCode=0
Jun 06 05:24:45.613941 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.613836    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-wvxkf"
Jun 06 05:24:45.613941 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.613873    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wvxkf" event={"ID":"bad06983-d656-4ce5-a442-15aa2b357df9","Type":"ContainerDied","Data":"479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60"}
Jun 06 05:24:45.613941 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.613922    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-wvxkf" event={"ID":"bad06983-d656-4ce5-a442-15aa2b357df9","Type":"ContainerDied","Data":"5ae92c975c3d91ee10a5e2ce5e442117c93cf2b04b73eae983b025596cb5b20a"}
Jun 06 05:24:45.613941 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.613941    2568 scope.go:117] "RemoveContainer" containerID="479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60"
Jun 06 05:24:45.621742 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.621721    2568 scope.go:117] "RemoveContainer" containerID="479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60"
Jun 06 05:24:45.622036 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:24:45.622015    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60\": container with ID starting with 479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60 not found: ID does not exist" containerID="479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60"
Jun 06 05:24:45.622109 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.622045    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60"} err="failed to get container status \"479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60\": rpc error: code = NotFound desc = could not find container \"479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60\": container with ID starting with 479fc5dd3c6ad8e76eb4d08dc9fca4aee1f678926fb07fdad6e05b400bbdfd60 not found: ID does not exist"
Jun 06 05:24:45.631493 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.631472    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wvxkf"]
Jun 06 05:24:45.634891 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.634874    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-wvxkf"]
Jun 06 05:24:45.676819 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.676789    2568 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/bad06983-d656-4ce5-a442-15aa2b357df9-postgresdata\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:24:45.676819 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:45.676811    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsdxb\" (UniqueName: \"kubernetes.io/projected/bad06983-d656-4ce5-a442-15aa2b357df9-kube-api-access-nsdxb\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:24:46.375302 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:46.375268    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba3d2510-ed03-4f27-9043-ed4fee807476" path="/var/lib/kubelet/pods/ba3d2510-ed03-4f27-9043-ed4fee807476/volumes"
Jun 06 05:24:46.375688 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:24:46.375645    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bad06983-d656-4ce5-a442-15aa2b357df9" path="/var/lib/kubelet/pods/bad06983-d656-4ce5-a442-15aa2b357df9/volumes"
Jun 06 05:26:41.520247 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520165    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-cks7k"]
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520466    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3d2510-ed03-4f27-9043-ed4fee807476" containerName="feast-1"
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520479    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3d2510-ed03-4f27-9043-ed4fee807476" containerName="feast-1"
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520495    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3d2510-ed03-4f27-9043-ed4fee807476" containerName="feast-0"
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520501    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3d2510-ed03-4f27-9043-ed4fee807476" containerName="feast-0"
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520509    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad06983-d656-4ce5-a442-15aa2b357df9" containerName="postgres"
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520516    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad06983-d656-4ce5-a442-15aa2b357df9" containerName="postgres"
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520558    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad06983-d656-4ce5-a442-15aa2b357df9" containerName="postgres"
Jun 06 05:26:41.520783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.520565    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba3d2510-ed03-4f27-9043-ed4fee807476" containerName="feast-1"
Jun 06 05:26:41.523041 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.523023    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k"
Jun 06 05:26:41.524969 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.524943    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 06 05:26:41.525070 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.524980    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-nfn9m\""
Jun 06 05:26:41.525443 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.525424    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 06 05:26:41.530038 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.530016    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-cks7k"]
Jun 06 05:26:41.613976 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.613941    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc7sm\" (UniqueName: \"kubernetes.io/projected/3741b98b-7a8a-4196-9d5d-88a41d8a9da2-kube-api-access-gc7sm\") pod \"redis-69bbd798b6-cks7k\" (UID: \"3741b98b-7a8a-4196-9d5d-88a41d8a9da2\") " pod="test-ns-feast-rest/redis-69bbd798b6-cks7k"
Jun 06 05:26:41.714922 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.714880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc7sm\" (UniqueName: \"kubernetes.io/projected/3741b98b-7a8a-4196-9d5d-88a41d8a9da2-kube-api-access-gc7sm\") pod \"redis-69bbd798b6-cks7k\" (UID: \"3741b98b-7a8a-4196-9d5d-88a41d8a9da2\") " pod="test-ns-feast-rest/redis-69bbd798b6-cks7k"
Jun 06 05:26:41.722347 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.722323    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc7sm\" (UniqueName: \"kubernetes.io/projected/3741b98b-7a8a-4196-9d5d-88a41d8a9da2-kube-api-access-gc7sm\") pod \"redis-69bbd798b6-cks7k\" (UID: \"3741b98b-7a8a-4196-9d5d-88a41d8a9da2\") " pod="test-ns-feast-rest/redis-69bbd798b6-cks7k"
Jun 06 05:26:41.832812 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.832710    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k"
Jun 06 05:26:41.952905 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:41.952873    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-cks7k"]
Jun 06 05:26:41.956206 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:26:41.956179    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3741b98b_7a8a_4196_9d5d_88a41d8a9da2.slice/crio-3b59ccaf49b0d978e45c37e2df17ee2c4a08c1530acc515e461c43994fd3e809 WatchSource:0}: Error finding container 3b59ccaf49b0d978e45c37e2df17ee2c4a08c1530acc515e461c43994fd3e809: Status 404 returned error can't find the container with id 3b59ccaf49b0d978e45c37e2df17ee2c4a08c1530acc515e461c43994fd3e809
Jun 06 05:26:42.031501 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:42.031469    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k" event={"ID":"3741b98b-7a8a-4196-9d5d-88a41d8a9da2","Type":"ContainerStarted","Data":"3b59ccaf49b0d978e45c37e2df17ee2c4a08c1530acc515e461c43994fd3e809"}
Jun 06 05:26:44.040206 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:44.040172    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k" event={"ID":"3741b98b-7a8a-4196-9d5d-88a41d8a9da2","Type":"ContainerStarted","Data":"0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7"}
Jun 06 05:26:44.053136 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:44.053088    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k" podStartSLOduration=1.6938766539999999 podStartE2EDuration="3.053072085s" totalImagesPullingTime="1.359195431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:26:44.052309344 +0000 UTC m=+1066.100175012" watchObservedRunningTime="2026-06-06 05:26:44.053072085 +0000 UTC m=+1066.100937772"
Jun 06 05:26:46.952881 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:46.952849    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-tsjbq"]
Jun 06 05:26:46.955833 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:46.955813    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:46.957693 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:46.957673    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 06 05:26:46.963204 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:46.962702    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-tsjbq"]
Jun 06 05:26:47.057190 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.057154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/af3e11da-511a-4803-8728-03202e8de89a-postgresdata\") pod \"postgres-864846d4f5-tsjbq\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") " pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:47.057358 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.057219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hk8k\" (UniqueName: \"kubernetes.io/projected/af3e11da-511a-4803-8728-03202e8de89a-kube-api-access-2hk8k\") pod \"postgres-864846d4f5-tsjbq\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") " pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:47.157978 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.157939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/af3e11da-511a-4803-8728-03202e8de89a-postgresdata\") pod \"postgres-864846d4f5-tsjbq\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") " pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:47.158153 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.158018    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hk8k\" (UniqueName: \"kubernetes.io/projected/af3e11da-511a-4803-8728-03202e8de89a-kube-api-access-2hk8k\") pod \"postgres-864846d4f5-tsjbq\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") " pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:47.158327 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.158303    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/af3e11da-511a-4803-8728-03202e8de89a-postgresdata\") pod \"postgres-864846d4f5-tsjbq\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") " pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:47.165823 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.165804    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hk8k\" (UniqueName: \"kubernetes.io/projected/af3e11da-511a-4803-8728-03202e8de89a-kube-api-access-2hk8k\") pod \"postgres-864846d4f5-tsjbq\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") " pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:47.266033 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.266001    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:26:47.387928 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:47.387900    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-tsjbq"]
Jun 06 05:26:47.391438 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:26:47.391410    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf3e11da_511a_4803_8728_03202e8de89a.slice/crio-35133e7b78edaf3ca690008f99a483c9123aebccc89f2f05089fd9eba304c132 WatchSource:0}: Error finding container 35133e7b78edaf3ca690008f99a483c9123aebccc89f2f05089fd9eba304c132: Status 404 returned error can't find the container with id 35133e7b78edaf3ca690008f99a483c9123aebccc89f2f05089fd9eba304c132
Jun 06 05:26:48.055217 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:48.055177    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq" event={"ID":"af3e11da-511a-4803-8728-03202e8de89a","Type":"ContainerStarted","Data":"28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8"}
Jun 06 05:26:48.055217 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:48.055220    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq" event={"ID":"af3e11da-511a-4803-8728-03202e8de89a","Type":"ContainerStarted","Data":"35133e7b78edaf3ca690008f99a483c9123aebccc89f2f05089fd9eba304c132"}
Jun 06 05:26:48.067956 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:26:48.067911    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq" podStartSLOduration=2.067895075 podStartE2EDuration="2.067895075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:26:48.066992094 +0000 UTC m=+1070.114857752" watchObservedRunningTime="2026-06-06 05:26:48.067895075 +0000 UTC m=+1070.115760743"
Jun 06 05:28:58.375232 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:28:58.375203    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:28:58.376459 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:28:58.376435    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:28:58.381405 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:28:58.381383    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:28:58.382421 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:28:58.382397    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:29:05.552349 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.552313    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-tsjbq"]
Jun 06 05:29:05.552756 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.552494    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq" podUID="af3e11da-511a-4803-8728-03202e8de89a" containerName="postgres" containerID="cri-o://28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8" gracePeriod=30
Jun 06 05:29:05.556938 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.556915    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-cks7k"]
Jun 06 05:29:05.557115 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.557084    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k" podUID="3741b98b-7a8a-4196-9d5d-88a41d8a9da2" containerName="redis" containerID="cri-o://0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7" gracePeriod=30
Jun 06 05:29:05.813319 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.813295    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:29:05.816048 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.816025    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k"
Jun 06 05:29:05.892330 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.892297    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc7sm\" (UniqueName: \"kubernetes.io/projected/3741b98b-7a8a-4196-9d5d-88a41d8a9da2-kube-api-access-gc7sm\") pod \"3741b98b-7a8a-4196-9d5d-88a41d8a9da2\" (UID: \"3741b98b-7a8a-4196-9d5d-88a41d8a9da2\") "
Jun 06 05:29:05.892330 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.892341    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/af3e11da-511a-4803-8728-03202e8de89a-postgresdata\") pod \"af3e11da-511a-4803-8728-03202e8de89a\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") "
Jun 06 05:29:05.892538 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.892376    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hk8k\" (UniqueName: \"kubernetes.io/projected/af3e11da-511a-4803-8728-03202e8de89a-kube-api-access-2hk8k\") pod \"af3e11da-511a-4803-8728-03202e8de89a\" (UID: \"af3e11da-511a-4803-8728-03202e8de89a\") "
Jun 06 05:29:05.894497 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.894462    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3e11da-511a-4803-8728-03202e8de89a-kube-api-access-2hk8k" (OuterVolumeSpecName: "kube-api-access-2hk8k") pod "af3e11da-511a-4803-8728-03202e8de89a" (UID: "af3e11da-511a-4803-8728-03202e8de89a"). InnerVolumeSpecName "kube-api-access-2hk8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:29:05.894610 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.894502    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3741b98b-7a8a-4196-9d5d-88a41d8a9da2-kube-api-access-gc7sm" (OuterVolumeSpecName: "kube-api-access-gc7sm") pod "3741b98b-7a8a-4196-9d5d-88a41d8a9da2" (UID: "3741b98b-7a8a-4196-9d5d-88a41d8a9da2"). InnerVolumeSpecName "kube-api-access-gc7sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:29:05.921305 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.921277    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3e11da-511a-4803-8728-03202e8de89a-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "af3e11da-511a-4803-8728-03202e8de89a" (UID: "af3e11da-511a-4803-8728-03202e8de89a"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:29:05.993386 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.993355    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc7sm\" (UniqueName: \"kubernetes.io/projected/3741b98b-7a8a-4196-9d5d-88a41d8a9da2-kube-api-access-gc7sm\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:29:05.993386 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.993383    2568 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/af3e11da-511a-4803-8728-03202e8de89a-postgresdata\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:29:05.993504 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:05.993395    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hk8k\" (UniqueName: \"kubernetes.io/projected/af3e11da-511a-4803-8728-03202e8de89a-kube-api-access-2hk8k\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:29:06.548308 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.548277    2568 generic.go:356] "Generic (PLEG): container finished" podID="3741b98b-7a8a-4196-9d5d-88a41d8a9da2" containerID="0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7" exitCode=0
Jun 06 05:29:06.549536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.548350    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k" event={"ID":"3741b98b-7a8a-4196-9d5d-88a41d8a9da2","Type":"ContainerDied","Data":"0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7"}
Jun 06 05:29:06.549536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.548323    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k"
Jun 06 05:29:06.549536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.548938    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-cks7k" event={"ID":"3741b98b-7a8a-4196-9d5d-88a41d8a9da2","Type":"ContainerDied","Data":"3b59ccaf49b0d978e45c37e2df17ee2c4a08c1530acc515e461c43994fd3e809"}
Jun 06 05:29:06.549536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.548992    2568 scope.go:117] "RemoveContainer" containerID="0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7"
Jun 06 05:29:06.554532 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.554474    2568 generic.go:356] "Generic (PLEG): container finished" podID="af3e11da-511a-4803-8728-03202e8de89a" containerID="28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8" exitCode=0
Jun 06 05:29:06.554532 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.554512    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq" event={"ID":"af3e11da-511a-4803-8728-03202e8de89a","Type":"ContainerDied","Data":"28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8"}
Jun 06 05:29:06.555002 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.554543    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq" event={"ID":"af3e11da-511a-4803-8728-03202e8de89a","Type":"ContainerDied","Data":"35133e7b78edaf3ca690008f99a483c9123aebccc89f2f05089fd9eba304c132"}
Jun 06 05:29:06.555002 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.554568    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-tsjbq"
Jun 06 05:29:06.561755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.561736    2568 scope.go:117] "RemoveContainer" containerID="0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7"
Jun 06 05:29:06.562015 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:29:06.561997    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7\": container with ID starting with 0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7 not found: ID does not exist" containerID="0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7"
Jun 06 05:29:06.562058 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.562023    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7"} err="failed to get container status \"0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7\": rpc error: code = NotFound desc = could not find container \"0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7\": container with ID starting with 0d9d398ee22c2a39b9a1471294756e0e8576fb2c83bfd521e20a2480dd8148b7 not found: ID does not exist"
Jun 06 05:29:06.562058 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.562039    2568 scope.go:117] "RemoveContainer" containerID="28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8"
Jun 06 05:29:06.567800 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.567780    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-cks7k"]
Jun 06 05:29:06.569223 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.569208    2568 scope.go:117] "RemoveContainer" containerID="28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8"
Jun 06 05:29:06.569539 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:29:06.569519    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8\": container with ID starting with 28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8 not found: ID does not exist" containerID="28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8"
Jun 06 05:29:06.569636 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.569546    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8"} err="failed to get container status \"28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8\": rpc error: code = NotFound desc = could not find container \"28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8\": container with ID starting with 28e0ec9fdf4a2f9c0b78d2f8f03b60aabfb728a01afd233a604d546645d228c8 not found: ID does not exist"
Jun 06 05:29:06.570891 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.570872    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-cks7k"]
Jun 06 05:29:06.579009 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.578990    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-tsjbq"]
Jun 06 05:29:06.584515 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:06.584493    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-tsjbq"]
Jun 06 05:29:08.369121 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:08.369087    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3741b98b-7a8a-4196-9d5d-88a41d8a9da2" path="/var/lib/kubelet/pods/3741b98b-7a8a-4196-9d5d-88a41d8a9da2/volumes"
Jun 06 05:29:08.369532 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:08.369423    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af3e11da-511a-4803-8728-03202e8de89a" path="/var/lib/kubelet/pods/af3e11da-511a-4803-8728-03202e8de89a/volumes"
Jun 06 05:29:13.294453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.294421    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"]
Jun 06 05:29:13.294881 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.294681    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3741b98b-7a8a-4196-9d5d-88a41d8a9da2" containerName="redis"
Jun 06 05:29:13.294881 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.294692    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3741b98b-7a8a-4196-9d5d-88a41d8a9da2" containerName="redis"
Jun 06 05:29:13.294881 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.294707    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3e11da-511a-4803-8728-03202e8de89a" containerName="postgres"
Jun 06 05:29:13.294881 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.294713    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3e11da-511a-4803-8728-03202e8de89a" containerName="postgres"
Jun 06 05:29:13.294881 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.294759    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3e11da-511a-4803-8728-03202e8de89a" containerName="postgres"
Jun 06 05:29:13.294881 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.294767    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3741b98b-7a8a-4196-9d5d-88a41d8a9da2" containerName="redis"
Jun 06 05:29:13.297747 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.297731    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:29:13.299529 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.299512    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 06 05:29:13.300002 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.299984    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-zzx9b\""
Jun 06 05:29:13.300071 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.299986    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 06 05:29:13.311010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.310988    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"]
Jun 06 05:29:13.344362 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.344329    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnw82\" (UniqueName: \"kubernetes.io/projected/18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37-kube-api-access-wnw82\") pod \"feast-operator-controller-manager-6d54c7db9d-rlzcp\" (UID: \"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:29:13.444945 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.444918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnw82\" (UniqueName: \"kubernetes.io/projected/18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37-kube-api-access-wnw82\") pod \"feast-operator-controller-manager-6d54c7db9d-rlzcp\" (UID: \"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:29:13.460244 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.460204    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnw82\" (UniqueName: \"kubernetes.io/projected/18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37-kube-api-access-wnw82\") pod \"feast-operator-controller-manager-6d54c7db9d-rlzcp\" (UID: \"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:29:13.607644 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.607553    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:29:13.731825 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.731734    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"]
Jun 06 05:29:13.734372 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:29:13.734344    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b7fe66_15e9_42b3_8c2e_22a0bdf1eb37.slice/crio-9160edb90c9f18594366cba10087ad4f229be981790a073fa11f5ce80fccca29 WatchSource:0}: Error finding container 9160edb90c9f18594366cba10087ad4f229be981790a073fa11f5ce80fccca29: Status 404 returned error can't find the container with id 9160edb90c9f18594366cba10087ad4f229be981790a073fa11f5ce80fccca29
Jun 06 05:29:13.742755 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:13.742732    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:29:14.587735 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:14.587693    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp" event={"ID":"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37","Type":"ContainerStarted","Data":"9160edb90c9f18594366cba10087ad4f229be981790a073fa11f5ce80fccca29"}
Jun 06 05:29:17.599437 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:17.599400    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp" event={"ID":"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37","Type":"ContainerStarted","Data":"7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729"}
Jun 06 05:29:17.599929 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:17.599519    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:29:17.613519 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:17.613477    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp" podStartSLOduration=1.7951244389999998 podStartE2EDuration="4.613463527s" totalImagesPullingTime="2.818339088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:29:17.61295423 +0000 UTC m=+1219.660819919" watchObservedRunningTime="2026-06-06 05:29:17.613463527 +0000 UTC m=+1219.661329194"
Jun 06 05:29:28.604989 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:28.604954    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:29:29.954195 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.954158    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"]
Jun 06 05:29:29.957718 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.957701    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:29.959644 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.959618    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 06 05:29:29.959644 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.959634    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-vbjm7\""
Jun 06 05:29:29.959833 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.959618    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 06 05:29:29.959918 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.959904    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 06 05:29:29.959977 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.959960    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 06 05:29:29.960031 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.959967    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 06 05:29:29.960078 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.960063    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 06 05:29:29.968412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:29.968388    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"]
Jun 06 05:29:30.063276 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.063237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.063462 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.063315    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dshfc\" (UniqueName: \"kubernetes.io/projected/fc164570-80f4-48ec-9584-33cf9d162214-kube-api-access-dshfc\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.063462 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.063342    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.063462 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.063363    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.063462 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.063412    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fc164570-80f4-48ec-9584-33cf9d162214-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.063624 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.063475    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.163896 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.163860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dshfc\" (UniqueName: \"kubernetes.io/projected/fc164570-80f4-48ec-9584-33cf9d162214-kube-api-access-dshfc\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.163896 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.163894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.164161 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.163912    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.164161 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.163928    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fc164570-80f4-48ec-9584-33cf9d162214-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.164161 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.163961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.164161 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.163986    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.164455 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.164378    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fc164570-80f4-48ec-9584-33cf9d162214-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.166562 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.166536    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.166684 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.166639    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.166877 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.166861    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.166998 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.166979    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.171144 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.171119    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dshfc\" (UniqueName: \"kubernetes.io/projected/fc164570-80f4-48ec-9584-33cf9d162214-kube-api-access-dshfc\") pod \"feast-simple-feast-setup-75c64c888b-krlbl\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.266997 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.266960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:29:30.394674 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.394631    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"]
Jun 06 05:29:30.650435 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:30.650355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerStarted","Data":"0bba973b2330e7ed2eaf14487c1408de7eb67c7de51f01549dc0f6187867d269"}
Jun 06 05:29:45.723712 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:45.723591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerStarted","Data":"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"}
Jun 06 05:29:50.743671 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:50.743629    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc164570-80f4-48ec-9584-33cf9d162214" containerID="53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19" exitCode=0
Jun 06 05:29:50.744133 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:50.743699    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerDied","Data":"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"}
Jun 06 05:29:51.749894 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:51.749857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerStarted","Data":"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"}
Jun 06 05:29:56.771186 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:56.771150    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc164570-80f4-48ec-9584-33cf9d162214" containerID="86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562" exitCode=0
Jun 06 05:29:56.771565 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:56.771203    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerDied","Data":"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"}
Jun 06 05:29:57.781299 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:57.781260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerStarted","Data":"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"}
Jun 06 05:29:57.781889 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:57.781325    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerStarted","Data":"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"}
Jun 06 05:29:57.781889 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:57.781347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerStarted","Data":"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"}
Jun 06 05:29:57.781889 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:57.781365    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerStarted","Data":"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"}
Jun 06 05:29:57.803494 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:57.803425    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podStartSLOduration=13.91949541 podStartE2EDuration="28.803400863s" totalImagesPullingTime="14.883905453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:29:57.80150399 +0000 UTC m=+1259.849369661" watchObservedRunningTime="2026-06-06 05:29:57.803400863 +0000 UTC m=+1259.851266534"
Jun 06 05:29:58.413097 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:58.413050    2568 scope.go:117] "RemoveContainer" containerID="065b7c688fc54b645e2aa1978021c7d9eaba9b130cdc0ffc7fd8ff15539793cc"
Jun 06 05:29:58.423823 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:29:58.423782    2568 scope.go:117] "RemoveContainer" containerID="213caaf80ff2710884a66aeb1f528ad55f1e1bd18028972e5fa0b07ac88d4b23"
Jun 06 05:30:00.267103 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.267056    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.267627 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.267126    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.267627 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.267146    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.267627 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.267165    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.267627 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.267184    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.267627 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.267202    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.267913 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.267645    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.268109 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.268087    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:00.269673 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.269622    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 06 05:30:00.269793 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.269685    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
Jun 06 05:30:00.269793 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.269633    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
Jun 06 05:30:00.269988 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:00.269957    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 06 05:30:03.268598 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.268565    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:03.269091 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.268893    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:03.269308 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.269287    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:03.269380 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.269344    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:03.269440 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.269409    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:03.273233 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.273210    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:03.810864 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.810835    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:30:03.813483 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:30:03.813448    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:31:05.381131 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.381098    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"]
Jun 06 05:31:05.381714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.381390    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="registry" containerID="cri-o://b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d" gracePeriod=30
Jun 06 05:31:05.381714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.381453    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui" containerID="cri-o://3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa" gracePeriod=30
Jun 06 05:31:05.381714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.381457    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online" containerID="cri-o://be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15" gracePeriod=30
Jun 06 05:31:05.381714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.381436    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="offline" containerID="cri-o://1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976" gracePeriod=30
Jun 06 05:31:05.714841 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.714615    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"]
Jun 06 05:31:05.719112 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.719088    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.720993 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.720971    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tdqvx\""
Jun 06 05:31:05.729942 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.729911    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"]
Jun 06 05:31:05.768440 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.768400    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.768635 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.768453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gmng\" (UniqueName: \"kubernetes.io/projected/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-kube-api-access-9gmng\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.768635 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.768537    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.768635 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.768574    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.768635 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.768594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.768821 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.768703    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.869883 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.869854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.869978 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.869894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gmng\" (UniqueName: \"kubernetes.io/projected/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-kube-api-access-9gmng\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.869978 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.869922    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.870050 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:05.869991    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 06 05:31:05.870083 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:05.870059    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls podName:a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164 nodeName:}" failed. No retries permitted until 2026-06-06 05:31:06.370043723 +0000 UTC m=+1328.417909368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls") pod "feast-simple-feast-setup-75c64c888b-szlw5" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 06 05:31:05.870126 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:05.870116    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 06 05:31:05.870169 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.870154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.870207 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:05.870168    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls podName:a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164 nodeName:}" failed. No retries permitted until 2026-06-06 05:31:06.370151385 +0000 UTC m=+1328.418017031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls") pod "feast-simple-feast-setup-75c64c888b-szlw5" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164") : secret "feast-simple-feast-setup-online-tls" not found
Jun 06 05:31:05.870207 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.870196    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.870288 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.870256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.870371 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:05.870358    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:31:05.870412 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:05.870405    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls podName:a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164 nodeName:}" failed. No retries permitted until 2026-06-06 05:31:06.370393017 +0000 UTC m=+1328.418258665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls") pod "feast-simple-feast-setup-75c64c888b-szlw5" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:31:05.870494 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.870476    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.872810 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.872790    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:05.877349 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:05.877327    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gmng\" (UniqueName: \"kubernetes.io/projected/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-kube-api-access-9gmng\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:06.051500 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:06.051465    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc164570-80f4-48ec-9584-33cf9d162214" containerID="3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa" exitCode=0
Jun 06 05:31:06.051680 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:06.051521    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerDied","Data":"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"}
Jun 06 05:31:06.380591 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:06.380484    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:06.380591 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:06.380571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:06.380853 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:06.380619    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:06.380853 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:06.380627    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:31:06.380853 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:06.380701    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls podName:a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164 nodeName:}" failed. No retries permitted until 2026-06-06 05:31:07.38068648 +0000 UTC m=+1329.428552127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls") pod "feast-simple-feast-setup-75c64c888b-szlw5" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:31:06.383009 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:06.382984    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:06.383308 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:06.383032    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:07.060419 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:07.060383    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc164570-80f4-48ec-9584-33cf9d162214" containerID="be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15" exitCode=0
Jun 06 05:31:07.060599 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:07.060440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerDied","Data":"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"}
Jun 06 05:31:07.388867 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:07.388774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:07.391263 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:07.391235    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-szlw5\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:07.530266 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:07.530206    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:07.662631 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:07.662604    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"]
Jun 06 05:31:07.664940 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:31:07.664913    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0dfcf10_50d3_4c4e_9df4_a9c6f1cbb164.slice/crio-62cecc3367c55785be1617a1b852d8855ca167fb3460c72a255bcb7100913fd8 WatchSource:0}: Error finding container 62cecc3367c55785be1617a1b852d8855ca167fb3460c72a255bcb7100913fd8: Status 404 returned error can't find the container with id 62cecc3367c55785be1617a1b852d8855ca167fb3460c72a255bcb7100913fd8
Jun 06 05:31:08.065951 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:08.065915    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerStarted","Data":"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"}
Jun 06 05:31:08.066122 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:08.065962    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerStarted","Data":"62cecc3367c55785be1617a1b852d8855ca167fb3460c72a255bcb7100913fd8"}
Jun 06 05:31:13.084783 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:13.084747    2568 generic.go:356] "Generic (PLEG): container finished" podID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerID="68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512" exitCode=0
Jun 06 05:31:13.085149 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:13.084816    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerDied","Data":"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"}
Jun 06 05:31:13.269727 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:13.269644    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 06 05:31:13.811028 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:13.810980    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 06 05:31:14.090560 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:14.090453    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerStarted","Data":"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"}
Jun 06 05:31:19.112811 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:19.112772    2568 generic.go:356] "Generic (PLEG): container finished" podID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerID="7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446" exitCode=0
Jun 06 05:31:19.113212 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:19.112848    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerDied","Data":"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"}
Jun 06 05:31:20.122858 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:20.122817    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerStarted","Data":"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"}
Jun 06 05:31:20.123348 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:20.122883    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerStarted","Data":"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"}
Jun 06 05:31:20.123348 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:20.122906    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerStarted","Data":"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"}
Jun 06 05:31:20.123348 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:20.122925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerStarted","Data":"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"}
Jun 06 05:31:20.144389 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:20.144327    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podStartSLOduration=15.144304443 podStartE2EDuration="15.144304443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:31:20.143559723 +0000 UTC m=+1342.191425425" watchObservedRunningTime="2026-06-06 05:31:20.144304443 +0000 UTC m=+1342.192170173"
Jun 06 05:31:22.531087 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.531043    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:22.531571 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.531112    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:22.531571 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.531131    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:22.531571 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.531151    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:22.533033 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.532997    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused"
Jun 06 05:31:22.533304 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.533027    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 06 05:31:22.533439 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.533036    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 06 05:31:22.533439 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:22.533065    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
Jun 06 05:31:23.269576 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:23.269520    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 06 05:31:23.811814 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:23.811762    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 06 05:31:25.531231 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.531197    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:25.531714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.531421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:25.531714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.531531    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:25.531714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.531708    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:25.531883 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.531735    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:25.531883 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.531800    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:25.532027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.532002    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:25.535904 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:25.535879    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:26.151495 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:26.151461    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:26.151708 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:26.151515    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:26.152069 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:26.152051    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:26.154476 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:26.154456    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:31:33.269132 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:33.269087    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 06 05:31:33.269579 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:33.269225    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:31:33.811288 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:33.811243    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jun 06 05:31:33.811465 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:33.811396    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:31:36.026168 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.026146    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:31:36.129719 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.129677    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-registry-tls\") pod \"fc164570-80f4-48ec-9584-33cf9d162214\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") "
Jun 06 05:31:36.129719 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.129719    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fc164570-80f4-48ec-9584-33cf9d162214-feast-data\") pod \"fc164570-80f4-48ec-9584-33cf9d162214\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") "
Jun 06 05:31:36.129991 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.129766    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dshfc\" (UniqueName: \"kubernetes.io/projected/fc164570-80f4-48ec-9584-33cf9d162214-kube-api-access-dshfc\") pod \"fc164570-80f4-48ec-9584-33cf9d162214\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") "
Jun 06 05:31:36.129991 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.129794    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-offline-tls\") pod \"fc164570-80f4-48ec-9584-33cf9d162214\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") "
Jun 06 05:31:36.129991 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.129871    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-online-tls\") pod \"fc164570-80f4-48ec-9584-33cf9d162214\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") "
Jun 06 05:31:36.129991 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.129894    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-ui-tls\") pod \"fc164570-80f4-48ec-9584-33cf9d162214\" (UID: \"fc164570-80f4-48ec-9584-33cf9d162214\") "
Jun 06 05:31:36.130331 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.130301    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc164570-80f4-48ec-9584-33cf9d162214-feast-data" (OuterVolumeSpecName: "feast-data") pod "fc164570-80f4-48ec-9584-33cf9d162214" (UID: "fc164570-80f4-48ec-9584-33cf9d162214"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:31:36.132132 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.132091    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "fc164570-80f4-48ec-9584-33cf9d162214" (UID: "fc164570-80f4-48ec-9584-33cf9d162214"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:31:36.132303 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.132286    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fc164570-80f4-48ec-9584-33cf9d162214" (UID: "fc164570-80f4-48ec-9584-33cf9d162214"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:31:36.132444 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.132413    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-online-tls" (OuterVolumeSpecName: "online-tls") pod "fc164570-80f4-48ec-9584-33cf9d162214" (UID: "fc164570-80f4-48ec-9584-33cf9d162214"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:31:36.132504 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.132423    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "fc164570-80f4-48ec-9584-33cf9d162214" (UID: "fc164570-80f4-48ec-9584-33cf9d162214"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:31:36.132576 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.132552    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc164570-80f4-48ec-9584-33cf9d162214-kube-api-access-dshfc" (OuterVolumeSpecName: "kube-api-access-dshfc") pod "fc164570-80f4-48ec-9584-33cf9d162214" (UID: "fc164570-80f4-48ec-9584-33cf9d162214"). InnerVolumeSpecName "kube-api-access-dshfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:31:36.189727 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.189614    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc164570-80f4-48ec-9584-33cf9d162214" containerID="1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976" exitCode=137
Jun 06 05:31:36.189727 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.189643    2568 generic.go:356] "Generic (PLEG): container finished" podID="fc164570-80f4-48ec-9584-33cf9d162214" containerID="b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d" exitCode=137
Jun 06 05:31:36.189727 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.189697    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerDied","Data":"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"}
Jun 06 05:31:36.189727 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.189714    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"
Jun 06 05:31:36.189979 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.189744    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerDied","Data":"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"}
Jun 06 05:31:36.189979 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.189760    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl" event={"ID":"fc164570-80f4-48ec-9584-33cf9d162214","Type":"ContainerDied","Data":"0bba973b2330e7ed2eaf14487c1408de7eb67c7de51f01549dc0f6187867d269"}
Jun 06 05:31:36.189979 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.189780    2568 scope.go:117] "RemoveContainer" containerID="3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"
Jun 06 05:31:36.198531 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.198514    2568 scope.go:117] "RemoveContainer" containerID="1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"
Jun 06 05:31:36.205630 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.205613    2568 scope.go:117] "RemoveContainer" containerID="be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"
Jun 06 05:31:36.210845 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.210825    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"]
Jun 06 05:31:36.213560 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.213541    2568 scope.go:117] "RemoveContainer" containerID="b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"
Jun 06 05:31:36.214091 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.214070    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-krlbl"]
Jun 06 05:31:36.220491 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.220475    2568 scope.go:117] "RemoveContainer" containerID="86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"
Jun 06 05:31:36.227253 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.227234    2568 scope.go:117] "RemoveContainer" containerID="53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"
Jun 06 05:31:36.230545 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.230528    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-offline-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:31:36.230545 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.230546    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-online-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:31:36.230684 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.230554    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-ui-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:31:36.230684 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.230561    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fc164570-80f4-48ec-9584-33cf9d162214-registry-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:31:36.230684 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.230570    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fc164570-80f4-48ec-9584-33cf9d162214-feast-data\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:31:36.230684 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.230578    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dshfc\" (UniqueName: \"kubernetes.io/projected/fc164570-80f4-48ec-9584-33cf9d162214-kube-api-access-dshfc\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:31:36.234148 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.234130    2568 scope.go:117] "RemoveContainer" containerID="3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"
Jun 06 05:31:36.234406 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:36.234391    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa\": container with ID starting with 3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa not found: ID does not exist" containerID="3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"
Jun 06 05:31:36.234445 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.234414    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"} err="failed to get container status \"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa\": rpc error: code = NotFound desc = could not find container \"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa\": container with ID starting with 3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa not found: ID does not exist"
Jun 06 05:31:36.234445 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.234433    2568 scope.go:117] "RemoveContainer" containerID="1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"
Jun 06 05:31:36.234682 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:36.234647    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976\": container with ID starting with 1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976 not found: ID does not exist" containerID="1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"
Jun 06 05:31:36.234717 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.234692    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"} err="failed to get container status \"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976\": rpc error: code = NotFound desc = could not find container \"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976\": container with ID starting with 1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976 not found: ID does not exist"
Jun 06 05:31:36.234717 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.234709    2568 scope.go:117] "RemoveContainer" containerID="be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"
Jun 06 05:31:36.234928 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:36.234912    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15\": container with ID starting with be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15 not found: ID does not exist" containerID="be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"
Jun 06 05:31:36.234969 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.234932    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"} err="failed to get container status \"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15\": rpc error: code = NotFound desc = could not find container \"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15\": container with ID starting with be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15 not found: ID does not exist"
Jun 06 05:31:36.234969 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.234946    2568 scope.go:117] "RemoveContainer" containerID="b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"
Jun 06 05:31:36.235159 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:36.235142    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d\": container with ID starting with b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d not found: ID does not exist" containerID="b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"
Jun 06 05:31:36.235234 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235167    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"} err="failed to get container status \"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d\": rpc error: code = NotFound desc = could not find container \"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d\": container with ID starting with b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d not found: ID does not exist"
Jun 06 05:31:36.235234 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235188    2568 scope.go:117] "RemoveContainer" containerID="86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"
Jun 06 05:31:36.235436 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:36.235420    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562\": container with ID starting with 86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562 not found: ID does not exist" containerID="86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"
Jun 06 05:31:36.235472 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235440    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"} err="failed to get container status \"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562\": rpc error: code = NotFound desc = could not find container \"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562\": container with ID starting with 86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562 not found: ID does not exist"
Jun 06 05:31:36.235472 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235453    2568 scope.go:117] "RemoveContainer" containerID="53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"
Jun 06 05:31:36.235693 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:31:36.235672    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19\": container with ID starting with 53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19 not found: ID does not exist" containerID="53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"
Jun 06 05:31:36.235749 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235699    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"} err="failed to get container status \"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19\": rpc error: code = NotFound desc = could not find container \"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19\": container with ID starting with 53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19 not found: ID does not exist"
Jun 06 05:31:36.235749 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235718    2568 scope.go:117] "RemoveContainer" containerID="3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"
Jun 06 05:31:36.235998 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235974    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa"} err="failed to get container status \"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa\": rpc error: code = NotFound desc = could not find container \"3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa\": container with ID starting with 3c8b71ccd8f56434feb70fc133a2590cd44b3b1aca5b8cd820466e56117c59fa not found: ID does not exist"
Jun 06 05:31:36.235998 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.235997    2568 scope.go:117] "RemoveContainer" containerID="1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"
Jun 06 05:31:36.236234 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236216    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976"} err="failed to get container status \"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976\": rpc error: code = NotFound desc = could not find container \"1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976\": container with ID starting with 1dd33ac90280f58809b3c773c14ac3285d55067033e69873ceec708b3e714976 not found: ID does not exist"
Jun 06 05:31:36.236300 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236236    2568 scope.go:117] "RemoveContainer" containerID="be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"
Jun 06 05:31:36.236455 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236434    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15"} err="failed to get container status \"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15\": rpc error: code = NotFound desc = could not find container \"be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15\": container with ID starting with be337396518932903cb5ec7b9a120dff67a98398d01f97e29447324c2c42ef15 not found: ID does not exist"
Jun 06 05:31:36.236502 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236456    2568 scope.go:117] "RemoveContainer" containerID="b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"
Jun 06 05:31:36.236650 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236633    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d"} err="failed to get container status \"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d\": rpc error: code = NotFound desc = could not find container \"b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d\": container with ID starting with b3108f57152bf0b2b31aeb4bb07b3d6092ca53df4b780b2606f466d906f63f3d not found: ID does not exist"
Jun 06 05:31:36.236650 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236650    2568 scope.go:117] "RemoveContainer" containerID="86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"
Jun 06 05:31:36.236853 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236838    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562"} err="failed to get container status \"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562\": rpc error: code = NotFound desc = could not find container \"86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562\": container with ID starting with 86d55a648d3bef6bfe919c5f519a794eeea8f77b4adb0b788536dd3398d42562 not found: ID does not exist"
Jun 06 05:31:36.236897 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.236855    2568 scope.go:117] "RemoveContainer" containerID="53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"
Jun 06 05:31:36.237074 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.237056    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19"} err="failed to get container status \"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19\": rpc error: code = NotFound desc = could not find container \"53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19\": container with ID starting with 53cf85d96785c9a45a7f6b99c86db28477009e2d328b75e9cadfad1776940d19 not found: ID does not exist"
Jun 06 05:31:36.369812 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:31:36.369782    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc164570-80f4-48ec-9584-33cf9d162214" path="/var/lib/kubelet/pods/fc164570-80f4-48ec-9584-33cf9d162214/volumes"
Jun 06 05:32:29.400142 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400106    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"]
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400363    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="registry"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400374    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="registry"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400385    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="offline"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400391    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="offline"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400399    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="feast-init"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400405    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="feast-init"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400418    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400423    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400429    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="feast-apply"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400434    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="feast-apply"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400440    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400445    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400493    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="registry"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400501    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="offline"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400507    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="online"
Jun 06 05:32:29.400622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.400512    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc164570-80f4-48ec-9584-33cf9d162214" containerName="ui"
Jun 06 05:32:29.403781 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.403758    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.405752 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.405726    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 06 05:32:29.405865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.405770    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 06 05:32:29.405865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.405796    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-k6qkc\""
Jun 06 05:32:29.405865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.405798    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 06 05:32:29.405865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.405829    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 06 05:32:29.405865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.405859    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 06 05:32:29.406068 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.405736    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 06 05:32:29.412835 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.412814    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"]
Jun 06 05:32:29.524195 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.524162    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad0d87-54a7-4d17-8d05-d3b086b5b405-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.524405 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.524215    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.524405 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.524267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/73ad0d87-54a7-4d17-8d05-d3b086b5b405-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.524405 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.524317    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.524405 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.524347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.524556 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.524418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkhg2\" (UniqueName: \"kubernetes.io/projected/73ad0d87-54a7-4d17-8d05-d3b086b5b405-kube-api-access-pkhg2\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.625703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.625649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/73ad0d87-54a7-4d17-8d05-d3b086b5b405-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.625703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.625709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.625940 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.625727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.625940 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.625760    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkhg2\" (UniqueName: \"kubernetes.io/projected/73ad0d87-54a7-4d17-8d05-d3b086b5b405-kube-api-access-pkhg2\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.625940 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.625784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad0d87-54a7-4d17-8d05-d3b086b5b405-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.626103 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.625937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.626304 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.626276    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad0d87-54a7-4d17-8d05-d3b086b5b405-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.626497 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.626473    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/73ad0d87-54a7-4d17-8d05-d3b086b5b405-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.628217 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.628195    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.628396 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.628376    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.628437 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.628395    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.632897 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.632876    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkhg2\" (UniqueName: \"kubernetes.io/projected/73ad0d87-54a7-4d17-8d05-d3b086b5b405-kube-api-access-pkhg2\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ztxmw\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.713079 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.712988    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:29.847117 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:29.847089    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"]
Jun 06 05:32:29.849748 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:32:29.849719    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73ad0d87_54a7_4d17_8d05_d3b086b5b405.slice/crio-8229e9e827f62bed235799929171deec242650a0dd90bcac03e8f694f3694b7e WatchSource:0}: Error finding container 8229e9e827f62bed235799929171deec242650a0dd90bcac03e8f694f3694b7e: Status 404 returned error can't find the container with id 8229e9e827f62bed235799929171deec242650a0dd90bcac03e8f694f3694b7e
Jun 06 05:32:30.384433 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:30.384397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerStarted","Data":"dc3a3d8dec3ce68236b3748817fb4a258295723a0cf35d701251ee0913fd1c90"}
Jun 06 05:32:30.384616 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:30.384443    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerStarted","Data":"8229e9e827f62bed235799929171deec242650a0dd90bcac03e8f694f3694b7e"}
Jun 06 05:32:35.406734 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:35.406700    2568 generic.go:356] "Generic (PLEG): container finished" podID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerID="dc3a3d8dec3ce68236b3748817fb4a258295723a0cf35d701251ee0913fd1c90" exitCode=0
Jun 06 05:32:35.407240 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:35.406739    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerDied","Data":"dc3a3d8dec3ce68236b3748817fb4a258295723a0cf35d701251ee0913fd1c90"}
Jun 06 05:32:36.412626 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:36.412584    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerStarted","Data":"3563eda8d8aec92514262a875c490ee4dd2f678c98097b11c2fc5de4853e3c83"}
Jun 06 05:32:41.434511 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:41.434476    2568 generic.go:356] "Generic (PLEG): container finished" podID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerID="3563eda8d8aec92514262a875c490ee4dd2f678c98097b11c2fc5de4853e3c83" exitCode=0
Jun 06 05:32:41.434511 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:41.434514    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerDied","Data":"3563eda8d8aec92514262a875c490ee4dd2f678c98097b11c2fc5de4853e3c83"}
Jun 06 05:32:42.442624 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:42.442582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerStarted","Data":"825531f28ee5ddb3f839f43a2e2acc5864500aeeb7dc6478cceaaf1a27942d47"}
Jun 06 05:32:42.443141 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:42.442639    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerStarted","Data":"50fa69ce449d48013c3643e39f75c940057a509470a76964e04e4af101d6a42f"}
Jun 06 05:32:42.443141 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:42.442667    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerStarted","Data":"8814b481a7a4a13df71894cb6d5cbab5d17d5b155c72a0467a51267ee14e0ba5"}
Jun 06 05:32:42.463078 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:42.463012    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podStartSLOduration=13.462986465 podStartE2EDuration="13.462986465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:32:42.461622541 +0000 UTC m=+1424.509488208" watchObservedRunningTime="2026-06-06 05:32:42.462986465 +0000 UTC m=+1424.510852136"
Jun 06 05:32:44.713500 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:44.713457    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:44.714024 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:44.713526    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:44.714024 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:44.713543    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:44.715508 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:44.715474    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 06 05:32:44.715622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:44.715532    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 06 05:32:44.715622 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:44.715476    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Jun 06 05:32:47.714698 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:47.714650    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:47.715184 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:47.714845    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:47.715249 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:47.715199    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:47.715249 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:47.715241    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:47.715584 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:47.715566    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:47.715691 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:47.715678    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:47.718770 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:47.718750    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:48.469273 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:48.469242    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:32:48.472159 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:32:48.472134    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:33:50.695286 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.695248    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"]
Jun 06 05:33:50.695905 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.695468    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online" containerID="cri-o://8814b481a7a4a13df71894cb6d5cbab5d17d5b155c72a0467a51267ee14e0ba5" gracePeriod=30
Jun 06 05:33:50.695905 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.695512    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="offline" containerID="cri-o://50fa69ce449d48013c3643e39f75c940057a509470a76964e04e4af101d6a42f" gracePeriod=30
Jun 06 05:33:50.695905 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.695547    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui" containerID="cri-o://825531f28ee5ddb3f839f43a2e2acc5864500aeeb7dc6478cceaaf1a27942d47" gracePeriod=30
Jun 06 05:33:50.837061 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.837032    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"]
Jun 06 05:33:50.837294 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.837261    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="registry" containerID="cri-o://66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843" gracePeriod=30
Jun 06 05:33:50.837526 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.837308    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="offline" containerID="cri-o://64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c" gracePeriod=30
Jun 06 05:33:50.837651 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.837330    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online" containerID="cri-o://052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955" gracePeriod=30
Jun 06 05:33:50.837651 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:50.837339    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui" containerID="cri-o://0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150" gracePeriod=30
Jun 06 05:33:51.713725 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.713683    2568 generic.go:356] "Generic (PLEG): container finished" podID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerID="825531f28ee5ddb3f839f43a2e2acc5864500aeeb7dc6478cceaaf1a27942d47" exitCode=0
Jun 06 05:33:51.713725 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.713713    2568 generic.go:356] "Generic (PLEG): container finished" podID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerID="8814b481a7a4a13df71894cb6d5cbab5d17d5b155c72a0467a51267ee14e0ba5" exitCode=0
Jun 06 05:33:51.714198 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.713744    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerDied","Data":"825531f28ee5ddb3f839f43a2e2acc5864500aeeb7dc6478cceaaf1a27942d47"}
Jun 06 05:33:51.714198 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.713784    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerDied","Data":"8814b481a7a4a13df71894cb6d5cbab5d17d5b155c72a0467a51267ee14e0ba5"}
Jun 06 05:33:51.716558 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.716534    2568 generic.go:356] "Generic (PLEG): container finished" podID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerID="0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150" exitCode=0
Jun 06 05:33:51.716558 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.716552    2568 generic.go:356] "Generic (PLEG): container finished" podID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerID="052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955" exitCode=0
Jun 06 05:33:51.716721 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.716591    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerDied","Data":"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"}
Jun 06 05:33:51.716721 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:51.716617    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerDied","Data":"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"}
Jun 06 05:33:55.532326 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:55.532285    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 06 05:33:56.152510 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:56.152465    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 06 05:33:57.716147 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:57.716105    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 06 05:33:58.399781 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:58.399752    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:33:58.401127 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:58.401105    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:33:58.405908 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:58.405883    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:33:58.407398 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:58.407376    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:33:58.469831 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:33:58.469790    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 06 05:34:05.532026 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:05.531987    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 06 05:34:06.152462 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:06.152420    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 06 05:34:07.715428 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:07.715373    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 06 05:34:08.470242 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:08.470200    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 06 05:34:15.532503 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:15.532448    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jun 06 05:34:15.532918 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:15.532610    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:34:16.152566 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:16.152523    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jun 06 05:34:16.152788 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:16.152680    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:34:17.715571 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:17.715522    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 06 05:34:17.716041 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:17.715700    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:34:18.469518 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:18.469478    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 06 05:34:18.469728 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:18.469580    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:34:20.836099 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:20.836067    2568 generic.go:356] "Generic (PLEG): container finished" podID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerID="50fa69ce449d48013c3643e39f75c940057a509470a76964e04e4af101d6a42f" exitCode=137
Jun 06 05:34:20.836479 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:20.836137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerDied","Data":"50fa69ce449d48013c3643e39f75c940057a509470a76964e04e4af101d6a42f"}
Jun 06 05:34:21.347541 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.347516    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:34:21.409255 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409220    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/73ad0d87-54a7-4d17-8d05-d3b086b5b405-registry-tls\") pod \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") "
Jun 06 05:34:21.409443 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409269    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad0d87-54a7-4d17-8d05-d3b086b5b405-feast-data\") pod \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") "
Jun 06 05:34:21.409443 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409297    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-offline-tls\") pod \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") "
Jun 06 05:34:21.409443 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409316    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-ui-tls\") pod \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") "
Jun 06 05:34:21.409443 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409361    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkhg2\" (UniqueName: \"kubernetes.io/projected/73ad0d87-54a7-4d17-8d05-d3b086b5b405-kube-api-access-pkhg2\") pod \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") "
Jun 06 05:34:21.409443 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409387    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-online-tls\") pod \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\" (UID: \"73ad0d87-54a7-4d17-8d05-d3b086b5b405\") "
Jun 06 05:34:21.409719 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409634    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ad0d87-54a7-4d17-8d05-d3b086b5b405-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "73ad0d87-54a7-4d17-8d05-d3b086b5b405" (UID: "73ad0d87-54a7-4d17-8d05-d3b086b5b405"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:34:21.410006 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.409981    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73ad0d87-54a7-4d17-8d05-d3b086b5b405-feast-data" (OuterVolumeSpecName: "feast-data") pod "73ad0d87-54a7-4d17-8d05-d3b086b5b405" (UID: "73ad0d87-54a7-4d17-8d05-d3b086b5b405"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:34:21.412289 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.411782    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-online-tls" (OuterVolumeSpecName: "online-tls") pod "73ad0d87-54a7-4d17-8d05-d3b086b5b405" (UID: "73ad0d87-54a7-4d17-8d05-d3b086b5b405"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:34:21.412289 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.412012    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "73ad0d87-54a7-4d17-8d05-d3b086b5b405" (UID: "73ad0d87-54a7-4d17-8d05-d3b086b5b405"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:34:21.412289 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.412083    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "73ad0d87-54a7-4d17-8d05-d3b086b5b405" (UID: "73ad0d87-54a7-4d17-8d05-d3b086b5b405"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:34:21.412471 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.412318    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ad0d87-54a7-4d17-8d05-d3b086b5b405-kube-api-access-pkhg2" (OuterVolumeSpecName: "kube-api-access-pkhg2") pod "73ad0d87-54a7-4d17-8d05-d3b086b5b405" (UID: "73ad0d87-54a7-4d17-8d05-d3b086b5b405"). InnerVolumeSpecName "kube-api-access-pkhg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:34:21.488075 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.488049    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:34:21.510674 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.510629    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gmng\" (UniqueName: \"kubernetes.io/projected/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-kube-api-access-9gmng\") pod \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") "
Jun 06 05:34:21.510838 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.510687    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls\") pod \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") "
Jun 06 05:34:21.510838 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.510749    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-feast-data\") pod \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") "
Jun 06 05:34:21.510838 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.510794    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls\") pod \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") "
Jun 06 05:34:21.510838 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.510816    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-ui-tls\") pod \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") "
Jun 06 05:34:21.511010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.510856    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls\") pod \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\" (UID: \"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164\") "
Jun 06 05:34:21.511067 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.511054    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/73ad0d87-54a7-4d17-8d05-d3b086b5b405-registry-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.511109 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.511070    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/73ad0d87-54a7-4d17-8d05-d3b086b5b405-feast-data\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.511109 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.511083    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-offline-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.511109 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.511095    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-ui-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.511213 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.511107    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkhg2\" (UniqueName: \"kubernetes.io/projected/73ad0d87-54a7-4d17-8d05-d3b086b5b405-kube-api-access-pkhg2\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.511213 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.511143    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/73ad0d87-54a7-4d17-8d05-d3b086b5b405-online-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.511398 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.511351    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-feast-data" (OuterVolumeSpecName: "feast-data") pod "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:34:21.513126 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.513096    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:34:21.513333 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.513303    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-kube-api-access-9gmng" (OuterVolumeSpecName: "kube-api-access-9gmng") pod "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164"). InnerVolumeSpecName "kube-api-access-9gmng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:34:21.513333 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.513320    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls" (OuterVolumeSpecName: "online-tls") pod "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:34:21.513460 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.513393    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:34:21.513460 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.513386    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" (UID: "a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:34:21.612047 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.612009    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-online-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.612047 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.612040    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-feast-data\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.612047 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.612050    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-offline-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.612047 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.612058    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-ui-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.612324 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.612066    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-registry-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.612324 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.612074    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gmng\" (UniqueName: \"kubernetes.io/projected/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164-kube-api-access-9gmng\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:21.842573 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.842538    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"
Jun 06 05:34:21.842573 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.842553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw" event={"ID":"73ad0d87-54a7-4d17-8d05-d3b086b5b405","Type":"ContainerDied","Data":"8229e9e827f62bed235799929171deec242650a0dd90bcac03e8f694f3694b7e"}
Jun 06 05:34:21.843203 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.842608    2568 scope.go:117] "RemoveContainer" containerID="825531f28ee5ddb3f839f43a2e2acc5864500aeeb7dc6478cceaaf1a27942d47"
Jun 06 05:34:21.845765 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.845736    2568 generic.go:356] "Generic (PLEG): container finished" podID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerID="64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c" exitCode=137
Jun 06 05:34:21.845765 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.845760    2568 generic.go:356] "Generic (PLEG): container finished" podID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerID="66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843" exitCode=137
Jun 06 05:34:21.845977 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.845815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerDied","Data":"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"}
Jun 06 05:34:21.845977 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.845830    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"
Jun 06 05:34:21.845977 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.845861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerDied","Data":"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"}
Jun 06 05:34:21.845977 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.845895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5" event={"ID":"a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164","Type":"ContainerDied","Data":"62cecc3367c55785be1617a1b852d8855ca167fb3460c72a255bcb7100913fd8"}
Jun 06 05:34:21.855163 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.853794    2568 scope.go:117] "RemoveContainer" containerID="50fa69ce449d48013c3643e39f75c940057a509470a76964e04e4af101d6a42f"
Jun 06 05:34:21.862706 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.862685    2568 scope.go:117] "RemoveContainer" containerID="8814b481a7a4a13df71894cb6d5cbab5d17d5b155c72a0467a51267ee14e0ba5"
Jun 06 05:34:21.867074 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.867051    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"]
Jun 06 05:34:21.871348 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.870959    2568 scope.go:117] "RemoveContainer" containerID="3563eda8d8aec92514262a875c490ee4dd2f678c98097b11c2fc5de4853e3c83"
Jun 06 05:34:21.872623 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.872596    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ztxmw"]
Jun 06 05:34:21.878457 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.878439    2568 scope.go:117] "RemoveContainer" containerID="dc3a3d8dec3ce68236b3748817fb4a258295723a0cf35d701251ee0913fd1c90"
Jun 06 05:34:21.881399 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.881378    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"]
Jun 06 05:34:21.886378 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.886358    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-szlw5"]
Jun 06 05:34:21.886440 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.886413    2568 scope.go:117] "RemoveContainer" containerID="0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"
Jun 06 05:34:21.893697 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.893675    2568 scope.go:117] "RemoveContainer" containerID="64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"
Jun 06 05:34:21.900495 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.900480    2568 scope.go:117] "RemoveContainer" containerID="052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"
Jun 06 05:34:21.907470 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.907453    2568 scope.go:117] "RemoveContainer" containerID="66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"
Jun 06 05:34:21.914451 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.914430    2568 scope.go:117] "RemoveContainer" containerID="7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"
Jun 06 05:34:21.921865 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.921842    2568 scope.go:117] "RemoveContainer" containerID="68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"
Jun 06 05:34:21.929053 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.929033    2568 scope.go:117] "RemoveContainer" containerID="0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"
Jun 06 05:34:21.929293 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:34:21.929276    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150\": container with ID starting with 0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150 not found: ID does not exist" containerID="0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"
Jun 06 05:34:21.929342 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.929302    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"} err="failed to get container status \"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150\": rpc error: code = NotFound desc = could not find container \"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150\": container with ID starting with 0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150 not found: ID does not exist"
Jun 06 05:34:21.929342 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.929319    2568 scope.go:117] "RemoveContainer" containerID="64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"
Jun 06 05:34:21.929538 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:34:21.929519    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c\": container with ID starting with 64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c not found: ID does not exist" containerID="64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"
Jun 06 05:34:21.929577 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.929549    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"} err="failed to get container status \"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c\": rpc error: code = NotFound desc = could not find container \"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c\": container with ID starting with 64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c not found: ID does not exist"
Jun 06 05:34:21.929577 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.929566    2568 scope.go:117] "RemoveContainer" containerID="052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"
Jun 06 05:34:21.929807 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:34:21.929791    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955\": container with ID starting with 052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955 not found: ID does not exist" containerID="052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"
Jun 06 05:34:21.929856 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.929812    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"} err="failed to get container status \"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955\": rpc error: code = NotFound desc = could not find container \"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955\": container with ID starting with 052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955 not found: ID does not exist"
Jun 06 05:34:21.929856 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.929826    2568 scope.go:117] "RemoveContainer" containerID="66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"
Jun 06 05:34:21.930010 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:34:21.929996    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843\": container with ID starting with 66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843 not found: ID does not exist" containerID="66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"
Jun 06 05:34:21.930048 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930013    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"} err="failed to get container status \"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843\": rpc error: code = NotFound desc = could not find container \"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843\": container with ID starting with 66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843 not found: ID does not exist"
Jun 06 05:34:21.930048 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930027    2568 scope.go:117] "RemoveContainer" containerID="7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"
Jun 06 05:34:21.930242 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:34:21.930222    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446\": container with ID starting with 7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446 not found: ID does not exist" containerID="7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"
Jun 06 05:34:21.930312 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930249    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"} err="failed to get container status \"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446\": rpc error: code = NotFound desc = could not find container \"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446\": container with ID starting with 7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446 not found: ID does not exist"
Jun 06 05:34:21.930312 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930269    2568 scope.go:117] "RemoveContainer" containerID="68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"
Jun 06 05:34:21.930517 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:34:21.930502    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512\": container with ID starting with 68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512 not found: ID does not exist" containerID="68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"
Jun 06 05:34:21.930551 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930520    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"} err="failed to get container status \"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512\": rpc error: code = NotFound desc = could not find container \"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512\": container with ID starting with 68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512 not found: ID does not exist"
Jun 06 05:34:21.930551 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930531    2568 scope.go:117] "RemoveContainer" containerID="0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"
Jun 06 05:34:21.930732 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930714    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150"} err="failed to get container status \"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150\": rpc error: code = NotFound desc = could not find container \"0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150\": container with ID starting with 0931ff0361cb8052750a2bacfff4ad5326e1046def65a386266d57e43dcf3150 not found: ID does not exist"
Jun 06 05:34:21.930809 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930734    2568 scope.go:117] "RemoveContainer" containerID="64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"
Jun 06 05:34:21.930921 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930905    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c"} err="failed to get container status \"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c\": rpc error: code = NotFound desc = could not find container \"64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c\": container with ID starting with 64b0a25cbed047a4c334438a60bf728dacff48fdec0b6301609ee03ba14a3a4c not found: ID does not exist"
Jun 06 05:34:21.930985 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.930922    2568 scope.go:117] "RemoveContainer" containerID="052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"
Jun 06 05:34:21.931173 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.931156    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955"} err="failed to get container status \"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955\": rpc error: code = NotFound desc = could not find container \"052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955\": container with ID starting with 052b0344b1b354cb12571ccb254e6b350ef14f66a6897611e3c4c50a86f55955 not found: ID does not exist"
Jun 06 05:34:21.931226 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.931174    2568 scope.go:117] "RemoveContainer" containerID="66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"
Jun 06 05:34:21.931415 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.931397    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843"} err="failed to get container status \"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843\": rpc error: code = NotFound desc = could not find container \"66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843\": container with ID starting with 66b4a0222265c67b179ee2c3596844db160a24e97a6c2152f125177180a41843 not found: ID does not exist"
Jun 06 05:34:21.931471 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.931417    2568 scope.go:117] "RemoveContainer" containerID="7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"
Jun 06 05:34:21.931614 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.931598    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446"} err="failed to get container status \"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446\": rpc error: code = NotFound desc = could not find container \"7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446\": container with ID starting with 7e50641dcf9c4c0398dd239d13abeb801c054cd19ce9c6e3be6f7a0837ad7446 not found: ID does not exist"
Jun 06 05:34:21.931678 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.931614    2568 scope.go:117] "RemoveContainer" containerID="68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"
Jun 06 05:34:21.931817 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:21.931801    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512"} err="failed to get container status \"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512\": rpc error: code = NotFound desc = could not find container \"68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512\": container with ID starting with 68c1454c32357c60affa586485fe2f167c73bdd4f94cd131afd2b0657371a512 not found: ID does not exist"
Jun 06 05:34:22.369640 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:22.369609    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" path="/var/lib/kubelet/pods/73ad0d87-54a7-4d17-8d05-d3b086b5b405/volumes"
Jun 06 05:34:22.370160 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:22.370147    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" path="/var/lib/kubelet/pods/a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164/volumes"
Jun 06 05:34:39.215723 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.215686    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"]
Jun 06 05:34:39.216251 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.215911    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp" podUID="18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37" containerName="manager" containerID="cri-o://7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729" gracePeriod=10
Jun 06 05:34:39.458765 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.458740    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:34:39.543616 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.543575    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnw82\" (UniqueName: \"kubernetes.io/projected/18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37-kube-api-access-wnw82\") pod \"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37\" (UID: \"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37\") "
Jun 06 05:34:39.545801 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.545768    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37-kube-api-access-wnw82" (OuterVolumeSpecName: "kube-api-access-wnw82") pod "18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37" (UID: "18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37"). InnerVolumeSpecName "kube-api-access-wnw82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:34:39.645029 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.644991    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnw82\" (UniqueName: \"kubernetes.io/projected/18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37-kube-api-access-wnw82\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:34:39.910369 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.910275    2568 generic.go:356] "Generic (PLEG): container finished" podID="18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37" containerID="7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729" exitCode=0
Jun 06 05:34:39.910369 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.910328    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"
Jun 06 05:34:39.910369 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.910340    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp" event={"ID":"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37","Type":"ContainerDied","Data":"7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729"}
Jun 06 05:34:39.910632 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.910382    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp" event={"ID":"18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37","Type":"ContainerDied","Data":"9160edb90c9f18594366cba10087ad4f229be981790a073fa11f5ce80fccca29"}
Jun 06 05:34:39.910632 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.910406    2568 scope.go:117] "RemoveContainer" containerID="7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729"
Jun 06 05:34:39.918519 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.918311    2568 scope.go:117] "RemoveContainer" containerID="7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729"
Jun 06 05:34:39.918758 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:34:39.918736    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729\": container with ID starting with 7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729 not found: ID does not exist" containerID="7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729"
Jun 06 05:34:39.918833 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.918767    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729"} err="failed to get container status \"7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729\": rpc error: code = NotFound desc = could not find container \"7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729\": container with ID starting with 7f4db3f7343a528a0e453bb4e07aca3a5ef9745276703b4d9fe93aba6e5fc729 not found: ID does not exist"
Jun 06 05:34:39.928844 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.928813    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"]
Jun 06 05:34:39.934273 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:39.934247    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rlzcp"]
Jun 06 05:34:40.370620 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:40.370580    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37" path="/var/lib/kubelet/pods/18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37/volumes"
Jun 06 05:34:43.430480 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430439    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"]
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430810    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="offline"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430827    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="offline"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430846    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="feast-init"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430854    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="feast-init"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430866    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430875    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430883    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="registry"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430891    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="registry"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430901    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="feast-apply"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430910    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="feast-apply"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430918    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="offline"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430926    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="offline"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430934    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="feast-apply"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430942    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="feast-apply"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430951    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430959    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430970    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37" containerName="manager"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430978    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37" containerName="manager"
Jun 06 05:34:43.430982 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430988    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.430995    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431007    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="feast-init"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431015    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="feast-init"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431028    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431036    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431104    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="ui"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431118    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="ui"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431130    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="online"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431138    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b7fe66-15e9-42b3-8c2e-22a0bdf1eb37" containerName="manager"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431150    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="registry"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431159    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="online"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431166    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0dfcf10-50d3-4c4e-9df4-a9c6f1cbb164" containerName="offline"
Jun 06 05:34:43.431875 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.431172    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ad0d87-54a7-4d17-8d05-d3b086b5b405" containerName="offline"
Jun 06 05:34:43.435508 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.435486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"
Jun 06 05:34:43.438441 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.438421    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 06 05:34:43.439023 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.439000    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 06 05:34:43.439023 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.439008    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-zzx9b\""
Jun 06 05:34:43.444759 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.444715    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"]
Jun 06 05:34:43.477730 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.477695    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7nr8\" (UniqueName: \"kubernetes.io/projected/4ee0107a-45ed-4276-936d-4679fe360bed-kube-api-access-t7nr8\") pod \"feast-operator-controller-manager-6d54c7db9d-rwqqz\" (UID: \"4ee0107a-45ed-4276-936d-4679fe360bed\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"
Jun 06 05:34:43.578937 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.578900    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7nr8\" (UniqueName: \"kubernetes.io/projected/4ee0107a-45ed-4276-936d-4679fe360bed-kube-api-access-t7nr8\") pod \"feast-operator-controller-manager-6d54c7db9d-rwqqz\" (UID: \"4ee0107a-45ed-4276-936d-4679fe360bed\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"
Jun 06 05:34:43.586344 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.586321    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7nr8\" (UniqueName: \"kubernetes.io/projected/4ee0107a-45ed-4276-936d-4679fe360bed-kube-api-access-t7nr8\") pod \"feast-operator-controller-manager-6d54c7db9d-rwqqz\" (UID: \"4ee0107a-45ed-4276-936d-4679fe360bed\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"
Jun 06 05:34:43.746501 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.746416    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"
Jun 06 05:34:43.872257 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.872232    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"]
Jun 06 05:34:43.874727 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:34:43.874700    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee0107a_45ed_4276_936d_4679fe360bed.slice/crio-a594becc9f3606db0990430fbe5e41bfba1e74e75397c8e12a057e9248d0c9fa WatchSource:0}: Error finding container a594becc9f3606db0990430fbe5e41bfba1e74e75397c8e12a057e9248d0c9fa: Status 404 returned error can't find the container with id a594becc9f3606db0990430fbe5e41bfba1e74e75397c8e12a057e9248d0c9fa
Jun 06 05:34:43.926979 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.926951    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz" event={"ID":"4ee0107a-45ed-4276-936d-4679fe360bed","Type":"ContainerStarted","Data":"041b5538ff0773ed92bb9f2eb096800801da24c36a12b11429b0de52a8a6d408"}
Jun 06 05:34:43.927097 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.927006    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz" event={"ID":"4ee0107a-45ed-4276-936d-4679fe360bed","Type":"ContainerStarted","Data":"a594becc9f3606db0990430fbe5e41bfba1e74e75397c8e12a057e9248d0c9fa"}
Jun 06 05:34:43.927097 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.927055    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"
Jun 06 05:34:43.940404 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:43.940361    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz" podStartSLOduration=0.940347141 podStartE2EDuration="940.347141ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:34:43.939807395 +0000 UTC m=+1545.987673056" watchObservedRunningTime="2026-06-06 05:34:43.940347141 +0000 UTC m=+1545.988212809"
Jun 06 05:34:54.935406 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:34:54.935372    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-rwqqz"
Jun 06 05:35:02.727600 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.727562    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"]
Jun 06 05:35:02.732244 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.732213    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.734283 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.734259    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 06 05:35:02.734510 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.734489    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 06 05:35:02.734510 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.734495    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 06 05:35:02.734777 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.734761    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 06 05:35:02.734945 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.734930    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 06 05:35:02.735230 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.735215    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 06 05:35:02.735447 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.735431    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-p9pnl\""
Jun 06 05:35:02.744509 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.744480    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"]
Jun 06 05:35:02.813263 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.813231    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a95c37da-ad93-4e3a-bb98-4ba1a523390e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.813263 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.813269    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.813498 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.813298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.813498 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.813359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.813498 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.813411    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/a95c37da-ad93-4e3a-bb98-4ba1a523390e-kube-api-access-489ts\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.813498 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.813447    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.914704 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.914637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.914704 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.914707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a95c37da-ad93-4e3a-bb98-4ba1a523390e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.914965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.914727    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.914965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.914759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.914965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.914777    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.914965 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.914812    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/a95c37da-ad93-4e3a-bb98-4ba1a523390e-kube-api-access-489ts\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.914965 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:35:02.914883    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 06 05:35:02.915200 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:35:02.914971    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls podName:a95c37da-ad93-4e3a-bb98-4ba1a523390e nodeName:}" failed. No retries permitted until 2026-06-06 05:35:03.414951714 +0000 UTC m=+1565.462817359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls") pod "feast-simple-feast-setup-75c64c888b-8bsbl" (UID: "a95c37da-ad93-4e3a-bb98-4ba1a523390e") : secret "feast-simple-feast-setup-online-tls" not found
Jun 06 05:35:02.915200 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.915120    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a95c37da-ad93-4e3a-bb98-4ba1a523390e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.917261 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.917238    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.917384 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.917366    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.917468 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.917399    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:02.922640 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:02.922612    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/a95c37da-ad93-4e3a-bb98-4ba1a523390e-kube-api-access-489ts\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:03.419316 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:03.419273    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:03.421758 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:03.421730    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bsbl\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:03.641369 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:03.641329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:03.767855 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:03.767833    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"]
Jun 06 05:35:03.769730 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:35:03.769703    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda95c37da_ad93_4e3a_bb98_4ba1a523390e.slice/crio-bf02d2f02cb56ba0d7f6588b34299c7874208c9f58df711671156cc116e3caf2 WatchSource:0}: Error finding container bf02d2f02cb56ba0d7f6588b34299c7874208c9f58df711671156cc116e3caf2: Status 404 returned error can't find the container with id bf02d2f02cb56ba0d7f6588b34299c7874208c9f58df711671156cc116e3caf2
Jun 06 05:35:04.003313 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:04.003281    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerStarted","Data":"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"}
Jun 06 05:35:04.003471 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:04.003336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerStarted","Data":"bf02d2f02cb56ba0d7f6588b34299c7874208c9f58df711671156cc116e3caf2"}
Jun 06 05:35:09.021916 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:09.021873    2568 generic.go:356] "Generic (PLEG): container finished" podID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerID="6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84" exitCode=0
Jun 06 05:35:09.022406 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:09.021949    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerDied","Data":"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"}
Jun 06 05:35:10.027021 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:10.026987    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerStarted","Data":"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"}
Jun 06 05:35:15.048310 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:15.048273    2568 generic.go:356] "Generic (PLEG): container finished" podID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerID="2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d" exitCode=0
Jun 06 05:35:15.048717 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:15.048339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerDied","Data":"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"}
Jun 06 05:35:16.058593 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:16.058553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerStarted","Data":"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"}
Jun 06 05:35:16.059169 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:16.059142    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerStarted","Data":"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"}
Jun 06 05:35:16.059294 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:16.059279    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerStarted","Data":"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"}
Jun 06 05:35:16.059389 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:16.059377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerStarted","Data":"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"}
Jun 06 05:35:16.080379 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:16.080313    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podStartSLOduration=14.080290386 podStartE2EDuration="14.080290386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:35:16.078681968 +0000 UTC m=+1578.126547637" watchObservedRunningTime="2026-06-06 05:35:16.080290386 +0000 UTC m=+1578.128156055"
Jun 06 05:35:18.642190 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.642153    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:18.642832 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.642812    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:18.642977 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.642966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:18.643303 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.643288    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:18.644493 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.644454    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 06 05:35:18.644493 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.644470    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
Jun 06 05:35:18.644680 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.644478    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
Jun 06 05:35:18.644680 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:18.644532    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 06 05:35:21.642990 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.642955    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.643356 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.643110    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.643453 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.643428    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.643811 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.643787    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.643939 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.643823    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.643939 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.643840    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.643939 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.643884    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.644092 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.643973    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.644092 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.644044    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:21.647722 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:21.647701    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:22.088522 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:22.088495    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:35:22.091489 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:35:22.091468    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:36:23.713979 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:23.713940    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"]
Jun 06 05:36:23.714458 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:23.714227    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="registry" containerID="cri-o://2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60" gracePeriod=30
Jun 06 05:36:23.714458 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:23.714360    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui" containerID="cri-o://dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847" gracePeriod=30
Jun 06 05:36:23.714458 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:23.714347    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="offline" containerID="cri-o://974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2" gracePeriod=30
Jun 06 05:36:23.714458 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:23.714347    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online" containerID="cri-o://6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d" gracePeriod=30
Jun 06 05:36:23.995683 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:23.995569    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"]
Jun 06 05:36:23.999208 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:23.999184    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.001020 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.000997    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-b9ctj\""
Jun 06 05:36:24.008742 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.008719    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"]
Jun 06 05:36:24.052814 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.052779    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.053006 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.052835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.053006 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.052946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.053006 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.052998    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.053116 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.053048    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frprb\" (UniqueName: \"kubernetes.io/projected/2f74035e-2414-4547-b058-017c7d5bb7b0-kube-api-access-frprb\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.053116 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.053102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f74035e-2414-4547-b058-017c7d5bb7b0-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.153847 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.153803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.154043 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.153860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.154043 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.153960    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.154043 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:24.153972    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 06 05:36:24.154043 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.153984    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.154248 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:24.154051    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls podName:2f74035e-2414-4547-b058-017c7d5bb7b0 nodeName:}" failed. No retries permitted until 2026-06-06 05:36:24.654029184 +0000 UTC m=+1646.701894831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls") pod "feast-simple-feast-setup-75c64c888b-jgkcx" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0") : secret "feast-simple-feast-setup-online-tls" not found
Jun 06 05:36:24.154248 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:24.154100    2568 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:36:24.154248 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.154115    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frprb\" (UniqueName: \"kubernetes.io/projected/2f74035e-2414-4547-b058-017c7d5bb7b0-kube-api-access-frprb\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.154248 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:24.154157    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls podName:2f74035e-2414-4547-b058-017c7d5bb7b0 nodeName:}" failed. No retries permitted until 2026-06-06 05:36:24.654139355 +0000 UTC m=+1646.702005013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls") pod "feast-simple-feast-setup-75c64c888b-jgkcx" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 06 05:36:24.154248 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.154187    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f74035e-2414-4547-b058-017c7d5bb7b0-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.154620 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.154593    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f74035e-2414-4547-b058-017c7d5bb7b0-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.156568 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.156539    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.156701 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.156575    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.161493 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.161466    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frprb\" (UniqueName: \"kubernetes.io/projected/2f74035e-2414-4547-b058-017c7d5bb7b0-kube-api-access-frprb\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.316063 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.316026    2568 generic.go:356] "Generic (PLEG): container finished" podID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerID="dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847" exitCode=0
Jun 06 05:36:24.316227 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.316070    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerDied","Data":"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"}
Jun 06 05:36:24.658876 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.658792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.658876 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.658854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.661293 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.661266    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.661402 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.661319    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-jgkcx\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:24.908835 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:24.908801    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:25.037523 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:25.037498    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"]
Jun 06 05:36:25.323473 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:25.323014    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerStarted","Data":"f4d860f5ec2bbab71c590f419d068fd844894c22f01c49bc9874821344a75b48"}
Jun 06 05:36:25.323473 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:25.323075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerStarted","Data":"bc42257a217ddf9d5e0ed5db1a1ab466aa66f6790ce762eec0a62cbfff355e8e"}
Jun 06 05:36:25.326673 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:25.326634    2568 generic.go:356] "Generic (PLEG): container finished" podID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerID="6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d" exitCode=0
Jun 06 05:36:25.326806 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:25.326684    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerDied","Data":"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"}
Jun 06 05:36:30.345540 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:30.345508    2568 generic.go:356] "Generic (PLEG): container finished" podID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerID="f4d860f5ec2bbab71c590f419d068fd844894c22f01c49bc9874821344a75b48" exitCode=0
Jun 06 05:36:30.345941 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:30.345563    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerDied","Data":"f4d860f5ec2bbab71c590f419d068fd844894c22f01c49bc9874821344a75b48"}
Jun 06 05:36:31.350789 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:31.350753    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerStarted","Data":"b80830579b4584b9fd80e00942ddd4bc284e7ef7f01b0252082bb72c4373ea6e"}
Jun 06 05:36:31.643812 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:31.643691    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 06 05:36:32.089147 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:32.089096    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 06 05:36:36.371381 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:36.371346    2568 generic.go:356] "Generic (PLEG): container finished" podID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerID="b80830579b4584b9fd80e00942ddd4bc284e7ef7f01b0252082bb72c4373ea6e" exitCode=0
Jun 06 05:36:36.371779 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:36.371390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerDied","Data":"b80830579b4584b9fd80e00942ddd4bc284e7ef7f01b0252082bb72c4373ea6e"}
Jun 06 05:36:37.390693 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:37.390630    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerStarted","Data":"11b73af023406699bfd8efcb518f05386197cae98ecd9f9eba39730c9a059835"}
Jun 06 05:36:37.391209 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:37.390717    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerStarted","Data":"d89d6b0985a6a2b06d516dae55affafd4dedba6bab9fd3164719fee4f70a067b"}
Jun 06 05:36:37.391209 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:37.390740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerStarted","Data":"7e0a5040a11aa33a432146c723d36eb81c3938abd9280e0131c0e07847e002b5"}
Jun 06 05:36:37.391209 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:37.390760    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerStarted","Data":"cbdd0c76a427e509073fb937006e5e90585c26b327c86227a388a78a346cedfa"}
Jun 06 05:36:37.414217 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:37.414148    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podStartSLOduration=14.414126249 podStartE2EDuration="14.414126249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:36:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:36:37.411739736 +0000 UTC m=+1659.459605405" watchObservedRunningTime="2026-06-06 05:36:37.414126249 +0000 UTC m=+1659.461991914"
Jun 06 05:36:39.909866 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.909722    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:39.910376 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.910163    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:39.910376 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.910195    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:39.910376 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.910213    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:39.911213 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.911181    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Jun 06 05:36:39.911424 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.911225    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused"
Jun 06 05:36:39.911544 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.911260    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused"
Jun 06 05:36:39.911544 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:39.911293    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Jun 06 05:36:41.644493 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:41.644439    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 06 05:36:42.088840 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.088793    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 06 05:36:42.910012 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.909977    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.910737 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.910712    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.910935 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.910923    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.911530 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.911442    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.911530 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.911488    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.911530 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.911507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.911768 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.911728    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.911820 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.911805    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.911858 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.911838    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:42.915118 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:42.915099    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:43.420934 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:43.420902    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:43.423967 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:43.423947    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:36:51.644269 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:51.644197    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 06 05:36:51.644794 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:51.644428    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:36:52.088813 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:52.088775    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 06 05:36:52.088950 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:52.088898    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:36:54.371940 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.371916    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:36:54.415091 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.415065    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/a95c37da-ad93-4e3a-bb98-4ba1a523390e-kube-api-access-489ts\") pod \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") "
Jun 06 05:36:54.415374 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.415104    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-offline-tls\") pod \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") "
Jun 06 05:36:54.415374 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.415120    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-ui-tls\") pod \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") "
Jun 06 05:36:54.415374 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.415159    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a95c37da-ad93-4e3a-bb98-4ba1a523390e-feast-data\") pod \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") "
Jun 06 05:36:54.415374 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.415178    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-registry-tls\") pod \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") "
Jun 06 05:36:54.415374 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.415193    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls\") pod \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\" (UID: \"a95c37da-ad93-4e3a-bb98-4ba1a523390e\") "
Jun 06 05:36:54.415744 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.415716    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a95c37da-ad93-4e3a-bb98-4ba1a523390e-feast-data" (OuterVolumeSpecName: "feast-data") pod "a95c37da-ad93-4e3a-bb98-4ba1a523390e" (UID: "a95c37da-ad93-4e3a-bb98-4ba1a523390e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:36:54.417883 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.417858    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a95c37da-ad93-4e3a-bb98-4ba1a523390e" (UID: "a95c37da-ad93-4e3a-bb98-4ba1a523390e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:36:54.417883 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.417882    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls" (OuterVolumeSpecName: "online-tls") pod "a95c37da-ad93-4e3a-bb98-4ba1a523390e" (UID: "a95c37da-ad93-4e3a-bb98-4ba1a523390e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:36:54.418010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.417890    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95c37da-ad93-4e3a-bb98-4ba1a523390e-kube-api-access-489ts" (OuterVolumeSpecName: "kube-api-access-489ts") pod "a95c37da-ad93-4e3a-bb98-4ba1a523390e" (UID: "a95c37da-ad93-4e3a-bb98-4ba1a523390e"). InnerVolumeSpecName "kube-api-access-489ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:36:54.418010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.417909    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a95c37da-ad93-4e3a-bb98-4ba1a523390e" (UID: "a95c37da-ad93-4e3a-bb98-4ba1a523390e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:36:54.418010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.417922    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a95c37da-ad93-4e3a-bb98-4ba1a523390e" (UID: "a95c37da-ad93-4e3a-bb98-4ba1a523390e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:36:54.463352 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.463323    2568 generic.go:356] "Generic (PLEG): container finished" podID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerID="974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2" exitCode=137
Jun 06 05:36:54.463352 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.463347    2568 generic.go:356] "Generic (PLEG): container finished" podID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerID="2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60" exitCode=137
Jun 06 05:36:54.463529 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.463389    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"
Jun 06 05:36:54.463529 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.463403    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerDied","Data":"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"}
Jun 06 05:36:54.463529 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.463455    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerDied","Data":"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"}
Jun 06 05:36:54.463529 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.463476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl" event={"ID":"a95c37da-ad93-4e3a-bb98-4ba1a523390e","Type":"ContainerDied","Data":"bf02d2f02cb56ba0d7f6588b34299c7874208c9f58df711671156cc116e3caf2"}
Jun 06 05:36:54.463529 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.463501    2568 scope.go:117] "RemoveContainer" containerID="dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"
Jun 06 05:36:54.471872 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.471852    2568 scope.go:117] "RemoveContainer" containerID="974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"
Jun 06 05:36:54.479315 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.479299    2568 scope.go:117] "RemoveContainer" containerID="6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"
Jun 06 05:36:54.484317 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.484288    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"]
Jun 06 05:36:54.487068 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.487048    2568 scope.go:117] "RemoveContainer" containerID="2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"
Jun 06 05:36:54.487413 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.487393    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bsbl"]
Jun 06 05:36:54.493927 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.493911    2568 scope.go:117] "RemoveContainer" containerID="2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"
Jun 06 05:36:54.500707 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.500691    2568 scope.go:117] "RemoveContainer" containerID="6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"
Jun 06 05:36:54.507398 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.507380    2568 scope.go:117] "RemoveContainer" containerID="dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"
Jun 06 05:36:54.507643 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:54.507624    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847\": container with ID starting with dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847 not found: ID does not exist" containerID="dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"
Jun 06 05:36:54.507703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.507665    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"} err="failed to get container status \"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847\": rpc error: code = NotFound desc = could not find container \"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847\": container with ID starting with dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847 not found: ID does not exist"
Jun 06 05:36:54.507703 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.507686    2568 scope.go:117] "RemoveContainer" containerID="974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"
Jun 06 05:36:54.507907 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:54.507892    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2\": container with ID starting with 974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2 not found: ID does not exist" containerID="974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"
Jun 06 05:36:54.507949 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.507910    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"} err="failed to get container status \"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2\": rpc error: code = NotFound desc = could not find container \"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2\": container with ID starting with 974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2 not found: ID does not exist"
Jun 06 05:36:54.507949 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.507922    2568 scope.go:117] "RemoveContainer" containerID="6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"
Jun 06 05:36:54.508147 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:54.508131    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d\": container with ID starting with 6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d not found: ID does not exist" containerID="6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"
Jun 06 05:36:54.508189 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508150    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"} err="failed to get container status \"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d\": rpc error: code = NotFound desc = could not find container \"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d\": container with ID starting with 6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d not found: ID does not exist"
Jun 06 05:36:54.508189 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508164    2568 scope.go:117] "RemoveContainer" containerID="2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"
Jun 06 05:36:54.508379 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:54.508362    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60\": container with ID starting with 2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60 not found: ID does not exist" containerID="2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"
Jun 06 05:36:54.508421 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508383    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"} err="failed to get container status \"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60\": rpc error: code = NotFound desc = could not find container \"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60\": container with ID starting with 2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60 not found: ID does not exist"
Jun 06 05:36:54.508421 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508396    2568 scope.go:117] "RemoveContainer" containerID="2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"
Jun 06 05:36:54.508582 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:54.508567    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d\": container with ID starting with 2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d not found: ID does not exist" containerID="2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"
Jun 06 05:36:54.508619 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508587    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"} err="failed to get container status \"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d\": rpc error: code = NotFound desc = could not find container \"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d\": container with ID starting with 2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d not found: ID does not exist"
Jun 06 05:36:54.508619 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508599    2568 scope.go:117] "RemoveContainer" containerID="6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"
Jun 06 05:36:54.508814 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:36:54.508793    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84\": container with ID starting with 6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84 not found: ID does not exist" containerID="6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"
Jun 06 05:36:54.508855 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508819    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"} err="failed to get container status \"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84\": rpc error: code = NotFound desc = could not find container \"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84\": container with ID starting with 6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84 not found: ID does not exist"
Jun 06 05:36:54.508855 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.508834    2568 scope.go:117] "RemoveContainer" containerID="dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"
Jun 06 05:36:54.509052 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509035    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847"} err="failed to get container status \"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847\": rpc error: code = NotFound desc = could not find container \"dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847\": container with ID starting with dce213e97ba36d0af54192c073c93dfd86ecc9fb7a680f4b35cbd02da368b847 not found: ID does not exist"
Jun 06 05:36:54.509092 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509052    2568 scope.go:117] "RemoveContainer" containerID="974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"
Jun 06 05:36:54.509236 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509221    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2"} err="failed to get container status \"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2\": rpc error: code = NotFound desc = could not find container \"974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2\": container with ID starting with 974f54c426cf94d0a7fae3638cc1fb2b6ceb2f0a8b0c0e6f9068d184d42361d2 not found: ID does not exist"
Jun 06 05:36:54.509287 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509236    2568 scope.go:117] "RemoveContainer" containerID="6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"
Jun 06 05:36:54.509424 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509406    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d"} err="failed to get container status \"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d\": rpc error: code = NotFound desc = could not find container \"6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d\": container with ID starting with 6f3b9bdabc5551952287ff75e18906e3c9d050350a478ce41f20fbf765f96a4d not found: ID does not exist"
Jun 06 05:36:54.509468 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509425    2568 scope.go:117] "RemoveContainer" containerID="2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"
Jun 06 05:36:54.509602 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509587    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60"} err="failed to get container status \"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60\": rpc error: code = NotFound desc = could not find container \"2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60\": container with ID starting with 2f1bb5793f4319fb51a0a7d70a40878e5a3e10dd7a5c009622eb55a512762c60 not found: ID does not exist"
Jun 06 05:36:54.509646 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509602    2568 scope.go:117] "RemoveContainer" containerID="2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"
Jun 06 05:36:54.509814 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509795    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d"} err="failed to get container status \"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d\": rpc error: code = NotFound desc = could not find container \"2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d\": container with ID starting with 2e9accd5403fd7537872e4cdf40b33f9401d152e8ba752fbb4945549bd106f1d not found: ID does not exist"
Jun 06 05:36:54.509877 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509815    2568 scope.go:117] "RemoveContainer" containerID="6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"
Jun 06 05:36:54.510003 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.509987    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84"} err="failed to get container status \"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84\": rpc error: code = NotFound desc = could not find container \"6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84\": container with ID starting with 6027d4364131feb656fa568762bf6eadb88ed3792890b3e6929b9c221db3be84 not found: ID does not exist"
Jun 06 05:36:54.521513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.516990    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-registry-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:36:54.521513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.517034    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-online-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:36:54.521513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.517054    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-489ts\" (UniqueName: \"kubernetes.io/projected/a95c37da-ad93-4e3a-bb98-4ba1a523390e-kube-api-access-489ts\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:36:54.521513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.517082    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-offline-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:36:54.521513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.517101    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a95c37da-ad93-4e3a-bb98-4ba1a523390e-ui-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:36:54.521513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:54.517120    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a95c37da-ad93-4e3a-bb98-4ba1a523390e-feast-data\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:36:56.369991 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:36:56.369956    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" path="/var/lib/kubelet/pods/a95c37da-ad93-4e3a-bb98-4ba1a523390e/volumes"
Jun 06 05:37:45.411771 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.411739    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"]
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412111    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="feast-init"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412125    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="feast-init"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412147    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="feast-apply"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412153    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="feast-apply"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412159    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412165    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412171    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="offline"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412175    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="offline"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412185    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412190    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412196    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="registry"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412201    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="registry"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412259    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="registry"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412268    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="online"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412277    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="offline"
Jun 06 05:37:45.412320 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.412285    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95c37da-ad93-4e3a-bb98-4ba1a523390e" containerName="ui"
Jun 06 05:37:45.415772 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.415755    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.417569 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.417531    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 06 05:37:45.417710 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.417685    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 06 05:37:45.417782 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.417726    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 06 05:37:45.417848 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.417830    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-f5pjk\""
Jun 06 05:37:45.417907 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.417855    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 06 05:37:45.417959 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.417931    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 06 05:37:45.418010 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.417983    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 06 05:37:45.424733 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.424710    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"]
Jun 06 05:37:45.512725 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.512693    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.512896 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.512732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.512896 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.512812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0d6270c-df55-49b3-a966-d0fd8e616267-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.512896 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.512873    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pvps\" (UniqueName: \"kubernetes.io/projected/b0d6270c-df55-49b3-a966-d0fd8e616267-kube-api-access-2pvps\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.513027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.512911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d6270c-df55-49b3-a966-d0fd8e616267-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.513027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.512960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.613551 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.613514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pvps\" (UniqueName: \"kubernetes.io/projected/b0d6270c-df55-49b3-a966-d0fd8e616267-kube-api-access-2pvps\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.613551 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.613557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d6270c-df55-49b3-a966-d0fd8e616267-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.613842 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.613597    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.613842 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.613641    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.613842 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.613687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.613842 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.613749    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0d6270c-df55-49b3-a966-d0fd8e616267-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.614067 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.614044    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d6270c-df55-49b3-a966-d0fd8e616267-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.614505 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.614482    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0d6270c-df55-49b3-a966-d0fd8e616267-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.620695 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.619409    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.621462 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.621442    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.621553 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.621534    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.622595 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.622574    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pvps\" (UniqueName: \"kubernetes.io/projected/b0d6270c-df55-49b3-a966-d0fd8e616267-kube-api-access-2pvps\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hb8hn\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.724820 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.724732    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:45.854894 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:45.854866    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"]
Jun 06 05:37:45.857009 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:37:45.856981    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0d6270c_df55_49b3_a966_d0fd8e616267.slice/crio-a2963093315d7e9e870d72f4d2eac4b3ba6550a5e56103c338bad9637b1068e2 WatchSource:0}: Error finding container a2963093315d7e9e870d72f4d2eac4b3ba6550a5e56103c338bad9637b1068e2: Status 404 returned error can't find the container with id a2963093315d7e9e870d72f4d2eac4b3ba6550a5e56103c338bad9637b1068e2
Jun 06 05:37:46.655471 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:46.655427    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerStarted","Data":"463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065"}
Jun 06 05:37:46.655874 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:46.655481    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerStarted","Data":"a2963093315d7e9e870d72f4d2eac4b3ba6550a5e56103c338bad9637b1068e2"}
Jun 06 05:37:50.673702 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:50.673642    2568 generic.go:356] "Generic (PLEG): container finished" podID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerID="463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065" exitCode=0
Jun 06 05:37:50.674263 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:50.673720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerDied","Data":"463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065"}
Jun 06 05:37:51.679168 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:51.679133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerStarted","Data":"a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff"}
Jun 06 05:37:56.702355 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:56.702268    2568 generic.go:356] "Generic (PLEG): container finished" podID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerID="a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff" exitCode=0
Jun 06 05:37:56.702355 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:56.702309    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerDied","Data":"a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff"}
Jun 06 05:37:57.710375 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.710330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerStarted","Data":"6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a"}
Jun 06 05:37:57.710896 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.710388    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerStarted","Data":"8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea"}
Jun 06 05:37:57.710896 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.710401    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerStarted","Data":"1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171"}
Jun 06 05:37:57.725299 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.725267    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:57.725549 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.725532    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:57.725695 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.725651    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:37:57.726834 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.726799    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
Jun 06 05:37:57.727027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.726843    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Jun 06 05:37:57.727027 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.726842    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 06 05:37:57.730352 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:37:57.730302    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podStartSLOduration=12.730284555 podStartE2EDuration="12.730284555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:37:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:37:57.729167103 +0000 UTC m=+1739.777032797" watchObservedRunningTime="2026-06-06 05:37:57.730284555 +0000 UTC m=+1739.778150223"
Jun 06 05:38:00.725390 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:00.725349    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
Jun 06 05:38:00.725898 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:00.725367    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Jun 06 05:38:00.725898 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:00.725435    2568 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 06 05:38:03.726539 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.726505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.727062 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.726961    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.727128 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.727121    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.727182 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.727161    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.730941 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.730916    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.736005 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.735985    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.736127 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.736020    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.736457 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.736441    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:03.738552 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:03.738528    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:38:58.423557 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:58.423526    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:38:58.425723 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:58.425700    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:38:58.429944 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:58.429924    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:38:58.431491 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:38:58.431474    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:39:06.338236 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.338199    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"]
Jun 06 05:39:06.338676 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.338440    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online" containerID="cri-o://1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171" gracePeriod=30
Jun 06 05:39:06.338676 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.338515    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="offline" containerID="cri-o://8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea" gracePeriod=30
Jun 06 05:39:06.338676 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.338528    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui" containerID="cri-o://6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a" gracePeriod=30
Jun 06 05:39:06.486028 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.485989    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"]
Jun 06 05:39:06.486395 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.486288    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="registry" containerID="cri-o://cbdd0c76a427e509073fb937006e5e90585c26b327c86227a388a78a346cedfa" gracePeriod=30
Jun 06 05:39:06.486395 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.486359    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online" containerID="cri-o://7e0a5040a11aa33a432146c723d36eb81c3938abd9280e0131c0e07847e002b5" gracePeriod=30
Jun 06 05:39:06.486536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.486408    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui" containerID="cri-o://11b73af023406699bfd8efcb518f05386197cae98ecd9f9eba39730c9a059835" gracePeriod=30
Jun 06 05:39:06.486536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.486357    2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="offline" containerID="cri-o://d89d6b0985a6a2b06d516dae55affafd4dedba6bab9fd3164719fee4f70a067b" gracePeriod=30
Jun 06 05:39:06.968370 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.968332    2568 generic.go:356] "Generic (PLEG): container finished" podID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerID="6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a" exitCode=0
Jun 06 05:39:06.968566 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:06.968408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerDied","Data":"6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a"}
Jun 06 05:39:07.974805 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:07.974771    2568 generic.go:356] "Generic (PLEG): container finished" podID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerID="1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171" exitCode=0
Jun 06 05:39:07.977067 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:07.974845    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerDied","Data":"1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171"}
Jun 06 05:39:07.977792 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:07.977772    2568 generic.go:356] "Generic (PLEG): container finished" podID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerID="11b73af023406699bfd8efcb518f05386197cae98ecd9f9eba39730c9a059835" exitCode=0
Jun 06 05:39:07.977792 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:07.977788    2568 generic.go:356] "Generic (PLEG): container finished" podID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerID="7e0a5040a11aa33a432146c723d36eb81c3938abd9280e0131c0e07847e002b5" exitCode=0
Jun 06 05:39:07.977925 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:07.977813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerDied","Data":"11b73af023406699bfd8efcb518f05386197cae98ecd9f9eba39730c9a059835"}
Jun 06 05:39:07.977925 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:07.977841    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerDied","Data":"7e0a5040a11aa33a432146c723d36eb81c3938abd9280e0131c0e07847e002b5"}
Jun 06 05:39:12.911714 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:12.911632    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Jun 06 05:39:13.421536 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:13.421491    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Jun 06 05:39:13.736384 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:13.736127    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Jun 06 05:39:13.736384 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:13.736150    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 06 05:39:22.911874 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:22.911822    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Jun 06 05:39:23.422057 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:23.422012    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Jun 06 05:39:23.736420 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:23.736316    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Jun 06 05:39:23.736420 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:23.736391    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 06 05:39:32.911630 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:32.911579    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
Jun 06 05:39:32.912105 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:32.911783    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:39:33.421468 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:33.421425    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Jun 06 05:39:33.421644 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:33.421532    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:39:33.737058 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:33.736961    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Jun 06 05:39:33.737058 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:33.737020    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 06 05:39:33.737262 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:33.737090    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:39:33.737262 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:33.737137    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:39:36.991722 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:36.991698    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:39:37.085976 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.085941    2568 generic.go:356] "Generic (PLEG): container finished" podID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerID="d89d6b0985a6a2b06d516dae55affafd4dedba6bab9fd3164719fee4f70a067b" exitCode=137
Jun 06 05:39:37.085976 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.085964    2568 generic.go:356] "Generic (PLEG): container finished" podID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerID="cbdd0c76a427e509073fb937006e5e90585c26b327c86227a388a78a346cedfa" exitCode=137
Jun 06 05:39:37.086191 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.086015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerDied","Data":"d89d6b0985a6a2b06d516dae55affafd4dedba6bab9fd3164719fee4f70a067b"}
Jun 06 05:39:37.086191 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.086082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerDied","Data":"cbdd0c76a427e509073fb937006e5e90585c26b327c86227a388a78a346cedfa"}
Jun 06 05:39:37.088502 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.088478    2568 generic.go:356] "Generic (PLEG): container finished" podID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerID="8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea" exitCode=137
Jun 06 05:39:37.088613 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.088551    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"
Jun 06 05:39:37.088670 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.088550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerDied","Data":"8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea"}
Jun 06 05:39:37.088717 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.088675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn" event={"ID":"b0d6270c-df55-49b3-a966-d0fd8e616267","Type":"ContainerDied","Data":"a2963093315d7e9e870d72f4d2eac4b3ba6550a5e56103c338bad9637b1068e2"}
Jun 06 05:39:37.088717 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.088698    2568 scope.go:117] "RemoveContainer" containerID="6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a"
Jun 06 05:39:37.097061 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.097034    2568 scope.go:117] "RemoveContainer" containerID="8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea"
Jun 06 05:39:37.105232 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105179    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-online-tls\") pod \"b0d6270c-df55-49b3-a966-d0fd8e616267\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") "
Jun 06 05:39:37.105335 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105231    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0d6270c-df55-49b3-a966-d0fd8e616267-registry-tls\") pod \"b0d6270c-df55-49b3-a966-d0fd8e616267\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") "
Jun 06 05:39:37.105335 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105276    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-offline-tls\") pod \"b0d6270c-df55-49b3-a966-d0fd8e616267\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") "
Jun 06 05:39:37.105335 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105314    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pvps\" (UniqueName: \"kubernetes.io/projected/b0d6270c-df55-49b3-a966-d0fd8e616267-kube-api-access-2pvps\") pod \"b0d6270c-df55-49b3-a966-d0fd8e616267\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") "
Jun 06 05:39:37.105335 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105331    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-ui-tls\") pod \"b0d6270c-df55-49b3-a966-d0fd8e616267\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") "
Jun 06 05:39:37.105539 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105371    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d6270c-df55-49b3-a966-d0fd8e616267-feast-data\") pod \"b0d6270c-df55-49b3-a966-d0fd8e616267\" (UID: \"b0d6270c-df55-49b3-a966-d0fd8e616267\") "
Jun 06 05:39:37.105819 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105778    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0d6270c-df55-49b3-a966-d0fd8e616267-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b0d6270c-df55-49b3-a966-d0fd8e616267" (UID: "b0d6270c-df55-49b3-a966-d0fd8e616267"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 05:39:37.106053 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.105975    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0d6270c-df55-49b3-a966-d0fd8e616267-feast-data" (OuterVolumeSpecName: "feast-data") pod "b0d6270c-df55-49b3-a966-d0fd8e616267" (UID: "b0d6270c-df55-49b3-a966-d0fd8e616267"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:39:37.106201 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.106172    2568 scope.go:117] "RemoveContainer" containerID="1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171"
Jun 06 05:39:37.108507 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.108461    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b0d6270c-df55-49b3-a966-d0fd8e616267" (UID: "b0d6270c-df55-49b3-a966-d0fd8e616267"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:39:37.108507 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.108498    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-online-tls" (OuterVolumeSpecName: "online-tls") pod "b0d6270c-df55-49b3-a966-d0fd8e616267" (UID: "b0d6270c-df55-49b3-a966-d0fd8e616267"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:39:37.108628 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.108528    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b0d6270c-df55-49b3-a966-d0fd8e616267" (UID: "b0d6270c-df55-49b3-a966-d0fd8e616267"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:39:37.108628 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.108536    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0d6270c-df55-49b3-a966-d0fd8e616267-kube-api-access-2pvps" (OuterVolumeSpecName: "kube-api-access-2pvps") pod "b0d6270c-df55-49b3-a966-d0fd8e616267" (UID: "b0d6270c-df55-49b3-a966-d0fd8e616267"). InnerVolumeSpecName "kube-api-access-2pvps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:39:37.115172 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.115144    2568 scope.go:117] "RemoveContainer" containerID="a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff"
Jun 06 05:39:37.122513 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.122488    2568 scope.go:117] "RemoveContainer" containerID="463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065"
Jun 06 05:39:37.130418 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.130402    2568 scope.go:117] "RemoveContainer" containerID="6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a"
Jun 06 05:39:37.130766 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:39:37.130744    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a\": container with ID starting with 6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a not found: ID does not exist" containerID="6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a"
Jun 06 05:39:37.130848 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.130772    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a"} err="failed to get container status \"6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a\": rpc error: code = NotFound desc = could not find container \"6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a\": container with ID starting with 6bd19e6c8996351092f97dcbe0a79b22aa0d1a404ce1eb1fdc1854e1b7aa479a not found: ID does not exist"
Jun 06 05:39:37.130848 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.130795    2568 scope.go:117] "RemoveContainer" containerID="8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea"
Jun 06 05:39:37.131079 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:39:37.131061    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea\": container with ID starting with 8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea not found: ID does not exist" containerID="8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea"
Jun 06 05:39:37.131125 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.131082    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea"} err="failed to get container status \"8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea\": rpc error: code = NotFound desc = could not find container \"8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea\": container with ID starting with 8efa67bc8512656a2299fdd49f191c09acf98b3dad414c288b6ef8a9ac9a8fea not found: ID does not exist"
Jun 06 05:39:37.131125 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.131095    2568 scope.go:117] "RemoveContainer" containerID="1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171"
Jun 06 05:39:37.131311 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:39:37.131292    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171\": container with ID starting with 1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171 not found: ID does not exist" containerID="1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171"
Jun 06 05:39:37.131371 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.131321    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171"} err="failed to get container status \"1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171\": rpc error: code = NotFound desc = could not find container \"1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171\": container with ID starting with 1bd09cbc059e12793a63ce87fc72a684db50275da91ed60b4e747cf037d72171 not found: ID does not exist"
Jun 06 05:39:37.131371 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.131345    2568 scope.go:117] "RemoveContainer" containerID="a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff"
Jun 06 05:39:37.131608 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:39:37.131587    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff\": container with ID starting with a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff not found: ID does not exist" containerID="a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff"
Jun 06 05:39:37.131691 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.131611    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff"} err="failed to get container status \"a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff\": rpc error: code = NotFound desc = could not find container \"a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff\": container with ID starting with a4f49f14665732e99ff73b3e2341ccb2479ffaced5aedbc3606c4f93058387ff not found: ID does not exist"
Jun 06 05:39:37.131691 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.131629    2568 scope.go:117] "RemoveContainer" containerID="463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065"
Jun 06 05:39:37.131865 ip-10-0-139-94 kubenswrapper[2568]: E0606 05:39:37.131845    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065\": container with ID starting with 463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065 not found: ID does not exist" containerID="463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065"
Jun 06 05:39:37.131953 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.131869    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065"} err="failed to get container status \"463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065\": rpc error: code = NotFound desc = could not find container \"463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065\": container with ID starting with 463523589c88f2098a4f7f2d40eb4db9f2ed2d89efb05e1628c2b9cc5c4f4065 not found: ID does not exist"
Jun 06 05:39:37.137006 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.136987    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:39:37.206152 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206116    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls\") pod \"2f74035e-2414-4547-b058-017c7d5bb7b0\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") "
Jun 06 05:39:37.206343 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206168    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-ui-tls\") pod \"2f74035e-2414-4547-b058-017c7d5bb7b0\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") "
Jun 06 05:39:37.206343 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206188    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-offline-tls\") pod \"2f74035e-2414-4547-b058-017c7d5bb7b0\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") "
Jun 06 05:39:37.206343 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206209    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frprb\" (UniqueName: \"kubernetes.io/projected/2f74035e-2414-4547-b058-017c7d5bb7b0-kube-api-access-frprb\") pod \"2f74035e-2414-4547-b058-017c7d5bb7b0\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") "
Jun 06 05:39:37.206343 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206247    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls\") pod \"2f74035e-2414-4547-b058-017c7d5bb7b0\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") "
Jun 06 05:39:37.206569 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206380    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f74035e-2414-4547-b058-017c7d5bb7b0-feast-data\") pod \"2f74035e-2414-4547-b058-017c7d5bb7b0\" (UID: \"2f74035e-2414-4547-b058-017c7d5bb7b0\") "
Jun 06 05:39:37.206818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206628    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-offline-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.206818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206650    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pvps\" (UniqueName: \"kubernetes.io/projected/b0d6270c-df55-49b3-a966-d0fd8e616267-kube-api-access-2pvps\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.206818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206693    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-ui-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.206818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206706    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b0d6270c-df55-49b3-a966-d0fd8e616267-feast-data\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.206818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206719    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b0d6270c-df55-49b3-a966-d0fd8e616267-online-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.206818 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206731    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b0d6270c-df55-49b3-a966-d0fd8e616267-registry-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.207168 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.206979    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f74035e-2414-4547-b058-017c7d5bb7b0-feast-data" (OuterVolumeSpecName: "feast-data") pod "2f74035e-2414-4547-b058-017c7d5bb7b0" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 05:39:37.208518 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.208490    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2f74035e-2414-4547-b058-017c7d5bb7b0" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:39:37.208621 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.208511    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls" (OuterVolumeSpecName: "online-tls") pod "2f74035e-2414-4547-b058-017c7d5bb7b0" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:39:37.208621 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.208526    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2f74035e-2414-4547-b058-017c7d5bb7b0" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:39:37.208799 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.208781    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2f74035e-2414-4547-b058-017c7d5bb7b0" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 05:39:37.208864 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.208796    2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f74035e-2414-4547-b058-017c7d5bb7b0-kube-api-access-frprb" (OuterVolumeSpecName: "kube-api-access-frprb") pod "2f74035e-2414-4547-b058-017c7d5bb7b0" (UID: "2f74035e-2414-4547-b058-017c7d5bb7b0"). InnerVolumeSpecName "kube-api-access-frprb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 05:39:37.307202 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.307166    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frprb\" (UniqueName: \"kubernetes.io/projected/2f74035e-2414-4547-b058-017c7d5bb7b0-kube-api-access-frprb\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.307202 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.307196    2568 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-online-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.307202 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.307206    2568 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f74035e-2414-4547-b058-017c7d5bb7b0-feast-data\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.307202 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.307214    2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-registry-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.307444 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.307224    2568 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-ui-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.307444 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.307231    2568 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f74035e-2414-4547-b058-017c7d5bb7b0-offline-tls\") on node \"ip-10-0-139-94.ec2.internal\" DevicePath \"\""
Jun 06 05:39:37.409022 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.408984    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"]
Jun 06 05:39:37.416302 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:37.416263    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hb8hn"]
Jun 06 05:39:38.095323 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.095286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx" event={"ID":"2f74035e-2414-4547-b058-017c7d5bb7b0","Type":"ContainerDied","Data":"bc42257a217ddf9d5e0ed5db1a1ab466aa66f6790ce762eec0a62cbfff355e8e"}
Jun 06 05:39:38.095323 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.095313    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"
Jun 06 05:39:38.095810 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.095349    2568 scope.go:117] "RemoveContainer" containerID="11b73af023406699bfd8efcb518f05386197cae98ecd9f9eba39730c9a059835"
Jun 06 05:39:38.104532 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.104513    2568 scope.go:117] "RemoveContainer" containerID="d89d6b0985a6a2b06d516dae55affafd4dedba6bab9fd3164719fee4f70a067b"
Jun 06 05:39:38.111997 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.111977    2568 scope.go:117] "RemoveContainer" containerID="7e0a5040a11aa33a432146c723d36eb81c3938abd9280e0131c0e07847e002b5"
Jun 06 05:39:38.115791 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.115766    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"]
Jun 06 05:39:38.118847 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.118825    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-jgkcx"]
Jun 06 05:39:38.120443 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.120420    2568 scope.go:117] "RemoveContainer" containerID="cbdd0c76a427e509073fb937006e5e90585c26b327c86227a388a78a346cedfa"
Jun 06 05:39:38.129419 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.129392    2568 scope.go:117] "RemoveContainer" containerID="b80830579b4584b9fd80e00942ddd4bc284e7ef7f01b0252082bb72c4373ea6e"
Jun 06 05:39:38.136868 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.136848    2568 scope.go:117] "RemoveContainer" containerID="f4d860f5ec2bbab71c590f419d068fd844894c22f01c49bc9874821344a75b48"
Jun 06 05:39:38.370386 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.370306    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" path="/var/lib/kubelet/pods/2f74035e-2414-4547-b058-017c7d5bb7b0/volumes"
Jun 06 05:39:38.370943 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:39:38.370929    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" path="/var/lib/kubelet/pods/b0d6270c-df55-49b3-a966-d0fd8e616267/volumes"
Jun 06 05:40:13.218222 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218133    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9qq24/must-gather-j5d2j"]
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218496    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218514    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218529    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="offline"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218540    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="offline"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218551    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="feast-init"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218560    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="feast-init"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218568    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218578    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218586    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="registry"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218594    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="registry"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218607    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="feast-init"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218614    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="feast-init"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218625    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="offline"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218632    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="offline"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218649    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="feast-apply"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218676    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="feast-apply"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218685    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="feast-apply"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218693    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="feast-apply"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218706    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218713    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218723    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online"
Jun 06 05:40:13.218731 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218732    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online"
Jun 06 05:40:13.219826 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218803    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="ui"
Jun 06 05:40:13.219826 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218817    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="registry"
Jun 06 05:40:13.219826 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218826    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="ui"
Jun 06 05:40:13.219826 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218837    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="offline"
Jun 06 05:40:13.219826 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218848    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="online"
Jun 06 05:40:13.219826 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218857    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f74035e-2414-4547-b058-017c7d5bb7b0" containerName="online"
Jun 06 05:40:13.219826 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.218865    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0d6270c-df55-49b3-a966-d0fd8e616267" containerName="offline"
Jun 06 05:40:13.223448 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.223427    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.225205 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.225180    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9qq24\"/\"default-dockercfg-jqqtz\""
Jun 06 05:40:13.225328 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.225183    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qq24\"/\"openshift-service-ca.crt\""
Jun 06 05:40:13.225673 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.225645    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qq24\"/\"kube-root-ca.crt\""
Jun 06 05:40:13.228744 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.228719    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qq24/must-gather-j5d2j"]
Jun 06 05:40:13.276617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.272461    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm629\" (UniqueName: \"kubernetes.io/projected/9c590fb0-66c2-4770-95b5-50dd05ea47cc-kube-api-access-jm629\") pod \"must-gather-j5d2j\" (UID: \"9c590fb0-66c2-4770-95b5-50dd05ea47cc\") " pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.276617 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.272552    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c590fb0-66c2-4770-95b5-50dd05ea47cc-must-gather-output\") pod \"must-gather-j5d2j\" (UID: \"9c590fb0-66c2-4770-95b5-50dd05ea47cc\") " pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.373630 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.373584    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm629\" (UniqueName: \"kubernetes.io/projected/9c590fb0-66c2-4770-95b5-50dd05ea47cc-kube-api-access-jm629\") pod \"must-gather-j5d2j\" (UID: \"9c590fb0-66c2-4770-95b5-50dd05ea47cc\") " pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.373825 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.373688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c590fb0-66c2-4770-95b5-50dd05ea47cc-must-gather-output\") pod \"must-gather-j5d2j\" (UID: \"9c590fb0-66c2-4770-95b5-50dd05ea47cc\") " pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.374060 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.374035    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c590fb0-66c2-4770-95b5-50dd05ea47cc-must-gather-output\") pod \"must-gather-j5d2j\" (UID: \"9c590fb0-66c2-4770-95b5-50dd05ea47cc\") " pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.380412 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.380390    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm629\" (UniqueName: \"kubernetes.io/projected/9c590fb0-66c2-4770-95b5-50dd05ea47cc-kube-api-access-jm629\") pod \"must-gather-j5d2j\" (UID: \"9c590fb0-66c2-4770-95b5-50dd05ea47cc\") " pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.533263 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.533204    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qq24/must-gather-j5d2j"
Jun 06 05:40:13.658444 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.658410    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qq24/must-gather-j5d2j"]
Jun 06 05:40:13.661588 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:40:13.661557    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c590fb0_66c2_4770_95b5_50dd05ea47cc.slice/crio-6df692b6abf02abefd59c836613991f6b4e898f639baaa9731baba7101db0951 WatchSource:0}: Error finding container 6df692b6abf02abefd59c836613991f6b4e898f639baaa9731baba7101db0951: Status 404 returned error can't find the container with id 6df692b6abf02abefd59c836613991f6b4e898f639baaa9731baba7101db0951
Jun 06 05:40:13.663433 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:13.663418    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 05:40:14.226409 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:14.226374    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qq24/must-gather-j5d2j" event={"ID":"9c590fb0-66c2-4770-95b5-50dd05ea47cc","Type":"ContainerStarted","Data":"6df692b6abf02abefd59c836613991f6b4e898f639baaa9731baba7101db0951"}
Jun 06 05:40:15.232158 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:15.232122    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qq24/must-gather-j5d2j" event={"ID":"9c590fb0-66c2-4770-95b5-50dd05ea47cc","Type":"ContainerStarted","Data":"61431775e3f85826b755421b313cdbf4c5e283ec21b44ac545f5847ca303bdeb"}
Jun 06 05:40:15.232158 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:15.232166    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qq24/must-gather-j5d2j" event={"ID":"9c590fb0-66c2-4770-95b5-50dd05ea47cc","Type":"ContainerStarted","Data":"52df5323b908cfcc29cf190936460c722f9307fd7f4c6dc7525d484c17be5149"}
Jun 06 05:40:15.244699 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:15.244627    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9qq24/must-gather-j5d2j" podStartSLOduration=1.357574409 podStartE2EDuration="2.244609703s" totalImagesPullingTime="887.035294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 05:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:40:15.244291358 +0000 UTC m=+1877.292157027" watchObservedRunningTime="2026-06-06 05:40:15.244609703 +0000 UTC m=+1877.292475370"
Jun 06 05:40:15.844636 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:15.844601    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-db5w4_75dce24e-ff56-42ef-bbc7-a2bb0db4b024/global-pull-secret-syncer/0.log"
Jun 06 05:40:15.952892 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:15.952851    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hvsjv_3a5a9f60-8e3e-4b14-9e88-24141a99b4e7/konnectivity-agent/0.log"
Jun 06 05:40:16.025494 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:16.025457    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-94.ec2.internal_f4df2d57bbce72652886cb8d629b1afd/haproxy/0.log"
Jun 06 05:40:20.127711 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.127684    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwhtp_53469dad-04ae-4a39-85eb-df175148d3d6/node-exporter/0.log"
Jun 06 05:40:20.151298 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.151268    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwhtp_53469dad-04ae-4a39-85eb-df175148d3d6/kube-rbac-proxy/0.log"
Jun 06 05:40:20.179286 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.179257    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwhtp_53469dad-04ae-4a39-85eb-df175148d3d6/init-textfile/0.log"
Jun 06 05:40:20.350321 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.350290    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sxzl2_81bd0a66-3de2-4692-b104-95f4846c1c2b/kube-rbac-proxy-main/0.log"
Jun 06 05:40:20.381064 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.380980    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sxzl2_81bd0a66-3de2-4692-b104-95f4846c1c2b/kube-rbac-proxy-self/0.log"
Jun 06 05:40:20.402071 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.402038    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-sxzl2_81bd0a66-3de2-4692-b104-95f4846c1c2b/openshift-state-metrics/0.log"
Jun 06 05:40:20.647641 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.647560    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-b49bq_973d8bd5-ad60-4e90-ab5a-d1fb27a20b44/prometheus-operator/0.log"
Jun 06 05:40:20.667311 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:20.667268    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-b49bq_973d8bd5-ad60-4e90-ab5a-d1fb27a20b44/kube-rbac-proxy/0.log"
Jun 06 05:40:22.591538 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:22.591513    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/1.log"
Jun 06 05:40:22.599932 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:22.599898    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8s7h4_218705eb-2c30-4d53-8ac8-c78bb4ead465/console-operator/2.log"
Jun 06 05:40:22.988559 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:22.988479    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-669599797f-8djw8_b669f259-46f2-4810-b18f-7dfbf18bc86d/console/0.log"
Jun 06 05:40:23.492292 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.492255    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"]
Jun 06 05:40:23.497525 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.497493    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.505183 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.505116    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"]
Jun 06 05:40:23.564400 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.564361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-lib-modules\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.564601 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.564438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-podres\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.564601 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.564480    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-sys\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.564601 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.564560    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-proc\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.564797 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.564692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crd9f\" (UniqueName: \"kubernetes.io/projected/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-kube-api-access-crd9f\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.665729 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-podres\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-sys\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665766    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-proc\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crd9f\" (UniqueName: \"kubernetes.io/projected/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-kube-api-access-crd9f\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665842    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-sys\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665858    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-proc\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-lib-modules\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665891    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-podres\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.666164 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.665960    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-lib-modules\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.673276 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.673241    2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crd9f\" (UniqueName: \"kubernetes.io/projected/5b4e3174-8e7a-45fe-a6cc-e33faedbe39e-kube-api-access-crd9f\") pod \"perf-node-gather-daemonset-wfj74\" (UID: \"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e\") " pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.813075 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.813037    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:23.970790 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:23.970704    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"]
Jun 06 05:40:23.976259 ip-10-0-139-94 kubenswrapper[2568]: W0606 05:40:23.976223    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5b4e3174_8e7a_45fe_a6cc_e33faedbe39e.slice/crio-f567a2fd60570dda6c8467f529952f147d9e91e94c80b7a369fe11edca06595e WatchSource:0}: Error finding container f567a2fd60570dda6c8467f529952f147d9e91e94c80b7a369fe11edca06595e: Status 404 returned error can't find the container with id f567a2fd60570dda6c8467f529952f147d9e91e94c80b7a369fe11edca06595e
Jun 06 05:40:24.280577 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.280529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74" event={"ID":"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e","Type":"ContainerStarted","Data":"c35272ec423ff7864263f2bb203a58f15bd0ffb5d6a567e99541bd9428888823"}
Jun 06 05:40:24.280795 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.280611    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:24.280795 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.280640    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74" event={"ID":"5b4e3174-8e7a-45fe-a6cc-e33faedbe39e","Type":"ContainerStarted","Data":"f567a2fd60570dda6c8467f529952f147d9e91e94c80b7a369fe11edca06595e"}
Jun 06 05:40:24.295238 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.294601    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74" podStartSLOduration=1.294578075 podStartE2EDuration="1.294578075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 05:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 05:40:24.292987309 +0000 UTC m=+1886.340852979" watchObservedRunningTime="2026-06-06 05:40:24.294578075 +0000 UTC m=+1886.342443744"
Jun 06 05:40:24.411173 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.411144    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v9grf_f42df47c-6638-466f-b341-b0dbccbfa299/dns/0.log"
Jun 06 05:40:24.431183 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.431156    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v9grf_f42df47c-6638-466f-b341-b0dbccbfa299/kube-rbac-proxy/0.log"
Jun 06 05:40:24.452561 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.452537    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5knmq_db32dfd8-7a12-4e09-8afd-85acac271067/dns-node-resolver/0.log"
Jun 06 05:40:24.951596 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:24.951574    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtzwc_96e790f8-f227-4eb6-87ad-78214669307e/node-ca/0.log"
Jun 06 05:40:25.988026 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:25.987999    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-csrv7_4f79c52e-deb5-493c-a141-676094ef9597/serve-healthcheck-canary/0.log"
Jun 06 05:40:26.350133 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:26.350103    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctqd6_5a57686f-534d-4d73-8357-7a97f5d532ad/kube-rbac-proxy/0.log"
Jun 06 05:40:26.370323 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:26.370292    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctqd6_5a57686f-534d-4d73-8357-7a97f5d532ad/exporter/0.log"
Jun 06 05:40:26.394028 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:26.393999    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctqd6_5a57686f-534d-4d73-8357-7a97f5d532ad/extractor/0.log"
Jun 06 05:40:30.297245 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:30.297207    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9qq24/perf-node-gather-daemonset-wfj74"
Jun 06 05:40:30.298676 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:30.298635    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-wkx88_8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b/migrator/0.log"
Jun 06 05:40:30.324928 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:30.324900    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-wkx88_8a3d51d9-2bc6-4af6-a2cf-0e0baca9872b/graceful-termination/0.log"
Jun 06 05:40:31.474247 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.474217    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdx6l_d64bf082-4ce4-47ed-bb8f-4c5c1a915da7/kube-multus-additional-cni-plugins/0.log"
Jun 06 05:40:31.495616 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.495578    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdx6l_d64bf082-4ce4-47ed-bb8f-4c5c1a915da7/egress-router-binary-copy/0.log"
Jun 06 05:40:31.516363 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.516339    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdx6l_d64bf082-4ce4-47ed-bb8f-4c5c1a915da7/cni-plugins/0.log"
Jun 06 05:40:31.537781 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.537756    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdx6l_d64bf082-4ce4-47ed-bb8f-4c5c1a915da7/bond-cni-plugin/0.log"
Jun 06 05:40:31.559185 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.559154    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdx6l_d64bf082-4ce4-47ed-bb8f-4c5c1a915da7/routeoverride-cni/0.log"
Jun 06 05:40:31.582683 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.582640    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdx6l_d64bf082-4ce4-47ed-bb8f-4c5c1a915da7/whereabouts-cni-bincopy/0.log"
Jun 06 05:40:31.604710 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.604680    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pdx6l_d64bf082-4ce4-47ed-bb8f-4c5c1a915da7/whereabouts-cni/0.log"
Jun 06 05:40:31.833101 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.833065    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vz7gv_d7fb619c-a89f-4bf1-8252-be0daadaf38f/kube-multus/0.log"
Jun 06 05:40:31.893317 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.893283    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tmwx5_6b26181d-73f0-4e9c-9079-7a29e4e0d337/network-metrics-daemon/0.log"
Jun 06 05:40:31.913226 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:31.913197    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tmwx5_6b26181d-73f0-4e9c-9079-7a29e4e0d337/kube-rbac-proxy/0.log"
Jun 06 05:40:33.160819 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.160789    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-controller/0.log"
Jun 06 05:40:33.179037 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.179002    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/1.log"
Jun 06 05:40:33.179037 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.179020    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovn-acl-logging/0.log"
Jun 06 05:40:33.198586 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.198505    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/kube-rbac-proxy-node/0.log"
Jun 06 05:40:33.219026 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.218996    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/kube-rbac-proxy-ovn-metrics/0.log"
Jun 06 05:40:33.237411 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.237389    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/northd/0.log"
Jun 06 05:40:33.256959 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.256933    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/nbdb/0.log"
Jun 06 05:40:33.277387 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.277358    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/sbdb/0.log"
Jun 06 05:40:33.319427 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:33.319396    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt2fv_3a35b0fa-cf88-449d-a64a-a23dfad602a5/ovnkube-controller/0.log"
Jun 06 05:40:34.327101 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:34.327069    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nlgq9_fdbc123f-5509-4692-97c6-259afc83d9e1/network-check-target-container/0.log"
Jun 06 05:40:35.206444 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:35.206410    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-f4fft_15e36a6d-dccf-41b6-b9a0-9fe37a3817a1/iptables-alerter/0.log"
Jun 06 05:40:35.761237 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:35.761208    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cwm5c_d4c2d825-1373-498b-9e1b-9ef920cf7115/tuned/0.log"
Jun 06 05:40:39.047177 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:39.047147    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-p284f_1e371764-aab1-4b3c-b767-1e778d1bca51/csi-driver/0.log"
Jun 06 05:40:39.068207 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:39.068178    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-p284f_1e371764-aab1-4b3c-b767-1e778d1bca51/csi-node-driver-registrar/0.log"
Jun 06 05:40:39.088340 ip-10-0-139-94 kubenswrapper[2568]: I0606 05:40:39.088306    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-p284f_1e371764-aab1-4b3c-b767-1e778d1bca51/csi-liveness-probe/0.log"