Apr 24 14:21:33.076148 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Apr 24 14:21:33.076161 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Apr 24 14:21:33.076171 ip-10-0-143-187 systemd[1]: kubelet.service: Failed with result 'resources'. Apr 24 14:21:33.076478 ip-10-0-143-187 systemd[1]: Failed to start Kubernetes Kubelet. Apr 24 14:21:43.166366 ip-10-0-143-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Apr 24 14:21:43.166381 ip-10-0-143-187 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d8fdf45da7dc444898429fce78df41ab -- Apr 24 14:23:59.347447 ip-10-0-143-187 systemd[1]: Starting Kubernetes Kubelet... Apr 24 14:23:59.902993 ip-10-0-143-187 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 14:23:59.902993 ip-10-0-143-187 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 24 14:23:59.902993 ip-10-0-143-187 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 14:23:59.902993 ip-10-0-143-187 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 24 14:23:59.902993 ip-10-0-143-187 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 24 14:23:59.904197 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.903924 2577 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 24 14:23:59.908648 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908628 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 14:23:59.908648 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908648 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908653 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908656 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908660 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908663 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908666 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908669 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908672 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908675 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908678 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908686 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908689 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908692 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908694 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908697 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908700 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908702 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908705 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908708 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908710 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 14:23:59.908717 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908714 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908716 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908719 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908722 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908725 2577 feature_gate.go:328] unrecognized feature gate: Example Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908728 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908731 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908734 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908736 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908739 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908742 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908746 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908750 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908753 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908755 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908758 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908761 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908764 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908766 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 14:23:59.909212 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908770 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908774 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908777 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908781 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908784 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908786 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908789 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908792 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908795 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908798 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908800 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908803 2577 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908806 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908808 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908811 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908815 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908818 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908820 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908823 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908826 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 14:23:59.909669 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908829 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908832 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908834 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908837 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908840 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908842 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908845 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908848 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908850 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908852 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908855 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908858 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908860 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908863 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908865 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908868 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908870 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908873 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908876 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908878 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 14:23:59.910214 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908882 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908884 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908887 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908889 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908892 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.908894 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909296 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909302 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909305 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909309 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909311 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909314 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909317 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909320 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909322 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909325 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909328 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909331 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909333 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 14:23:59.910697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909336 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909338 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909341 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909344 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909347 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909349 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909352 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909356 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909360 2577 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909363 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909366 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909368 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909371 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909374 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909376 2577 feature_gate.go:328] unrecognized feature gate: Example Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909378 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909383 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909386 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909388 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 14:23:59.911167 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909391 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909394 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909398 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909400 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909403 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909405 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909408 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909411 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909413 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909416 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909419 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909421 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909424 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909426 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909429 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909431 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909434 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909437 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909439 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909442 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 14:23:59.911643 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909444 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909447 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909449 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909452 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909455 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909457 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909460 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909462 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909465 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909468 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909470 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909473 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909476 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909480 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909482 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909485 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909488 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909490 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909493 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 14:23:59.912155 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909496 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909498 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909501 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909504 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909506 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909509 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909511 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909513 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909516 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909518 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909521 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909524 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909527 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909529 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.909532 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909632 2577 flags.go:64] FLAG: --address="0.0.0.0" Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909640 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909647 2577 flags.go:64] FLAG: --anonymous-auth="true" Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909651 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909656 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909659 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 24 14:23:59.912616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909665 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909673 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909678 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909691 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909706 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909710 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909714 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909717 2577 flags.go:64] FLAG: --cgroup-root="" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909720 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909723 2577 flags.go:64] FLAG: --client-ca-file="" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909726 2577 flags.go:64] FLAG: --cloud-config="" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909729 2577 flags.go:64] FLAG: --cloud-provider="external" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909733 2577 flags.go:64] FLAG: --cluster-dns="[]" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909738 2577 flags.go:64] FLAG: --cluster-domain="" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909741 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909744 2577 flags.go:64] FLAG: --config-dir="" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909747 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909750 2577 flags.go:64] FLAG: --container-log-max-files="5" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909755 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909758 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909761 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909765 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909768 2577 flags.go:64] FLAG: --contention-profiling="false" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909771 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 24 14:23:59.913152 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909774 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909778 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909781 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909785 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909788 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909791 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909795 2577 flags.go:64] FLAG: --enable-load-reader="false" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909798 2577 flags.go:64] FLAG: --enable-server="true" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909801 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909806 2577 flags.go:64] FLAG: --event-burst="100" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909809 2577 flags.go:64] FLAG: --event-qps="50" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909812 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909815 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909819 2577 flags.go:64] FLAG: --eviction-hard="" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909823 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909826 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909829 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909833 2577 flags.go:64] FLAG: --eviction-soft="" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909836 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909839 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909842 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909845 2577 flags.go:64] FLAG: --experimental-mounter-path="" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909848 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909851 2577 flags.go:64] FLAG: --fail-swap-on="true" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909854 2577 flags.go:64] FLAG: --feature-gates="" Apr 24 14:23:59.913830 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909858 2577 flags.go:64] FLAG: --file-check-frequency="20s" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909861 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909864 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909868 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909871 2577 flags.go:64] FLAG: --healthz-port="10248" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909874 2577 flags.go:64] FLAG: --help="false" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909877 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-143-187.ec2.internal" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909881 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909884 2577 flags.go:64] FLAG: --http-check-frequency="20s" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909887 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909890 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909894 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909897 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909900 2577 flags.go:64] FLAG: --image-service-endpoint="" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909903 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909906 2577 flags.go:64] FLAG: --kube-api-burst="100" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909909 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909912 2577 flags.go:64] FLAG: --kube-api-qps="50" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909915 2577 flags.go:64] FLAG: --kube-reserved="" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909918 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909922 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909925 2577 flags.go:64] FLAG: --kubelet-cgroups="" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909928 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909931 2577 flags.go:64] FLAG: --lock-file="" Apr 24 14:23:59.914467 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909934 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909937 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909941 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909946 2577 flags.go:64] FLAG: --log-json-split-stream="false" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909949 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909952 2577 flags.go:64] FLAG: --log-text-split-stream="false" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909955 2577 flags.go:64] FLAG: --logging-format="text" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909958 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909961 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909964 2577 flags.go:64] FLAG: --manifest-url="" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909967 2577 flags.go:64] FLAG: --manifest-url-header="" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909971 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909974 2577 flags.go:64] FLAG: --max-open-files="1000000" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909978 2577 flags.go:64] FLAG: --max-pods="110" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909981 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909984 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909988 2577 flags.go:64] FLAG: --memory-manager-policy="None" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909991 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909994 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.909997 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910003 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910011 2577 flags.go:64] FLAG: --node-status-max-images="50" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910014 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910018 2577 flags.go:64] FLAG: --oom-score-adj="-999" Apr 24 14:23:59.915104 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910021 2577 flags.go:64] FLAG: --pod-cidr="" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910024 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910031 2577 flags.go:64] FLAG: --pod-manifest-path="" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910034 2577 flags.go:64] FLAG: --pod-max-pids="-1" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910038 2577 flags.go:64] FLAG: --pods-per-core="0" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910041 2577 flags.go:64] FLAG: --port="10250" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910044 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910047 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-065e33f136a771fed" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910051 2577 flags.go:64] FLAG: --qos-reserved="" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910054 2577 flags.go:64] FLAG: --read-only-port="10255" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910057 2577 flags.go:64] FLAG: --register-node="true" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910060 2577 flags.go:64] FLAG: --register-schedulable="true" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910063 2577 flags.go:64] FLAG: --register-with-taints="" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910070 2577 flags.go:64] FLAG: --registry-burst="10" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910073 2577 flags.go:64] FLAG: --registry-qps="5" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910076 2577 flags.go:64] FLAG: --reserved-cpus="" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910079 2577 flags.go:64] FLAG: --reserved-memory="" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910082 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910085 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910088 2577 flags.go:64] FLAG: --rotate-certificates="false" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910104 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910107 2577 flags.go:64] FLAG: --runonce="false" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910110 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910113 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910117 2577 flags.go:64] FLAG: --seccomp-default="false" Apr 24 14:23:59.915682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910120 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910123 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910127 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910131 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910134 2577 flags.go:64] FLAG: --storage-driver-password="root" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910138 2577 flags.go:64] FLAG: --storage-driver-secure="false" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910141 2577 flags.go:64] FLAG: --storage-driver-table="stats" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910143 2577 flags.go:64] FLAG: --storage-driver-user="root" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910147 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910150 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910153 2577 flags.go:64] FLAG: --system-cgroups="" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910156 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910166 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910169 2577 flags.go:64] FLAG: --tls-cert-file="" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910172 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910176 2577 flags.go:64] FLAG: --tls-min-version="" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910179 2577 flags.go:64] FLAG: --tls-private-key-file="" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910182 2577 flags.go:64] FLAG: --topology-manager-policy="none" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910185 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910188 2577 flags.go:64] FLAG: --topology-manager-scope="container" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910191 2577 flags.go:64] FLAG: --v="2" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910196 2577 flags.go:64] FLAG: --version="false" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910200 2577 flags.go:64] FLAG: --vmodule="" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910205 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.910208 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 24 14:23:59.916306 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910302 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910306 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910309 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910313 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910316 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910319 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910322 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910326 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910330 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910333 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910338 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910340 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910343 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910346 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910349 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910352 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910354 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910357 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910360 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 14:23:59.916907 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910364 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910367 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910370 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910372 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910375 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910378 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910381 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910383 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910386 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910389 2577 feature_gate.go:328] unrecognized feature gate: Example Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910392 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910394 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910397 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910399 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910402 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910405 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910407 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910410 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910413 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910415 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 14:23:59.917612 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910417 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910420 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910423 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910427 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910429 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910432 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910435 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910439 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910442 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910445 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910448 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910450 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910455 2577 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910458 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910460 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910463 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910466 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910468 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910471 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 14:23:59.918511 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910473 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910476 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910479 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910481 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910484 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910487 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910490 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910492 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910495 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910497 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910499 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910502 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910505 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910507 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910510 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910512 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910517 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910519 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910522 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910524 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 14:23:59.919110 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910527 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910529 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910532 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910534 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910537 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910541 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910544 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.910547 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 14:23:59.919610 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.911346 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 14:23:59.921150 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.921127 2577 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 24 14:23:59.921193 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.921151 2577 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 24 14:23:59.921227 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921209 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 14:23:59.921227 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921215 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 14:23:59.921227 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921219 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 14:23:59.921227 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921222 2577 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 14:23:59.921227 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921225 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 14:23:59.921227 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921228 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 14:23:59.921227 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921231 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921234 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921237 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921240 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921242 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921245 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921247 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921250 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921253 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921255 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921258 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921260 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921263 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921266 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921269 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921271 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921274 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921277 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921280 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 14:23:59.921404 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921283 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921285 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921288 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921290 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921293 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921295 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921298 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921301 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921304 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921306 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921309 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921312 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921314 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921317 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921319 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921322 2577 feature_gate.go:328] unrecognized feature gate: Example Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921326 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921330 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921333 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921336 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 14:23:59.921862 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921338 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921341 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921343 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921346 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921349 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921353 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921358 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921361 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921364 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921367 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921369 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921372 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921374 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921377 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921380 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921382 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921385 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921388 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921391 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 14:23:59.922422 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921394 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921396 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921399 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921402 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921405 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921407 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921410 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921413 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921416 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921419 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921421 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921424 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921427 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921430 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921432 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921435 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921438 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921440 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921443 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921445 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 14:23:59.922893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921448 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921451 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.921456 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921575 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921581 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921584 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921587 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921590 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921592 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921595 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921598 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921601 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921604 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921607 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921610 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 24 14:23:59.923517 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921612 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921615 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921618 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921620 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921624 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921626 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921629 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921632 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921634 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921637 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921640 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921643 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921645 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921648 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921650 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921653 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921655 2577 feature_gate.go:328] unrecognized feature gate: Example Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921658 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921660 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921663 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 24 14:23:59.923893 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921665 2577 feature_gate.go:328] unrecognized feature gate: Example2 Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921668 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921670 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921673 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921675 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921678 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921680 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921683 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921686 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921688 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921691 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921695 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921699 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921702 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921704 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921707 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921710 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921713 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921715 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 24 14:23:59.924429 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921718 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921721 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921723 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921726 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921730 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921732 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921735 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921737 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921740 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921743 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921745 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921748 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921750 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921753 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921756 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921758 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921761 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921764 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921766 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921769 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 24 14:23:59.924918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921771 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921774 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921776 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921780 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921783 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921786 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921789 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921791 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921794 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921796 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921799 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921801 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921804 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921806 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:23:59.921809 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 24 14:23:59.925436 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.921813 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 24 14:23:59.925803 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.922747 2577 server.go:962] "Client rotation is on, will bootstrap in background" Apr 24 14:23:59.925803 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.924933 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 24 14:23:59.926103 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.926078 2577 server.go:1019] "Starting client certificate rotation" Apr 24 14:23:59.926211 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.926191 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 24 14:23:59.926247 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.926238 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 24 14:23:59.955504 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.955480 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 24 14:23:59.958292 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.958272 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 24 14:23:59.982413 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.982386 2577 log.go:25] "Validated CRI v1 runtime API" Apr 24 14:23:59.986602 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.986581 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 24 14:23:59.988698 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.988682 2577 log.go:25] "Validated CRI v1 image API" Apr 24 14:23:59.989898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.989883 2577 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 24 14:23:59.996948 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.996922 2577 fs.go:135] Filesystem UUIDs: map[06c83273-7a99-4752-99be-153c9940509d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 83b7991c-e01c-4d95-9c79-85bf27d07f09:/dev/nvme0n1p3] Apr 24 14:23:59.996998 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:23:59.996949 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 24 14:24:00.003053 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.002945 2577 manager.go:217] Machine: {Timestamp:2026-04-24 14:24:00.000706402 +0000 UTC m=+0.513539020 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101617 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec230c9ac85d87f9106e7fb2482b4eb4 SystemUUID:ec230c9a-c85d-87f9-106e-7fb2482b4eb4 BootID:d8fdf45d-a7dc-4448-9842-9fce78df41ab Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:ff:e6:7d:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:ff:e6:7d:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:9b:4e:13:5d:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 24 14:24:00.003053 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.003048 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 24 14:24:00.003186 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.003145 2577 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 24 14:24:00.006282 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.006258 2577 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 24 14:24:00.006418 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.006284 2577 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 24 14:24:00.006468 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.006428 2577 topology_manager.go:138] "Creating topology manager with none policy" Apr 24 14:24:00.006468 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.006435 2577 container_manager_linux.go:306] "Creating device plugin manager" Apr 24 14:24:00.006468 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.006448 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 24 14:24:00.007511 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.007501 2577 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 24 14:24:00.009017 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.009007 2577 state_mem.go:36] "Initialized new in-memory state store" Apr 24 14:24:00.009168 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.009159 2577 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 24 14:24:00.009867 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.009848 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-phcnr" Apr 24 14:24:00.012064 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.012054 2577 kubelet.go:491] "Attempting to sync node with API server" Apr 24 14:24:00.012129 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.012067 2577 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 24 14:24:00.012129 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.012080 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 24 14:24:00.012129 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.012099 2577 kubelet.go:397] "Adding apiserver pod source" Apr 24 14:24:00.012129 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.012109 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 24 14:24:00.013179 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.013168 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 24 14:24:00.013225 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.013188 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 24 14:24:00.015265 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.015246 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-phcnr" Apr 24 14:24:00.016612 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.016590 2577 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 24 14:24:00.018359 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.018345 2577 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 24 14:24:00.020366 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020354 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 24 14:24:00.020366 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020372 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020378 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020384 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020389 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020395 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020401 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020408 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020419 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020427 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020445 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 24 14:24:00.020463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.020454 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 24 14:24:00.021594 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.021582 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 24 14:24:00.021594 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.021593 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 24 14:24:00.023348 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.023333 2577 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 14:24:00.023952 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.023936 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 14:24:00.026266 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.026252 2577 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 24 14:24:00.026318 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.026292 2577 server.go:1295] "Started kubelet" Apr 24 14:24:00.026417 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.026388 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 24 14:24:00.026488 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.026378 2577 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 24 14:24:00.026539 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.026508 2577 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 24 14:24:00.027202 ip-10-0-143-187 systemd[1]: Started Kubernetes Kubelet. Apr 24 14:24:00.031257 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.030482 2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-187.ec2.internal" not found Apr 24 14:24:00.031257 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.030543 2577 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 24 14:24:00.032308 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.032294 2577 server.go:317] "Adding debug handlers to kubelet server" Apr 24 14:24:00.036067 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.036047 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 24 14:24:00.036173 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.036074 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 24 14:24:00.036774 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.036756 2577 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 24 14:24:00.036774 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.036757 2577 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 24 14:24:00.036925 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.036787 2577 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 24 14:24:00.036925 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.036856 2577 reconstruct.go:97] "Volume reconstruction finished" Apr 24 14:24:00.036925 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.036868 2577 reconciler.go:26] "Reconciler: start to sync state" Apr 24 14:24:00.037460 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:00.037414 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-187.ec2.internal\" not found" Apr 24 14:24:00.037628 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.037604 2577 factory.go:55] Registering systemd factory Apr 24 14:24:00.037628 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.037630 2577 factory.go:223] Registration of the systemd container factory successfully Apr 24 14:24:00.037879 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.037851 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 14:24:00.038324 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.038305 2577 factory.go:153] Registering CRI-O factory Apr 24 14:24:00.038324 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.038326 2577 factory.go:223] Registration of the crio container factory successfully Apr 24 14:24:00.038476 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.038400 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 24 14:24:00.038610 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.038589 2577 factory.go:103] Registering Raw factory Apr 24 14:24:00.038705 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.038619 2577 manager.go:1196] Started watching for new ooms in manager Apr 24 14:24:00.039321 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.039306 2577 manager.go:319] Starting recovery of all containers Apr 24 14:24:00.040060 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:00.040038 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-187.ec2.internal\" not found" node="ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.045652 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.045560 2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-187.ec2.internal" not found Apr 24 14:24:00.050632 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.050617 2577 manager.go:324] Recovery completed Apr 24 14:24:00.055436 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.055423 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 14:24:00.057481 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.057467 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Apr 24 14:24:00.057546 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.057501 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 14:24:00.057546 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.057511 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Apr 24 14:24:00.058020 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.058008 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 24 14:24:00.058055 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.058020 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 24 14:24:00.058055 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.058039 2577 state_mem.go:36] "Initialized new in-memory state store" Apr 24 14:24:00.060128 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.060117 2577 policy_none.go:49] "None policy: Start" Apr 24 14:24:00.060165 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.060139 2577 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 24 14:24:00.060165 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.060150 2577 state_mem.go:35] "Initializing new in-memory state store" Apr 24 14:24:00.095690 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.095674 2577 manager.go:341] "Starting Device Plugin manager" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:00.095711 2577 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.095726 2577 server.go:85] "Starting device plugin registration server" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.095996 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.096011 2577 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.096128 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.096243 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.096253 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:00.096834 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:00.096874 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-187.ec2.internal\" not found" Apr 24 14:24:00.107784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.104475 2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-143-187.ec2.internal" not found Apr 24 14:24:00.137331 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.137295 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 24 14:24:00.138463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.138436 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 24 14:24:00.138463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.138462 2577 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 24 14:24:00.138609 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.138498 2577 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 24 14:24:00.138609 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.138506 2577 kubelet.go:2451] "Starting kubelet main sync loop" Apr 24 14:24:00.138609 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:00.138543 2577 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 24 14:24:00.142955 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.142938 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 14:24:00.196419 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.196331 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 24 14:24:00.197368 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.197344 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientMemory" Apr 24 14:24:00.197487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.197376 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasNoDiskPressure" Apr 24 14:24:00.197487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.197385 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeHasSufficientPID" Apr 24 14:24:00.197487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.197409 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.206350 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.206330 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.239058 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.239001 2577 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal"] Apr 24 14:24:00.241472 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.241448 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.241472 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.241468 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.272916 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.272895 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.277412 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.277395 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.291588 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.291570 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 24 14:24:00.373248 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.373216 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 24 14:24:00.438958 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.438931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5b2995dbd38a04e33ee46b3dbe014c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"b5b2995dbd38a04e33ee46b3dbe014c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.438958 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.438961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b2995dbd38a04e33ee46b3dbe014c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"b5b2995dbd38a04e33ee46b3dbe014c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.439147 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.438978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a8c5c56c9bc8e6777ce9cbd08c33017-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"2a8c5c56c9bc8e6777ce9cbd08c33017\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.539565 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.539492 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5b2995dbd38a04e33ee46b3dbe014c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"b5b2995dbd38a04e33ee46b3dbe014c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.539565 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.539525 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b2995dbd38a04e33ee46b3dbe014c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"b5b2995dbd38a04e33ee46b3dbe014c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.539565 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.539542 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a8c5c56c9bc8e6777ce9cbd08c33017-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"2a8c5c56c9bc8e6777ce9cbd08c33017\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.539729 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.539598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5b2995dbd38a04e33ee46b3dbe014c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"b5b2995dbd38a04e33ee46b3dbe014c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.539729 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.539651 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b2995dbd38a04e33ee46b3dbe014c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal\" (UID: \"b5b2995dbd38a04e33ee46b3dbe014c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.539729 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.539679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a8c5c56c9bc8e6777ce9cbd08c33017-config\") pod \"kube-apiserver-proxy-ip-10-0-143-187.ec2.internal\" (UID: \"2a8c5c56c9bc8e6777ce9cbd08c33017\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.593495 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.593469 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.677022 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.676995 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" Apr 24 14:24:00.926221 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.926139 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 24 14:24:00.926723 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.926299 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 24 14:24:00.926723 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.926309 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 24 14:24:00.926723 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:00.926318 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 24 14:24:01.012954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.012927 2577 apiserver.go:52] "Watching apiserver" Apr 24 14:24:01.016663 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.016619 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-23 14:19:00 +0000 UTC" deadline="2027-10-18 05:18:07.678821426 +0000 UTC" Apr 24 14:24:01.016663 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.016660 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12998h54m6.662165496s" Apr 24 14:24:01.020458 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.020441 2577 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 24 14:24:01.021904 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.021874 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-njhj7","openshift-network-operator/iptables-alerter-d9djn","kube-system/konnectivity-agent-m49gc","openshift-cluster-node-tuning-operator/tuned-k4cnh","openshift-dns/node-resolver-8rjmh","openshift-image-registry/node-ca-h86r5","openshift-multus/multus-rppr2","openshift-multus/network-metrics-daemon-fvgmc","openshift-ovn-kubernetes/ovnkube-node-kx6pv","kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal","openshift-multus/multus-additional-cni-plugins-tv87b"] Apr 24 14:24:01.023465 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.023445 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:01.023582 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.023523 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:01.024426 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.024411 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.025455 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.025436 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.026826 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.026808 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.026984 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.026965 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 24 14:24:01.027127 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.026981 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 24 14:24:01.027195 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.027169 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-862gl\"" Apr 24 14:24:01.027252 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.027232 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 24 14:24:01.028231 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.028214 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 24 14:24:01.028316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.028235 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fbpnt\"" Apr 24 14:24:01.028316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.028220 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 24 14:24:01.028900 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.028876 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hzp8q\"" Apr 24 14:24:01.028977 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.028929 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 24 14:24:01.029048 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.029033 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.029283 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.029267 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 24 14:24:01.030147 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.030110 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.031247 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.031231 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.031531 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.031340 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 24 14:24:01.031531 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.031363 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:01.031531 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.031369 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pmznq\"" Apr 24 14:24:01.031531 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.031437 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:01.031798 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.031782 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 24 14:24:01.032284 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.032269 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 24 14:24:01.032362 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.032287 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 24 14:24:01.032742 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.032723 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 24 14:24:01.032835 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.032772 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-96gr7\"" Apr 24 14:24:01.034534 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.034010 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 24 14:24:01.034534 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.034007 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 24 14:24:01.034534 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.034280 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 24 14:24:01.034722 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.034589 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.034775 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.034756 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 24 14:24:01.035818 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.035512 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mg2j4\"" Apr 24 14:24:01.036142 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.036051 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.036528 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.036510 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 24 14:24:01.037186 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.037164 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 24 14:24:01.038033 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038015 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.038359 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038340 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hb9sx\"" Apr 24 14:24:01.038437 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038376 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 24 14:24:01.038437 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038422 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 24 14:24:01.038537 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038449 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 24 14:24:01.038633 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038576 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 24 14:24:01.038633 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038624 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 24 14:24:01.038633 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.038629 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 24 14:24:01.039649 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.039632 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 24 14:24:01.039931 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.039913 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 24 14:24:01.040292 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040274 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-59jzc\"" Apr 24 14:24:01.040468 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040454 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 24 14:24:01.040542 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040516 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 24 14:24:01.040729 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv758\" (UniqueName: \"kubernetes.io/projected/ed2a96bf-5d4c-49fb-b377-94105ee5d017-kube-api-access-tv758\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.040794 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-host\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.040794 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040710 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kmxbf\"" Apr 24 14:24:01.040794 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-socket-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.040794 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0243e7c7-6f6f-41a6-a151-ae5c594532aa-agent-certs\") pod \"konnectivity-agent-m49gc\" (UID: \"0243e7c7-6f6f-41a6-a151-ae5c594532aa\") " pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-os-release\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-hostroot\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-etc-kubernetes\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-var-lib-kubelet\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-cni-netd\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a63313f9-269d-481f-b407-508d97a93776-tmp\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51abbf9b-3457-4508-a7e3-0f1a997126d8-cni-binary-copy\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-lib-modules\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-698n9\" (UniqueName: \"kubernetes.io/projected/a63313f9-269d-481f-b407-508d97a93776-kube-api-access-698n9\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.040991 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.040980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovnkube-config\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovn-node-metrics-cert\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-cni-multus\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-system-cni-dir\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28x42\" (UniqueName: \"kubernetes.io/projected/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-kube-api-access-28x42\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysconfig\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovnkube-script-lib\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvm96\" (UniqueName: \"kubernetes.io/projected/f73ebcb5-d903-4b07-b067-9ddd419fdf33-kube-api-access-pvm96\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cnibin\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-run\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-etc-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.041344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn855\" (UniqueName: \"kubernetes.io/projected/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-kube-api-access-gn855\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-systemd-units\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0243e7c7-6f6f-41a6-a151-ae5c594532aa-konnectivity-ca\") pod \"konnectivity-agent-m49gc\" (UID: \"0243e7c7-6f6f-41a6-a151-ae5c594532aa\") " pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-cnibin\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-conf-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-serviceca\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-system-cni-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-cni-bin\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-kubelet\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041635 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-systemd\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdvp\" (UniqueName: \"kubernetes.io/projected/0f07c588-4cdd-4779-a4bf-d23af3f3d566-kube-api-access-xmdvp\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-hosts-file\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9ck\" (UniqueName: \"kubernetes.io/projected/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-kube-api-access-hk9ck\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-socket-dir-parent\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.041898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041791 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w424m\" (UniqueName: \"kubernetes.io/projected/9caca091-9126-4a82-a6a4-88c3b7802e83-kube-api-access-w424m\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-host\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-registration-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-multus-certs\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9caca091-9126-4a82-a6a4-88c3b7802e83-iptables-alerter-script\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-modprobe-d\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-sys\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-node-log\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.041979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-cni-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-k8s-cni-cncf-io\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-tmp-dir\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-kubelet\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-run-netns\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-ovn\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-env-overrides\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.042638 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99czr\" (UniqueName: \"kubernetes.io/projected/51abbf9b-3457-4508-a7e3-0f1a997126d8-kube-api-access-99czr\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9caca091-9126-4a82-a6a4-88c3b7802e83-host-slash\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-kubernetes\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysctl-d\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a63313f9-269d-481f-b407-508d97a93776-etc-tuned\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-slash\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-sys-fs\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-var-lib-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-device-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-os-release\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysctl-conf\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-systemd\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.043297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-netns\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.043770 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-daemon-config\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.043770 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-log-socket\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.043770 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-run-ovn-kubernetes\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.043770 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.042871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-cni-bin\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.047463 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.047444 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 24 14:24:01.067234 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.067213 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqpp9" Apr 24 14:24:01.076725 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.076707 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqpp9" Apr 24 14:24:01.084587 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.084545 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b2995dbd38a04e33ee46b3dbe014c0.slice/crio-cc6138db2c9b43e051a2d95bd30ec50cd938252736cf4b9ea55f368bd402b94e WatchSource:0}: Error finding container cc6138db2c9b43e051a2d95bd30ec50cd938252736cf4b9ea55f368bd402b94e: Status 404 returned error can't find the container with id cc6138db2c9b43e051a2d95bd30ec50cd938252736cf4b9ea55f368bd402b94e Apr 24 14:24:01.084857 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.084834 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8c5c56c9bc8e6777ce9cbd08c33017.slice/crio-aa4c04d8a1f2668b30740af15edb6f302c644887bb793cd214d89ea6f2c4c655 WatchSource:0}: Error finding container aa4c04d8a1f2668b30740af15edb6f302c644887bb793cd214d89ea6f2c4c655: Status 404 returned error can't find the container with id aa4c04d8a1f2668b30740af15edb6f302c644887bb793cd214d89ea6f2c4c655 Apr 24 14:24:01.090281 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.090263 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 14:24:01.137453 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.137430 2577 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 24 14:24:01.140856 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.140814 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"b5b2995dbd38a04e33ee46b3dbe014c0","Type":"ContainerStarted","Data":"cc6138db2c9b43e051a2d95bd30ec50cd938252736cf4b9ea55f368bd402b94e"} Apr 24 14:24:01.141631 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.141602 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" event={"ID":"2a8c5c56c9bc8e6777ce9cbd08c33017","Type":"ContainerStarted","Data":"aa4c04d8a1f2668b30740af15edb6f302c644887bb793cd214d89ea6f2c4c655"} Apr 24 14:24:01.143863 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143845 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-kubernetes\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.143916 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143871 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysctl-d\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.143916 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143886 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a63313f9-269d-481f-b407-508d97a93776-etc-tuned\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.143916 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143905 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-slash\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143925 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-kubernetes\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143941 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-sys-fs\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143988 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-sys-fs\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.143987 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-var-lib-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysctl-d\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-var-lib-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-slash\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144036 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-device-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144062 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-os-release\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144063 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144079 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysctl-conf\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144112 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-systemd\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144140 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144155 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-os-release\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144161 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-systemd\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144165 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-netns\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-device-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144189 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-daemon-config\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysctl-conf\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-netns\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144218 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144208 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 24 14:24:01.144320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144257 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-log-socket\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144292 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-run-ovn-kubernetes\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-log-socket\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144327 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-cni-bin\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-run-ovn-kubernetes\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144359 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-cni-bin\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144385 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tv758\" (UniqueName: \"kubernetes.io/projected/ed2a96bf-5d4c-49fb-b377-94105ee5d017-kube-api-access-tv758\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144410 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-host\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144434 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-socket-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-host\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144456 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0243e7c7-6f6f-41a6-a151-ae5c594532aa-agent-certs\") pod \"konnectivity-agent-m49gc\" (UID: \"0243e7c7-6f6f-41a6-a151-ae5c594532aa\") " pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144478 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-os-release\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144493 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-hostroot\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144527 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-etc-kubernetes\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-socket-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-os-release\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-etc-kubernetes\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-hostroot\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.144997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144555 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-var-lib-kubelet\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144602 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-var-lib-kubelet\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144644 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-cni-netd\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144678 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a63313f9-269d-481f-b407-508d97a93776-tmp\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144687 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-cni-netd\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144710 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51abbf9b-3457-4508-a7e3-0f1a997126d8-cni-binary-copy\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144734 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-lib-modules\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144736 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-daemon-config\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144757 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-698n9\" (UniqueName: \"kubernetes.io/projected/a63313f9-269d-481f-b407-508d97a93776-kube-api-access-698n9\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144784 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovnkube-config\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144808 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovn-node-metrics-cert\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144832 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-cni-multus\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144858 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-system-cni-dir\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144882 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-lib-modules\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144884 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144927 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28x42\" (UniqueName: \"kubernetes.io/projected/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-kube-api-access-28x42\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144967 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysconfig\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.145876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.144994 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovnkube-script-lib\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145021 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvm96\" (UniqueName: \"kubernetes.io/projected/f73ebcb5-d903-4b07-b067-9ddd419fdf33-kube-api-access-pvm96\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145048 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cnibin\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145071 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-run\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145116 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-etc-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145142 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145167 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145192 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn855\" (UniqueName: \"kubernetes.io/projected/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-kube-api-access-gn855\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-system-cni-dir\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145216 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-systemd-units\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51abbf9b-3457-4508-a7e3-0f1a997126d8-cni-binary-copy\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-systemd-units\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145308 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-run\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-etc-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145387 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-sysconfig\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-cni-multus\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145510 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.146620 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145734 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cnibin\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovnkube-config\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145801 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0243e7c7-6f6f-41a6-a151-ae5c594532aa-konnectivity-ca\") pod \"konnectivity-agent-m49gc\" (UID: \"0243e7c7-6f6f-41a6-a151-ae5c594532aa\") " pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145827 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-cnibin\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145851 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-conf-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145873 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovnkube-script-lib\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145876 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-serviceca\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145926 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145954 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-system-cni-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-cnibin\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.145980 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-cni-bin\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146006 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-conf-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146025 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-kubelet\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146058 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-systemd\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146081 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-system-cni-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146086 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146139 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-openvswitch\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.147392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146147 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-cni-bin\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146176 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdvp\" (UniqueName: \"kubernetes.io/projected/0f07c588-4cdd-4779-a4bf-d23af3f3d566-kube-api-access-xmdvp\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146204 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-hosts-file\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.146227 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-kubelet\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.146308 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs podName:0f07c588-4cdd-4779-a4bf-d23af3f3d566 nodeName:}" failed. No retries permitted until 2026-04-24 14:24:01.646279852 +0000 UTC m=+2.159112441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs") pod "network-metrics-daemon-fvgmc" (UID: "0f07c588-4cdd-4779-a4bf-d23af3f3d566") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146302 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0243e7c7-6f6f-41a6-a151-ae5c594532aa-konnectivity-ca\") pod \"konnectivity-agent-m49gc\" (UID: \"0243e7c7-6f6f-41a6-a151-ae5c594532aa\") " pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146228 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9ck\" (UniqueName: \"kubernetes.io/projected/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-kube-api-access-hk9ck\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-systemd\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146356 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-socket-dir-parent\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-hosts-file\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146411 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w424m\" (UniqueName: \"kubernetes.io/projected/9caca091-9126-4a82-a6a4-88c3b7802e83-kube-api-access-w424m\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-socket-dir-parent\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146454 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-host\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146480 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-registration-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-host\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-registration-dir\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.148243 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146568 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-multus-certs\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146589 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9caca091-9126-4a82-a6a4-88c3b7802e83-iptables-alerter-script\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-multus-certs\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146610 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-modprobe-d\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146634 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-sys\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146661 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-node-log\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146685 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-cni-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146732 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-sys\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-multus-cni-dir\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146781 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-k8s-cni-cncf-io\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146809 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-node-log\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146850 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-tmp-dir\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146857 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-run-k8s-cni-cncf-io\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146891 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-kubelet\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146932 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-run-netns\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.146932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a63313f9-269d-481f-b407-508d97a93776-etc-modprobe-d\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147000 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51abbf9b-3457-4508-a7e3-0f1a997126d8-host-var-lib-kubelet\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.148693 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-host-run-netns\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-serviceca\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147153 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-ovn\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147179 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-env-overrides\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147203 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-tmp-dir\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147230 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99czr\" (UniqueName: \"kubernetes.io/projected/51abbf9b-3457-4508-a7e3-0f1a997126d8-kube-api-access-99czr\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147258 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147485 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f73ebcb5-d903-4b07-b067-9ddd419fdf33-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147568 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-cni-binary-copy\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147606 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed2a96bf-5d4c-49fb-b377-94105ee5d017-env-overrides\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147641 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed2a96bf-5d4c-49fb-b377-94105ee5d017-run-ovn\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147644 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9caca091-9126-4a82-a6a4-88c3b7802e83-host-slash\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147677 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9caca091-9126-4a82-a6a4-88c3b7802e83-host-slash\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.147879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9caca091-9126-4a82-a6a4-88c3b7802e83-iptables-alerter-script\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.148153 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0243e7c7-6f6f-41a6-a151-ae5c594532aa-agent-certs\") pod \"konnectivity-agent-m49gc\" (UID: \"0243e7c7-6f6f-41a6-a151-ae5c594532aa\") " pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.148171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a63313f9-269d-481f-b407-508d97a93776-tmp\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.149185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.148219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a63313f9-269d-481f-b407-508d97a93776-etc-tuned\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.149662 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.148342 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed2a96bf-5d4c-49fb-b377-94105ee5d017-ovn-node-metrics-cert\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.154881 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.154856 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 14:24:01.154984 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.154885 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 14:24:01.154984 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.154899 2577 projected.go:194] Error preparing data for projected volume kube-api-access-62d7b for pod openshift-network-diagnostics/network-check-target-njhj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:01.154984 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.154960 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b podName:31799aae-4d20-4f05-a6af-04f6e7fb0d6b nodeName:}" failed. No retries permitted until 2026-04-24 14:24:01.654940709 +0000 UTC m=+2.167773298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-62d7b" (UniqueName: "kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b") pod "network-check-target-njhj7" (UID: "31799aae-4d20-4f05-a6af-04f6e7fb0d6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:01.155359 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.155338 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv758\" (UniqueName: \"kubernetes.io/projected/ed2a96bf-5d4c-49fb-b377-94105ee5d017-kube-api-access-tv758\") pod \"ovnkube-node-kx6pv\" (UID: \"ed2a96bf-5d4c-49fb-b377-94105ee5d017\") " pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.156116 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.156080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn855\" (UniqueName: \"kubernetes.io/projected/d2cb5481-10b0-4339-b6ef-04e4e02e18f9-kube-api-access-gn855\") pod \"node-resolver-8rjmh\" (UID: \"d2cb5481-10b0-4339-b6ef-04e4e02e18f9\") " pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.156590 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.156565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99czr\" (UniqueName: \"kubernetes.io/projected/51abbf9b-3457-4508-a7e3-0f1a997126d8-kube-api-access-99czr\") pod \"multus-rppr2\" (UID: \"51abbf9b-3457-4508-a7e3-0f1a997126d8\") " pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.156590 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.156580 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w424m\" (UniqueName: \"kubernetes.io/projected/9caca091-9126-4a82-a6a4-88c3b7802e83-kube-api-access-w424m\") pod \"iptables-alerter-d9djn\" (UID: \"9caca091-9126-4a82-a6a4-88c3b7802e83\") " pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.156722 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.156675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvm96\" (UniqueName: \"kubernetes.io/projected/f73ebcb5-d903-4b07-b067-9ddd419fdf33-kube-api-access-pvm96\") pod \"aws-ebs-csi-driver-node-qrw7x\" (UID: \"f73ebcb5-d903-4b07-b067-9ddd419fdf33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.156914 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.156889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-698n9\" (UniqueName: \"kubernetes.io/projected/a63313f9-269d-481f-b407-508d97a93776-kube-api-access-698n9\") pod \"tuned-k4cnh\" (UID: \"a63313f9-269d-481f-b407-508d97a93776\") " pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.157219 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.157199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28x42\" (UniqueName: \"kubernetes.io/projected/cbc7782e-13cd-4b3b-9742-662bfb96c6fc-kube-api-access-28x42\") pod \"multus-additional-cni-plugins-tv87b\" (UID: \"cbc7782e-13cd-4b3b-9742-662bfb96c6fc\") " pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.157257 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.157217 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9ck\" (UniqueName: \"kubernetes.io/projected/2b2925e7-7ff4-4aa1-817e-9212a10cc8e1-kube-api-access-hk9ck\") pod \"node-ca-h86r5\" (UID: \"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1\") " pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.157559 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.157544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdvp\" (UniqueName: \"kubernetes.io/projected/0f07c588-4cdd-4779-a4bf-d23af3f3d566-kube-api-access-xmdvp\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:01.345795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.345767 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d9djn" Apr 24 14:24:01.352460 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.352419 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9caca091_9126_4a82_a6a4_88c3b7802e83.slice/crio-9441937fd3a7c1f4d5d9e38a10d2723a8173ffdae87059513089dbccd205163c WatchSource:0}: Error finding container 9441937fd3a7c1f4d5d9e38a10d2723a8173ffdae87059513089dbccd205163c: Status 404 returned error can't find the container with id 9441937fd3a7c1f4d5d9e38a10d2723a8173ffdae87059513089dbccd205163c Apr 24 14:24:01.366900 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.366873 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:01.373336 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.373305 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0243e7c7_6f6f_41a6_a151_ae5c594532aa.slice/crio-216455d26d8df13a26caa8c5b7a801d89e65fe9d29c66837e9a8c14792682eb3 WatchSource:0}: Error finding container 216455d26d8df13a26caa8c5b7a801d89e65fe9d29c66837e9a8c14792682eb3: Status 404 returned error can't find the container with id 216455d26d8df13a26caa8c5b7a801d89e65fe9d29c66837e9a8c14792682eb3 Apr 24 14:24:01.391422 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.391399 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" Apr 24 14:24:01.397087 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.397066 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8rjmh" Apr 24 14:24:01.397330 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.397309 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63313f9_269d_481f_b407_508d97a93776.slice/crio-9748773ed685efbeec2068a9dfb61adf6e3227b4cb289d8f0860cbbdb231d0ff WatchSource:0}: Error finding container 9748773ed685efbeec2068a9dfb61adf6e3227b4cb289d8f0860cbbdb231d0ff: Status 404 returned error can't find the container with id 9748773ed685efbeec2068a9dfb61adf6e3227b4cb289d8f0860cbbdb231d0ff Apr 24 14:24:01.402164 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.402142 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h86r5" Apr 24 14:24:01.404773 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.404751 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cb5481_10b0_4339_b6ef_04e4e02e18f9.slice/crio-cdb52405b3da3e16f3a952deba87c5bbccb2824a93a372ed0f5510078537aa50 WatchSource:0}: Error finding container cdb52405b3da3e16f3a952deba87c5bbccb2824a93a372ed0f5510078537aa50: Status 404 returned error can't find the container with id cdb52405b3da3e16f3a952deba87c5bbccb2824a93a372ed0f5510078537aa50 Apr 24 14:24:01.407812 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.407464 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rppr2" Apr 24 14:24:01.412646 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.412623 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:01.413065 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.413030 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2925e7_7ff4_4aa1_817e_9212a10cc8e1.slice/crio-fe78b6c5940ef88a8aae5107b6649a17d935c6eb201c5048b1bbe464029a1b24 WatchSource:0}: Error finding container fe78b6c5940ef88a8aae5107b6649a17d935c6eb201c5048b1bbe464029a1b24: Status 404 returned error can't find the container with id fe78b6c5940ef88a8aae5107b6649a17d935c6eb201c5048b1bbe464029a1b24 Apr 24 14:24:01.417733 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.417501 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" Apr 24 14:24:01.418505 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.418476 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51abbf9b_3457_4508_a7e3_0f1a997126d8.slice/crio-e587e4f6129582365dc72fe14f9fdb21f5809d1bf9db1da864139d6a844a02e5 WatchSource:0}: Error finding container e587e4f6129582365dc72fe14f9fdb21f5809d1bf9db1da864139d6a844a02e5: Status 404 returned error can't find the container with id e587e4f6129582365dc72fe14f9fdb21f5809d1bf9db1da864139d6a844a02e5 Apr 24 14:24:01.422544 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.422170 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tv87b" Apr 24 14:24:01.424192 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.424166 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2a96bf_5d4c_49fb_b377_94105ee5d017.slice/crio-66ea0eaf630b7728f5220d944e93666fc1fa63d81ff61c5eba170c5d696748f7 WatchSource:0}: Error finding container 66ea0eaf630b7728f5220d944e93666fc1fa63d81ff61c5eba170c5d696748f7: Status 404 returned error can't find the container with id 66ea0eaf630b7728f5220d944e93666fc1fa63d81ff61c5eba170c5d696748f7 Apr 24 14:24:01.428466 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.428435 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73ebcb5_d903_4b07_b067_9ddd419fdf33.slice/crio-ca28c5450aad0b906f16fa1b0f7c6639bfe095cb85e2741ae0cdc29ebc39b11b WatchSource:0}: Error finding container ca28c5450aad0b906f16fa1b0f7c6639bfe095cb85e2741ae0cdc29ebc39b11b: Status 404 returned error can't find the container with id ca28c5450aad0b906f16fa1b0f7c6639bfe095cb85e2741ae0cdc29ebc39b11b Apr 24 14:24:01.430823 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:01.430799 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc7782e_13cd_4b3b_9742_662bfb96c6fc.slice/crio-cec30aa3a88dc93b5d9f444fc1d63f92075a123f6fcacff084c4eeb207ca5385 WatchSource:0}: Error finding container cec30aa3a88dc93b5d9f444fc1d63f92075a123f6fcacff084c4eeb207ca5385: Status 404 returned error can't find the container with id cec30aa3a88dc93b5d9f444fc1d63f92075a123f6fcacff084c4eeb207ca5385 Apr 24 14:24:01.652205 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.651815 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:01.652205 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.651934 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:01.652205 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.652027 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs podName:0f07c588-4cdd-4779-a4bf-d23af3f3d566 nodeName:}" failed. No retries permitted until 2026-04-24 14:24:02.651988144 +0000 UTC m=+3.164820745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs") pod "network-metrics-daemon-fvgmc" (UID: "0f07c588-4cdd-4779-a4bf-d23af3f3d566") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:01.753418 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.752814 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:01.753418 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.752981 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 14:24:01.753418 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.753007 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 14:24:01.753418 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.753021 2577 projected.go:194] Error preparing data for projected volume kube-api-access-62d7b for pod openshift-network-diagnostics/network-check-target-njhj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:01.753418 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:01.753075 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b podName:31799aae-4d20-4f05-a6af-04f6e7fb0d6b nodeName:}" failed. No retries permitted until 2026-04-24 14:24:02.753058174 +0000 UTC m=+3.265890762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-62d7b" (UniqueName: "kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b") pod "network-check-target-njhj7" (UID: "31799aae-4d20-4f05-a6af-04f6e7fb0d6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:01.995965 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:01.995907 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 14:24:02.077478 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.077436 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 14:19:01 +0000 UTC" deadline="2027-10-30 21:00:49.827821601 +0000 UTC" Apr 24 14:24:02.077478 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.077475 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13302h36m47.750350208s" Apr 24 14:24:02.137944 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.137621 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 14:24:02.158127 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.158067 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerStarted","Data":"cec30aa3a88dc93b5d9f444fc1d63f92075a123f6fcacff084c4eeb207ca5385"} Apr 24 14:24:02.167623 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.167587 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" event={"ID":"f73ebcb5-d903-4b07-b067-9ddd419fdf33","Type":"ContainerStarted","Data":"ca28c5450aad0b906f16fa1b0f7c6639bfe095cb85e2741ae0cdc29ebc39b11b"} Apr 24 14:24:02.173556 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.173518 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"66ea0eaf630b7728f5220d944e93666fc1fa63d81ff61c5eba170c5d696748f7"} Apr 24 14:24:02.186691 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.186620 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h86r5" event={"ID":"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1","Type":"ContainerStarted","Data":"fe78b6c5940ef88a8aae5107b6649a17d935c6eb201c5048b1bbe464029a1b24"} Apr 24 14:24:02.198552 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.198495 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8rjmh" event={"ID":"d2cb5481-10b0-4339-b6ef-04e4e02e18f9","Type":"ContainerStarted","Data":"cdb52405b3da3e16f3a952deba87c5bbccb2824a93a372ed0f5510078537aa50"} Apr 24 14:24:02.207133 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.207055 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" event={"ID":"a63313f9-269d-481f-b407-508d97a93776","Type":"ContainerStarted","Data":"9748773ed685efbeec2068a9dfb61adf6e3227b4cb289d8f0860cbbdb231d0ff"} Apr 24 14:24:02.209829 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.209782 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m49gc" event={"ID":"0243e7c7-6f6f-41a6-a151-ae5c594532aa","Type":"ContainerStarted","Data":"216455d26d8df13a26caa8c5b7a801d89e65fe9d29c66837e9a8c14792682eb3"} Apr 24 14:24:02.213916 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.213638 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rppr2" event={"ID":"51abbf9b-3457-4508-a7e3-0f1a997126d8","Type":"ContainerStarted","Data":"e587e4f6129582365dc72fe14f9fdb21f5809d1bf9db1da864139d6a844a02e5"} Apr 24 14:24:02.217278 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.217256 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9djn" event={"ID":"9caca091-9126-4a82-a6a4-88c3b7802e83","Type":"ContainerStarted","Data":"9441937fd3a7c1f4d5d9e38a10d2723a8173ffdae87059513089dbccd205163c"} Apr 24 14:24:02.231888 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.231864 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 24 14:24:02.659644 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.659603 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:02.659824 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:02.659756 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:02.659894 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:02.659826 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs podName:0f07c588-4cdd-4779-a4bf-d23af3f3d566 nodeName:}" failed. No retries permitted until 2026-04-24 14:24:04.659806794 +0000 UTC m=+5.172639385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs") pod "network-metrics-daemon-fvgmc" (UID: "0f07c588-4cdd-4779-a4bf-d23af3f3d566") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:02.760586 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:02.760547 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:02.761120 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:02.760760 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 14:24:02.761120 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:02.760785 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 14:24:02.761120 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:02.760799 2577 projected.go:194] Error preparing data for projected volume kube-api-access-62d7b for pod openshift-network-diagnostics/network-check-target-njhj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:02.761120 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:02.760859 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b podName:31799aae-4d20-4f05-a6af-04f6e7fb0d6b nodeName:}" failed. No retries permitted until 2026-04-24 14:24:04.760840271 +0000 UTC m=+5.273672857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-62d7b" (UniqueName: "kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b") pod "network-check-target-njhj7" (UID: "31799aae-4d20-4f05-a6af-04f6e7fb0d6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:03.077700 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:03.077621 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-23 14:19:01 +0000 UTC" deadline="2027-10-26 22:58:01.764097226 +0000 UTC" Apr 24 14:24:03.077700 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:03.077658 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13208h33m58.686442932s" Apr 24 14:24:03.140397 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:03.139633 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:03.140397 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:03.139756 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:03.140397 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:03.140202 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:03.140397 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:03.140309 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:04.679650 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:04.679029 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:04.679650 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:04.679211 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:04.679650 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:04.679287 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs podName:0f07c588-4cdd-4779-a4bf-d23af3f3d566 nodeName:}" failed. No retries permitted until 2026-04-24 14:24:08.679267556 +0000 UTC m=+9.192100156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs") pod "network-metrics-daemon-fvgmc" (UID: "0f07c588-4cdd-4779-a4bf-d23af3f3d566") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:04.780237 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:04.780183 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:04.780428 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:04.780350 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 14:24:04.780428 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:04.780377 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 14:24:04.780428 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:04.780390 2577 projected.go:194] Error preparing data for projected volume kube-api-access-62d7b for pod openshift-network-diagnostics/network-check-target-njhj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:04.780574 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:04.780458 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b podName:31799aae-4d20-4f05-a6af-04f6e7fb0d6b nodeName:}" failed. No retries permitted until 2026-04-24 14:24:08.780439613 +0000 UTC m=+9.293272215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-62d7b" (UniqueName: "kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b") pod "network-check-target-njhj7" (UID: "31799aae-4d20-4f05-a6af-04f6e7fb0d6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:05.139883 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:05.139207 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:05.139883 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:05.139574 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:05.140174 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:05.139890 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:05.140174 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:05.139998 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:07.139492 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:07.139455 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:07.139964 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:07.139595 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:07.139964 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:07.139455 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:07.139964 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:07.139716 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:07.980128 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:07.980080 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gclmc"] Apr 24 14:24:07.984452 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:07.984162 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:07.984452 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:07.984239 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:08.107808 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.107758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd6b3902-a06e-4b22-b7f0-5990d385525e-dbus\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.107808 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.107793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.108040 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.107826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd6b3902-a06e-4b22-b7f0-5990d385525e-kubelet-config\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.208922 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.208885 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd6b3902-a06e-4b22-b7f0-5990d385525e-kubelet-config\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.209440 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.209000 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd6b3902-a06e-4b22-b7f0-5990d385525e-dbus\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.209440 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.209037 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.209440 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.209161 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:08.209440 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.209216 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret podName:dd6b3902-a06e-4b22-b7f0-5990d385525e nodeName:}" failed. No retries permitted until 2026-04-24 14:24:08.709197539 +0000 UTC m=+9.222030137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret") pod "global-pull-secret-syncer-gclmc" (UID: "dd6b3902-a06e-4b22-b7f0-5990d385525e") : object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:08.209634 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.209493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd6b3902-a06e-4b22-b7f0-5990d385525e-kubelet-config\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.209728 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.209653 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd6b3902-a06e-4b22-b7f0-5990d385525e-dbus\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.714344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.713596 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:08.714344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.713696 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:08.714344 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.713849 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:08.714344 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.713915 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:08.714344 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.713948 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs podName:0f07c588-4cdd-4779-a4bf-d23af3f3d566 nodeName:}" failed. No retries permitted until 2026-04-24 14:24:16.71389911 +0000 UTC m=+17.226731708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs") pod "network-metrics-daemon-fvgmc" (UID: "0f07c588-4cdd-4779-a4bf-d23af3f3d566") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:08.714344 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.713968 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret podName:dd6b3902-a06e-4b22-b7f0-5990d385525e nodeName:}" failed. No retries permitted until 2026-04-24 14:24:09.713957999 +0000 UTC m=+10.226790586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret") pod "global-pull-secret-syncer-gclmc" (UID: "dd6b3902-a06e-4b22-b7f0-5990d385525e") : object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:08.814546 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:08.814509 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:08.814746 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.814714 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 14:24:08.814746 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.814733 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 14:24:08.814883 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.814754 2577 projected.go:194] Error preparing data for projected volume kube-api-access-62d7b for pod openshift-network-diagnostics/network-check-target-njhj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:08.814883 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:08.814816 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b podName:31799aae-4d20-4f05-a6af-04f6e7fb0d6b nodeName:}" failed. No retries permitted until 2026-04-24 14:24:16.814796181 +0000 UTC m=+17.327628779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-62d7b" (UniqueName: "kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b") pod "network-check-target-njhj7" (UID: "31799aae-4d20-4f05-a6af-04f6e7fb0d6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:09.139652 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:09.138954 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:09.139652 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:09.139104 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:09.139652 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:09.139474 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:09.139652 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:09.139557 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:09.722113 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:09.722067 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:09.722527 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:09.722202 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:09.722527 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:09.722265 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret podName:dd6b3902-a06e-4b22-b7f0-5990d385525e nodeName:}" failed. No retries permitted until 2026-04-24 14:24:11.722249849 +0000 UTC m=+12.235082450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret") pod "global-pull-secret-syncer-gclmc" (UID: "dd6b3902-a06e-4b22-b7f0-5990d385525e") : object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:10.140107 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:10.139647 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:10.140107 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:10.139748 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:11.138724 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:11.138690 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:11.139149 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:11.138690 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:11.139149 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:11.138804 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:11.139149 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:11.138887 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:11.736528 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:11.736487 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:11.736725 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:11.736657 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:11.736786 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:11.736737 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret podName:dd6b3902-a06e-4b22-b7f0-5990d385525e nodeName:}" failed. No retries permitted until 2026-04-24 14:24:15.736716385 +0000 UTC m=+16.249548985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret") pod "global-pull-secret-syncer-gclmc" (UID: "dd6b3902-a06e-4b22-b7f0-5990d385525e") : object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:12.139589 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:12.139501 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:12.140019 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:12.139648 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:13.139316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:13.139277 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:13.139493 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:13.139278 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:13.139493 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:13.139428 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:13.139613 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:13.139486 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:14.139075 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:14.139037 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:14.139265 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:14.139166 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:15.138990 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:15.138957 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:15.139443 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:15.139065 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:15.139443 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:15.138960 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:15.139443 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:15.139183 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:15.770296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:15.770254 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:15.770464 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:15.770407 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:15.770507 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:15.770485 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret podName:dd6b3902-a06e-4b22-b7f0-5990d385525e nodeName:}" failed. No retries permitted until 2026-04-24 14:24:23.770462043 +0000 UTC m=+24.283294646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret") pod "global-pull-secret-syncer-gclmc" (UID: "dd6b3902-a06e-4b22-b7f0-5990d385525e") : object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:16.139557 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:16.139479 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:16.139975 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:16.139602 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:16.776507 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:16.776467 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:16.776723 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:16.776587 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:16.776723 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:16.776642 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs podName:0f07c588-4cdd-4779-a4bf-d23af3f3d566 nodeName:}" failed. No retries permitted until 2026-04-24 14:24:32.776626259 +0000 UTC m=+33.289458849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs") pod "network-metrics-daemon-fvgmc" (UID: "0f07c588-4cdd-4779-a4bf-d23af3f3d566") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:16.876807 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:16.876772 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:16.876969 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:16.876919 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 14:24:16.876969 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:16.876936 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 14:24:16.876969 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:16.876948 2577 projected.go:194] Error preparing data for projected volume kube-api-access-62d7b for pod openshift-network-diagnostics/network-check-target-njhj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:16.877082 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:16.877011 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b podName:31799aae-4d20-4f05-a6af-04f6e7fb0d6b nodeName:}" failed. No retries permitted until 2026-04-24 14:24:32.876992816 +0000 UTC m=+33.389825414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-62d7b" (UniqueName: "kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b") pod "network-check-target-njhj7" (UID: "31799aae-4d20-4f05-a6af-04f6e7fb0d6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:17.139573 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:17.139496 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:17.139965 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:17.139496 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:17.139965 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:17.139621 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:17.139965 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:17.139709 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:18.139220 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:18.139189 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:18.139415 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:18.139320 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:19.138781 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:19.138758 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:19.139058 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:19.138764 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:19.139058 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:19.138849 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:19.139058 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:19.138926 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:20.140580 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.139876 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:20.140580 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:20.140278 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:20.255228 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.254976 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" event={"ID":"a63313f9-269d-481f-b407-508d97a93776","Type":"ContainerStarted","Data":"f345d5786c871c586d2f2f9048c53f4add952d51661a2c87ad816c36d4ef86ea"} Apr 24 14:24:20.256371 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.256345 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m49gc" event={"ID":"0243e7c7-6f6f-41a6-a151-ae5c594532aa","Type":"ContainerStarted","Data":"d9c60fb89516c5f1876de8af9702abbfde7aa8bb2c6b940eb4209ed754b48748"} Apr 24 14:24:20.257607 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.257586 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" event={"ID":"2a8c5c56c9bc8e6777ce9cbd08c33017","Type":"ContainerStarted","Data":"c23f301a0126c4262030798469ba058f54049ebb7381072cdb7fc9f3fbb72d53"} Apr 24 14:24:20.258964 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.258943 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rppr2" event={"ID":"51abbf9b-3457-4508-a7e3-0f1a997126d8","Type":"ContainerStarted","Data":"557da7d8f24d03c68d3edce9104f80b1b7a77ccbc1050b45a68efc8d32ffee45"} Apr 24 14:24:20.260312 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.260292 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"b5b2995dbd38a04e33ee46b3dbe014c0","Type":"ContainerStarted","Data":"c01b988e2fb11ec1bc3cc0b69c66714ac2b2c936457baae85b9c6ef5964b2bcb"} Apr 24 14:24:20.262805 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.262786 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:24:20.263142 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.263122 2577 generic.go:358] "Generic (PLEG): container finished" podID="ed2a96bf-5d4c-49fb-b377-94105ee5d017" containerID="63df16f894edd3a56a4e710bbf942e1898e09fb3088678beb7db6a8c3e6f54fa" exitCode=1 Apr 24 14:24:20.263217 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.263154 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"32ea80f30d9290003dfb19fa006cd84965c6aea29938ba3ec65c67fee2404502"} Apr 24 14:24:20.263217 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.263169 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"292a8fc7ca8d3781e333772398ff372b15837ed62214b1fdd8a72de2dd25e9da"} Apr 24 14:24:20.263217 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.263179 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"2db435944c3222d7016bc06aaf3b8c4a570a5aa9ce723d74843b14d17754298c"} Apr 24 14:24:20.263217 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.263187 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"3bc897759a329070f07a84e8e9d83efd5779497c05d8a1d0406ef30c97e58adf"} Apr 24 14:24:20.263217 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.263195 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerDied","Data":"63df16f894edd3a56a4e710bbf942e1898e09fb3088678beb7db6a8c3e6f54fa"} Apr 24 14:24:20.263217 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.263204 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"3822ece7fdbd77be0d12077a1380e8fca1843ee1ba554061733bfb581a95fb76"} Apr 24 14:24:20.271085 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.271039 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k4cnh" podStartSLOduration=2.492824365 podStartE2EDuration="20.271028311s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.399724882 +0000 UTC m=+1.912557468" lastFinishedPulling="2026-04-24 14:24:19.177928824 +0000 UTC m=+19.690761414" observedRunningTime="2026-04-24 14:24:20.270814077 +0000 UTC m=+20.783646677" watchObservedRunningTime="2026-04-24 14:24:20.271028311 +0000 UTC m=+20.783860915" Apr 24 14:24:20.287184 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.287146 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-rppr2" podStartSLOduration=2.172986042 podStartE2EDuration="20.287134194s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.422617341 +0000 UTC m=+1.935449936" lastFinishedPulling="2026-04-24 14:24:19.536765498 +0000 UTC m=+20.049598088" observedRunningTime="2026-04-24 14:24:20.286607917 +0000 UTC m=+20.799440524" watchObservedRunningTime="2026-04-24 14:24:20.287134194 +0000 UTC m=+20.799966802" Apr 24 14:24:20.299667 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.299623 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-187.ec2.internal" podStartSLOduration=20.299609343 podStartE2EDuration="20.299609343s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 14:24:20.29949774 +0000 UTC m=+20.812330348" watchObservedRunningTime="2026-04-24 14:24:20.299609343 +0000 UTC m=+20.812441950" Apr 24 14:24:20.333854 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:20.333803 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m49gc" podStartSLOduration=2.591453149 podStartE2EDuration="20.333787942s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.374723202 +0000 UTC m=+1.887555788" lastFinishedPulling="2026-04-24 14:24:19.117057981 +0000 UTC m=+19.629890581" observedRunningTime="2026-04-24 14:24:20.333500184 +0000 UTC m=+20.846332795" watchObservedRunningTime="2026-04-24 14:24:20.333787942 +0000 UTC m=+20.846620550" Apr 24 14:24:21.138897 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.138870 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:21.139029 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.138869 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:21.139029 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:21.138987 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:21.139139 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:21.139037 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:21.181950 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.181908 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 24 14:24:21.222855 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.222823 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:21.266705 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.266677 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" event={"ID":"f73ebcb5-d903-4b07-b067-9ddd419fdf33","Type":"ContainerStarted","Data":"8a33098ae9e39d0f68f150c62b6bb536d041b0bb5ba00fab9534f31cda2b8c75"} Apr 24 14:24:21.266813 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.266714 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" event={"ID":"f73ebcb5-d903-4b07-b067-9ddd419fdf33","Type":"ContainerStarted","Data":"d4af015fe2f60db5dd8e177f065cc70082f0bb786ac78bfca26d23353beac2b9"} Apr 24 14:24:21.267880 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.267853 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h86r5" event={"ID":"2b2925e7-7ff4-4aa1-817e-9212a10cc8e1","Type":"ContainerStarted","Data":"a913417b2381a78db1f66df3998060a337b1786ea6db0e875fd70007fc8e761e"} Apr 24 14:24:21.268940 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.268915 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8rjmh" event={"ID":"d2cb5481-10b0-4339-b6ef-04e4e02e18f9","Type":"ContainerStarted","Data":"b2efe122f5a34d943cd73bc6215f785c5b32bf365fb3a11ccb2bef086546d971"} Apr 24 14:24:21.270045 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.270027 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d9djn" event={"ID":"9caca091-9126-4a82-a6a4-88c3b7802e83","Type":"ContainerStarted","Data":"332bd8d848f257f11bb208aa29cbf7c37688cc905cc9245cd7e22a9654af6371"} Apr 24 14:24:21.271277 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.271255 2577 generic.go:358] "Generic (PLEG): container finished" podID="b5b2995dbd38a04e33ee46b3dbe014c0" containerID="c01b988e2fb11ec1bc3cc0b69c66714ac2b2c936457baae85b9c6ef5964b2bcb" exitCode=0 Apr 24 14:24:21.271347 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.271331 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"b5b2995dbd38a04e33ee46b3dbe014c0","Type":"ContainerDied","Data":"c01b988e2fb11ec1bc3cc0b69c66714ac2b2c936457baae85b9c6ef5964b2bcb"} Apr 24 14:24:21.272597 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.272579 2577 generic.go:358] "Generic (PLEG): container finished" podID="cbc7782e-13cd-4b3b-9742-662bfb96c6fc" containerID="d04a4d7f06b03389887cd920ade678ea7968f0386906f59dfd61eda3b11b2394" exitCode=0 Apr 24 14:24:21.272676 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.272609 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerDied","Data":"d04a4d7f06b03389887cd920ade678ea7968f0386906f59dfd61eda3b11b2394"} Apr 24 14:24:21.282982 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.282947 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h86r5" podStartSLOduration=3.520887585 podStartE2EDuration="21.282936123s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.414900737 +0000 UTC m=+1.927733323" lastFinishedPulling="2026-04-24 14:24:19.176949261 +0000 UTC m=+19.689781861" observedRunningTime="2026-04-24 14:24:21.282828221 +0000 UTC m=+21.795660828" watchObservedRunningTime="2026-04-24 14:24:21.282936123 +0000 UTC m=+21.795768731" Apr 24 14:24:21.343525 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.343420 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d9djn" podStartSLOduration=3.518489041 podStartE2EDuration="21.343404472s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.354582139 +0000 UTC m=+1.867414738" lastFinishedPulling="2026-04-24 14:24:19.179497572 +0000 UTC m=+19.692330169" observedRunningTime="2026-04-24 14:24:21.343384201 +0000 UTC m=+21.856216832" watchObservedRunningTime="2026-04-24 14:24:21.343404472 +0000 UTC m=+21.856237062" Apr 24 14:24:21.361138 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:21.361084 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-8rjmh" podStartSLOduration=3.592657316 podStartE2EDuration="21.361072121s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.407611311 +0000 UTC m=+1.920443900" lastFinishedPulling="2026-04-24 14:24:19.176026107 +0000 UTC m=+19.688858705" observedRunningTime="2026-04-24 14:24:21.360966414 +0000 UTC m=+21.873799022" watchObservedRunningTime="2026-04-24 14:24:21.361072121 +0000 UTC m=+21.873904729" Apr 24 14:24:22.036439 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.036396 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:22.037162 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.037077 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:22.108694 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.108591 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-24T14:24:21.181927511Z","UUID":"e47aa695-d43d-42a0-bf27-2f822ea5c6b7","Handler":null,"Name":"","Endpoint":""} Apr 24 14:24:22.110168 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.110150 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 24 14:24:22.110168 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.110174 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 24 14:24:22.138886 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.138803 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:22.139032 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:22.138923 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:22.275808 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.275771 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" event={"ID":"b5b2995dbd38a04e33ee46b3dbe014c0","Type":"ContainerStarted","Data":"b24f503767ed599bde00cef57b9bdf247a1ec365e3eaacddc9a272ed8118238c"} Apr 24 14:24:22.277793 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.277761 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" event={"ID":"f73ebcb5-d903-4b07-b067-9ddd419fdf33","Type":"ContainerStarted","Data":"2083faf7b95a2a4c836b62d7a6dc9b4b95b696c3afdcdbbf584726303270dd73"} Apr 24 14:24:22.280720 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.280703 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:24:22.281133 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.281084 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"90fe990f1c68c75a186740ad098b15bebd5b369849841f25b9c5a4358e718a8e"} Apr 24 14:24:22.282157 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.282141 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m49gc" Apr 24 14:24:22.318525 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.318479 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-187.ec2.internal" podStartSLOduration=22.318467016 podStartE2EDuration="22.318467016s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 14:24:22.297047601 +0000 UTC m=+22.809880211" watchObservedRunningTime="2026-04-24 14:24:22.318467016 +0000 UTC m=+22.831299624" Apr 24 14:24:22.342946 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:22.342899 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrw7x" podStartSLOduration=1.8308555659999999 podStartE2EDuration="22.342886854s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.430235446 +0000 UTC m=+1.943068039" lastFinishedPulling="2026-04-24 14:24:21.942266725 +0000 UTC m=+22.455099327" observedRunningTime="2026-04-24 14:24:22.342383102 +0000 UTC m=+22.855215709" watchObservedRunningTime="2026-04-24 14:24:22.342886854 +0000 UTC m=+22.855719461" Apr 24 14:24:23.139378 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:23.139343 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:23.139571 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:23.139343 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:23.139571 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:23.139474 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:23.139686 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:23.139578 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:23.834392 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:23.834169 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:23.834784 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:23.834309 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:23.834784 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:23.834509 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret podName:dd6b3902-a06e-4b22-b7f0-5990d385525e nodeName:}" failed. No retries permitted until 2026-04-24 14:24:39.8344923 +0000 UTC m=+40.347324909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret") pod "global-pull-secret-syncer-gclmc" (UID: "dd6b3902-a06e-4b22-b7f0-5990d385525e") : object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:24.139441 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:24.139361 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:24.139602 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:24.139483 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:25.138920 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:25.138887 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:25.139531 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:25.138891 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:25.139531 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:25.139004 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:25.139531 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:25.139154 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:26.139719 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.139538 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:26.140448 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:26.139814 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:26.289776 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.289739 2577 generic.go:358] "Generic (PLEG): container finished" podID="cbc7782e-13cd-4b3b-9742-662bfb96c6fc" containerID="85a86a7dabbfdd62038e500b31c064c94b58e61753bec0046887edaba2501abc" exitCode=0 Apr 24 14:24:26.289947 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.289829 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerDied","Data":"85a86a7dabbfdd62038e500b31c064c94b58e61753bec0046887edaba2501abc"} Apr 24 14:24:26.293002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.292984 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:24:26.293327 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.293302 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"c90d75ba2c130004fe3709c4ee486cd2c35ba4b365714e9dcf5282a72da130c1"} Apr 24 14:24:26.293623 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.293599 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:26.293729 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.293632 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:26.293814 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.293739 2577 scope.go:117] "RemoveContainer" containerID="63df16f894edd3a56a4e710bbf942e1898e09fb3088678beb7db6a8c3e6f54fa" Apr 24 14:24:26.308898 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:26.308875 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:27.139063 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.139025 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:27.139063 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.139063 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:27.139286 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:27.139181 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:27.139333 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:27.139307 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:27.299599 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.299563 2577 generic.go:358] "Generic (PLEG): container finished" podID="cbc7782e-13cd-4b3b-9742-662bfb96c6fc" containerID="39bc8c39350043bc80bfd1e488bd464e2d3429641963aec68faf135a95c2aa2d" exitCode=0 Apr 24 14:24:27.300044 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.299609 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerDied","Data":"39bc8c39350043bc80bfd1e488bd464e2d3429641963aec68faf135a95c2aa2d"} Apr 24 14:24:27.302790 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.302771 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:24:27.303141 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.303118 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" event={"ID":"ed2a96bf-5d4c-49fb-b377-94105ee5d017","Type":"ContainerStarted","Data":"2333ff4534d39230e16253acc67455a0f3c1a4c025ab88e92dea548d08893cd7"} Apr 24 14:24:27.303432 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.303412 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:27.317241 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.317221 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:27.353986 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:27.353940 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" podStartSLOduration=9.559068026 podStartE2EDuration="27.353928124s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.426192647 +0000 UTC m=+1.939025233" lastFinishedPulling="2026-04-24 14:24:19.221052731 +0000 UTC m=+19.733885331" observedRunningTime="2026-04-24 14:24:27.353576931 +0000 UTC m=+27.866409539" watchObservedRunningTime="2026-04-24 14:24:27.353928124 +0000 UTC m=+27.866760766" Apr 24 14:24:28.139150 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:28.139076 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:28.139281 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:28.139191 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:28.307278 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:28.307236 2577 generic.go:358] "Generic (PLEG): container finished" podID="cbc7782e-13cd-4b3b-9742-662bfb96c6fc" containerID="0392f97bc326479b3a2de8b73aa6cf571362406e430ce71d950e616d07ba09e2" exitCode=0 Apr 24 14:24:28.307698 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:28.307321 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerDied","Data":"0392f97bc326479b3a2de8b73aa6cf571362406e430ce71d950e616d07ba09e2"} Apr 24 14:24:29.138963 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:29.138924 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:29.139206 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:29.138933 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:29.139206 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:29.139033 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:29.139206 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:29.139149 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:30.139843 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:30.139809 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:30.140279 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:30.139919 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:31.138868 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:31.138831 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:31.139059 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:31.138831 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:31.139059 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:31.138957 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:31.139218 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:31.139066 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:32.138953 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:32.138911 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:32.139432 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:32.139028 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:32.805713 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:32.805677 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:32.805893 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:32.805867 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:32.805951 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:32.805943 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs podName:0f07c588-4cdd-4779-a4bf-d23af3f3d566 nodeName:}" failed. No retries permitted until 2026-04-24 14:25:04.805922237 +0000 UTC m=+65.318754838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs") pod "network-metrics-daemon-fvgmc" (UID: "0f07c588-4cdd-4779-a4bf-d23af3f3d566") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 24 14:24:32.906578 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:32.906549 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:32.906760 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:32.906728 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 24 14:24:32.906760 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:32.906751 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 24 14:24:32.906901 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:32.906763 2577 projected.go:194] Error preparing data for projected volume kube-api-access-62d7b for pod openshift-network-diagnostics/network-check-target-njhj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:32.906901 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:32.906816 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b podName:31799aae-4d20-4f05-a6af-04f6e7fb0d6b nodeName:}" failed. No retries permitted until 2026-04-24 14:25:04.906795267 +0000 UTC m=+65.419627865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-62d7b" (UniqueName: "kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b") pod "network-check-target-njhj7" (UID: "31799aae-4d20-4f05-a6af-04f6e7fb0d6b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 24 14:24:33.139363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:33.139224 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:33.139799 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:33.139378 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:33.139799 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:33.139428 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:33.139799 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:33.139576 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:34.139616 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:34.139509 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:34.139960 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:34.139637 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:34.321487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:34.321456 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerStarted","Data":"a7d28af12e047af0d787a2d469124cf5bd26985265742926980debd77d0a68ef"} Apr 24 14:24:35.139516 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:35.139485 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:35.139516 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:35.139516 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:35.139927 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:35.139575 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:35.139927 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:35.139688 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:35.327328 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:35.327291 2577 generic.go:358] "Generic (PLEG): container finished" podID="cbc7782e-13cd-4b3b-9742-662bfb96c6fc" containerID="a7d28af12e047af0d787a2d469124cf5bd26985265742926980debd77d0a68ef" exitCode=0 Apr 24 14:24:35.327487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:35.327328 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerDied","Data":"a7d28af12e047af0d787a2d469124cf5bd26985265742926980debd77d0a68ef"} Apr 24 14:24:36.139690 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:36.139660 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:36.142670 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:36.141022 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:36.331824 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:36.331789 2577 generic.go:358] "Generic (PLEG): container finished" podID="cbc7782e-13cd-4b3b-9742-662bfb96c6fc" containerID="de61c4d51cdfc484fcf4a7afaf6b5ee9714020270d5aa8c3145082f320b4fa51" exitCode=0 Apr 24 14:24:36.332007 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:36.331825 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerDied","Data":"de61c4d51cdfc484fcf4a7afaf6b5ee9714020270d5aa8c3145082f320b4fa51"} Apr 24 14:24:37.139574 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:37.139544 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:37.139743 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:37.139547 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:37.139743 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:37.139643 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:37.139743 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:37.139722 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:37.336614 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:37.336579 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tv87b" event={"ID":"cbc7782e-13cd-4b3b-9742-662bfb96c6fc","Type":"ContainerStarted","Data":"1b7cb9d4c666f64f8ab8e514d19d7e027e3406e3478522765fd3877824740f78"} Apr 24 14:24:37.358941 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:37.358885 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tv87b" podStartSLOduration=4.689598566 podStartE2EDuration="37.358871652s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:24:01.432879848 +0000 UTC m=+1.945712436" lastFinishedPulling="2026-04-24 14:24:34.102152934 +0000 UTC m=+34.614985522" observedRunningTime="2026-04-24 14:24:37.357623882 +0000 UTC m=+37.870456491" watchObservedRunningTime="2026-04-24 14:24:37.358871652 +0000 UTC m=+37.871704256" Apr 24 14:24:38.138987 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:38.138947 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:38.139186 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:38.139108 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:39.139263 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:39.139229 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:39.139621 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:39.139230 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:39.139621 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:39.139430 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:39.139621 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:39.139329 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:39.863062 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:39.863015 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:39.863242 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:39.863196 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:39.863290 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:39.863264 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret podName:dd6b3902-a06e-4b22-b7f0-5990d385525e nodeName:}" failed. No retries permitted until 2026-04-24 14:25:11.863245272 +0000 UTC m=+72.376077859 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret") pod "global-pull-secret-syncer-gclmc" (UID: "dd6b3902-a06e-4b22-b7f0-5990d385525e") : object "kube-system"/"original-pull-secret" not registered Apr 24 14:24:40.139833 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:40.139758 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:40.140195 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:40.139881 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:40.628133 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:40.628083 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njhj7"] Apr 24 14:24:40.628311 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:40.628216 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:40.628376 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:40.628320 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:40.633654 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:40.633626 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvgmc"] Apr 24 14:24:40.633783 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:40.633727 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:40.633860 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:40.633837 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:40.634482 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:40.634456 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gclmc"] Apr 24 14:24:40.634573 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:40.634542 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:40.634674 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:40.634649 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:42.139200 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:42.139171 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:42.140016 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:42.139299 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:42.140016 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:42.139316 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:42.140016 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:42.139414 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:42.140016 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:42.139462 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:42.140016 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:42.139525 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:44.138940 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:44.138906 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:44.139378 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:44.138906 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:44.139378 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:44.139013 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-njhj7" podUID="31799aae-4d20-4f05-a6af-04f6e7fb0d6b" Apr 24 14:24:44.139378 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:44.138906 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:44.139378 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:44.139111 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvgmc" podUID="0f07c588-4cdd-4779-a4bf-d23af3f3d566" Apr 24 14:24:44.139378 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:44.139201 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gclmc" podUID="dd6b3902-a06e-4b22-b7f0-5990d385525e" Apr 24 14:24:44.296199 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:44.296172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8rjmh_d2cb5481-10b0-4339-b6ef-04e4e02e18f9/dns-node-resolver/0.log" Apr 24 14:24:45.282718 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.282691 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-187.ec2.internal" event="NodeReady" Apr 24 14:24:45.283157 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.282802 2577 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 24 14:24:45.284626 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.284608 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h86r5_2b2925e7-7ff4-4aa1-817e-9212a10cc8e1/node-ca/0.log" Apr 24 14:24:45.317906 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.317879 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66c9d7f6bb-ptns5"] Apr 24 14:24:45.370369 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.370336 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jdk56"] Apr 24 14:24:45.370515 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.370481 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.373340 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.373318 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Apr 24 14:24:45.373460 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.373373 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfj9f\"" Apr 24 14:24:45.373460 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.373318 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Apr 24 14:24:45.373460 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.373318 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Apr 24 14:24:45.378143 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.378123 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Apr 24 14:24:45.388255 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.388234 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66c9d7f6bb-ptns5"] Apr 24 14:24:45.388356 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.388266 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5jn2n"] Apr 24 14:24:45.388356 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.388274 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.391302 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.391280 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 24 14:24:45.391413 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.391360 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 24 14:24:45.391413 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.391390 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vrfmr\"" Apr 24 14:24:45.403171 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-ca-trust-extracted\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.403274 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-registry-tls\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.403274 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-installation-pull-secrets\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.403349 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-trusted-ca\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.403403 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-image-registry-private-configuration\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.403500 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gp5m\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-kube-api-access-7gp5m\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.403500 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-bound-sa-token\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.403500 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.403462 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-registry-certificates\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.406253 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.406236 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jdk56"] Apr 24 14:24:45.406344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.406258 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jn2n"] Apr 24 14:24:45.406400 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.406382 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.408765 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.408743 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 24 14:24:45.408765 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.408773 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 24 14:24:45.408937 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.408746 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9tl5g\"" Apr 24 14:24:45.408937 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.408748 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 24 14:24:45.503726 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.503688 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-ca-trust-extracted\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.503726 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.503728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f881448e-a5ef-4cb5-a379-fa149299394b-cert\") pod \"ingress-canary-5jn2n\" (UID: \"f881448e-a5ef-4cb5-a379-fa149299394b\") " pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.503982 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.503748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b5abfa-6cab-43b2-9877-4ac806e03f9d-tmp-dir\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.503982 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.503767 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-registry-tls\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.503982 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.503825 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-installation-pull-secrets\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.503982 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.503979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfdng\" (UniqueName: \"kubernetes.io/projected/23b5abfa-6cab-43b2-9877-4ac806e03f9d-kube-api-access-bfdng\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.504223 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504017 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-trusted-ca\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.504223 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504056 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-image-registry-private-configuration\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.504223 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504073 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gp5m\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-kube-api-access-7gp5m\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.504223 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23b5abfa-6cab-43b2-9877-4ac806e03f9d-metrics-tls\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.504223 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504154 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-bound-sa-token\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.504223 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-ca-trust-extracted\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.504486 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504350 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-registry-certificates\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.504486 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ldgf\" (UniqueName: \"kubernetes.io/projected/f881448e-a5ef-4cb5-a379-fa149299394b-kube-api-access-2ldgf\") pod \"ingress-canary-5jn2n\" (UID: \"f881448e-a5ef-4cb5-a379-fa149299394b\") " pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.504486 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.504428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23b5abfa-6cab-43b2-9877-4ac806e03f9d-config-volume\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.505113 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.505078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-trusted-ca\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.505225 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.505122 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-registry-certificates\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.508170 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.507971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-installation-pull-secrets\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.508170 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.507996 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-image-registry-private-configuration\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.508342 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.508321 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-registry-tls\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.514056 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.514035 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-bound-sa-token\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.514707 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.514690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gp5m\" (UniqueName: \"kubernetes.io/projected/5a209e20-3a84-4e4d-9c4a-8ef8626232c3-kube-api-access-7gp5m\") pod \"image-registry-66c9d7f6bb-ptns5\" (UID: \"5a209e20-3a84-4e4d-9c4a-8ef8626232c3\") " pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.605481 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605371 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f881448e-a5ef-4cb5-a379-fa149299394b-cert\") pod \"ingress-canary-5jn2n\" (UID: \"f881448e-a5ef-4cb5-a379-fa149299394b\") " pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.605481 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605408 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b5abfa-6cab-43b2-9877-4ac806e03f9d-tmp-dir\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.605481 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605440 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfdng\" (UniqueName: \"kubernetes.io/projected/23b5abfa-6cab-43b2-9877-4ac806e03f9d-kube-api-access-bfdng\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.605481 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605475 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23b5abfa-6cab-43b2-9877-4ac806e03f9d-metrics-tls\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.605794 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605506 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ldgf\" (UniqueName: \"kubernetes.io/projected/f881448e-a5ef-4cb5-a379-fa149299394b-kube-api-access-2ldgf\") pod \"ingress-canary-5jn2n\" (UID: \"f881448e-a5ef-4cb5-a379-fa149299394b\") " pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.605794 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605521 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23b5abfa-6cab-43b2-9877-4ac806e03f9d-config-volume\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.605880 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23b5abfa-6cab-43b2-9877-4ac806e03f9d-tmp-dir\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.606002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.605987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23b5abfa-6cab-43b2-9877-4ac806e03f9d-config-volume\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.608030 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.608003 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23b5abfa-6cab-43b2-9877-4ac806e03f9d-metrics-tls\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.608030 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.608004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f881448e-a5ef-4cb5-a379-fa149299394b-cert\") pod \"ingress-canary-5jn2n\" (UID: \"f881448e-a5ef-4cb5-a379-fa149299394b\") " pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.616384 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.616364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfdng\" (UniqueName: \"kubernetes.io/projected/23b5abfa-6cab-43b2-9877-4ac806e03f9d-kube-api-access-bfdng\") pod \"dns-default-jdk56\" (UID: \"23b5abfa-6cab-43b2-9877-4ac806e03f9d\") " pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.616477 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.616439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ldgf\" (UniqueName: \"kubernetes.io/projected/f881448e-a5ef-4cb5-a379-fa149299394b-kube-api-access-2ldgf\") pod \"ingress-canary-5jn2n\" (UID: \"f881448e-a5ef-4cb5-a379-fa149299394b\") " pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.679285 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.679253 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:45.706408 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.706381 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:45.729070 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.729040 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jn2n" Apr 24 14:24:45.856646 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.856573 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jdk56"] Apr 24 14:24:45.859703 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.859682 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66c9d7f6bb-ptns5"] Apr 24 14:24:45.860973 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:45.860948 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b5abfa_6cab_43b2_9877_4ac806e03f9d.slice/crio-034b2e323223cc7ecbcc5579e4fc91783f23b05eb93305a8cb85b7588b9265e5 WatchSource:0}: Error finding container 034b2e323223cc7ecbcc5579e4fc91783f23b05eb93305a8cb85b7588b9265e5: Status 404 returned error can't find the container with id 034b2e323223cc7ecbcc5579e4fc91783f23b05eb93305a8cb85b7588b9265e5 Apr 24 14:24:45.862589 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:45.862566 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jn2n"] Apr 24 14:24:45.863999 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:45.863953 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a209e20_3a84_4e4d_9c4a_8ef8626232c3.slice/crio-bc4e68c7353cf527ca67ce30c7a0c57635334d0dcb1240f710ca910c82127405 WatchSource:0}: Error finding container bc4e68c7353cf527ca67ce30c7a0c57635334d0dcb1240f710ca910c82127405: Status 404 returned error can't find the container with id bc4e68c7353cf527ca67ce30c7a0c57635334d0dcb1240f710ca910c82127405 Apr 24 14:24:45.866213 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:45.866188 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf881448e_a5ef_4cb5_a379_fa149299394b.slice/crio-921e4ee333baa8fb705a784a017e5592bc7fd3730db8efa010db407ab5bf0789 WatchSource:0}: Error finding container 921e4ee333baa8fb705a784a017e5592bc7fd3730db8efa010db407ab5bf0789: Status 404 returned error can't find the container with id 921e4ee333baa8fb705a784a017e5592bc7fd3730db8efa010db407ab5bf0789 Apr 24 14:24:46.139271 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.139195 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:24:46.139271 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.139229 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:24:46.139271 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.139235 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:24:46.142037 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.142002 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 24 14:24:46.142200 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.142047 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 24 14:24:46.143023 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.143001 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 24 14:24:46.143023 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.143015 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 24 14:24:46.143215 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.143025 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qmh6n\"" Apr 24 14:24:46.143215 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.143008 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2dnd\"" Apr 24 14:24:46.355210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.355175 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jn2n" event={"ID":"f881448e-a5ef-4cb5-a379-fa149299394b","Type":"ContainerStarted","Data":"921e4ee333baa8fb705a784a017e5592bc7fd3730db8efa010db407ab5bf0789"} Apr 24 14:24:46.356046 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.356025 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdk56" event={"ID":"23b5abfa-6cab-43b2-9877-4ac806e03f9d","Type":"ContainerStarted","Data":"034b2e323223cc7ecbcc5579e4fc91783f23b05eb93305a8cb85b7588b9265e5"} Apr 24 14:24:46.357145 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.357125 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" event={"ID":"5a209e20-3a84-4e4d-9c4a-8ef8626232c3","Type":"ContainerStarted","Data":"1f649ff394ecb394adc5274384b36628b27438074e8a66beff594e2ea9319973"} Apr 24 14:24:46.357219 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.357149 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" event={"ID":"5a209e20-3a84-4e4d-9c4a-8ef8626232c3","Type":"ContainerStarted","Data":"bc4e68c7353cf527ca67ce30c7a0c57635334d0dcb1240f710ca910c82127405"} Apr 24 14:24:46.357335 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.357321 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:24:46.377516 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:46.377338 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" podStartSLOduration=7.377316309 podStartE2EDuration="7.377316309s" podCreationTimestamp="2026-04-24 14:24:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 14:24:46.377265924 +0000 UTC m=+46.890098534" watchObservedRunningTime="2026-04-24 14:24:46.377316309 +0000 UTC m=+46.890148916" Apr 24 14:24:47.203320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.203286 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h94ff"] Apr 24 14:24:47.217556 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.217520 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h94ff"] Apr 24 14:24:47.217701 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.217672 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.220515 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.220444 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 24 14:24:47.220515 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.220444 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 24 14:24:47.220719 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.220492 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 24 14:24:47.220719 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.220494 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 24 14:24:47.221676 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.221554 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gwkgg\"" Apr 24 14:24:47.320783 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.320746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khj48\" (UniqueName: \"kubernetes.io/projected/39845295-b5c6-484b-ab3a-d6e711d1259c-kube-api-access-khj48\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.320958 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.320820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39845295-b5c6-484b-ab3a-d6e711d1259c-crio-socket\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.320958 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.320859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39845295-b5c6-484b-ab3a-d6e711d1259c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.320958 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.320947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39845295-b5c6-484b-ab3a-d6e711d1259c-data-volume\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.321132 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.321052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39845295-b5c6-484b-ab3a-d6e711d1259c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.421818 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.421782 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39845295-b5c6-484b-ab3a-d6e711d1259c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.422316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.421847 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khj48\" (UniqueName: \"kubernetes.io/projected/39845295-b5c6-484b-ab3a-d6e711d1259c-kube-api-access-khj48\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.422316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.421892 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39845295-b5c6-484b-ab3a-d6e711d1259c-crio-socket\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.422316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.422140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39845295-b5c6-484b-ab3a-d6e711d1259c-crio-socket\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.422316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.422138 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39845295-b5c6-484b-ab3a-d6e711d1259c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.422316 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.422288 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39845295-b5c6-484b-ab3a-d6e711d1259c-data-volume\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.422594 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.422563 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39845295-b5c6-484b-ab3a-d6e711d1259c-data-volume\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.422664 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.422647 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39845295-b5c6-484b-ab3a-d6e711d1259c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.425373 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.425357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39845295-b5c6-484b-ab3a-d6e711d1259c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.429817 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.429793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khj48\" (UniqueName: \"kubernetes.io/projected/39845295-b5c6-484b-ab3a-d6e711d1259c-kube-api-access-khj48\") pod \"insights-runtime-extractor-h94ff\" (UID: \"39845295-b5c6-484b-ab3a-d6e711d1259c\") " pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:47.529308 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:47.529226 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h94ff" Apr 24 14:24:48.406785 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:48.406758 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h94ff"] Apr 24 14:24:48.409918 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:48.409894 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39845295_b5c6_484b_ab3a_d6e711d1259c.slice/crio-619d1785cc7c83f7f839c89602eda09db8bf1a9cbaa6610017c5d1b44abb3290 WatchSource:0}: Error finding container 619d1785cc7c83f7f839c89602eda09db8bf1a9cbaa6610017c5d1b44abb3290: Status 404 returned error can't find the container with id 619d1785cc7c83f7f839c89602eda09db8bf1a9cbaa6610017c5d1b44abb3290 Apr 24 14:24:49.367545 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.367293 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jn2n" event={"ID":"f881448e-a5ef-4cb5-a379-fa149299394b","Type":"ContainerStarted","Data":"877914a24e83c9256e9d0521055fa83b5912404dc761734bc2815018b02e68e6"} Apr 24 14:24:49.368792 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.368772 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdk56" event={"ID":"23b5abfa-6cab-43b2-9877-4ac806e03f9d","Type":"ContainerStarted","Data":"99605635260fca1eaba6cb3449340381977c3bc5371bd66a4965cfab78230b8f"} Apr 24 14:24:49.368868 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.368800 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdk56" event={"ID":"23b5abfa-6cab-43b2-9877-4ac806e03f9d","Type":"ContainerStarted","Data":"486a0cd3ae00ed2f3535228f1ba85ead326794728acb35ce0c495c3c3905f880"} Apr 24 14:24:49.368915 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.368882 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jdk56" Apr 24 14:24:49.369943 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.369922 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h94ff" event={"ID":"39845295-b5c6-484b-ab3a-d6e711d1259c","Type":"ContainerStarted","Data":"523fffd573bbb4a38de4646d9fb7fd44d06f3e569e9685b4c90865b7b469422b"} Apr 24 14:24:49.370036 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.369950 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h94ff" event={"ID":"39845295-b5c6-484b-ab3a-d6e711d1259c","Type":"ContainerStarted","Data":"619d1785cc7c83f7f839c89602eda09db8bf1a9cbaa6610017c5d1b44abb3290"} Apr 24 14:24:49.383229 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.383193 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5jn2n" podStartSLOduration=1.967392658 podStartE2EDuration="4.383181991s" podCreationTimestamp="2026-04-24 14:24:45 +0000 UTC" firstStartedPulling="2026-04-24 14:24:45.869539927 +0000 UTC m=+46.382372515" lastFinishedPulling="2026-04-24 14:24:48.285329255 +0000 UTC m=+48.798161848" observedRunningTime="2026-04-24 14:24:49.38266846 +0000 UTC m=+49.895501090" watchObservedRunningTime="2026-04-24 14:24:49.383181991 +0000 UTC m=+49.896014599" Apr 24 14:24:49.399003 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.398954 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jdk56" podStartSLOduration=1.981990126 podStartE2EDuration="4.398937817s" podCreationTimestamp="2026-04-24 14:24:45 +0000 UTC" firstStartedPulling="2026-04-24 14:24:45.863086559 +0000 UTC m=+46.375919145" lastFinishedPulling="2026-04-24 14:24:48.28003425 +0000 UTC m=+48.792866836" observedRunningTime="2026-04-24 14:24:49.398739368 +0000 UTC m=+49.911571976" watchObservedRunningTime="2026-04-24 14:24:49.398937817 +0000 UTC m=+49.911770426" Apr 24 14:24:49.882063 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.882011 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t7f6c"] Apr 24 14:24:49.910875 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.910806 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.913586 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.913562 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 24 14:24:49.913720 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.913590 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 24 14:24:49.913903 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.913880 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 24 14:24:49.913903 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.913901 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 24 14:24:49.914055 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.913912 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 24 14:24:49.914055 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.913915 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-72grf\"" Apr 24 14:24:49.914055 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.913926 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 24 14:24:49.941248 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941378 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttc4b\" (UniqueName: \"kubernetes.io/projected/42ea33ec-d4b8-4502-a44d-c5090664737b-kube-api-access-ttc4b\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941378 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ea33ec-d4b8-4502-a44d-c5090664737b-metrics-client-ca\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941378 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-sys\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941494 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-root\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941494 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941494 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-textfile\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941494 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-tls\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:49.941611 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:49.941500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-wtmp\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.041834 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.041796 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.041834 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.041836 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttc4b\" (UniqueName: \"kubernetes.io/projected/42ea33ec-d4b8-4502-a44d-c5090664737b-kube-api-access-ttc4b\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.041869 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ea33ec-d4b8-4502-a44d-c5090664737b-metrics-client-ca\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.041920 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-sys\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.041953 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-root\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.041988 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042014 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-textfile\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-sys\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042058 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-root\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042113 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-tls\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042151 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-wtmp\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042487 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:50.042258 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Apr 24 14:24:50.042487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042290 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-wtmp\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.042487 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:24:50.042350 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-tls podName:42ea33ec-d4b8-4502-a44d-c5090664737b nodeName:}" failed. No retries permitted until 2026-04-24 14:24:50.542327741 +0000 UTC m=+51.055160340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-tls") pod "node-exporter-t7f6c" (UID: "42ea33ec-d4b8-4502-a44d-c5090664737b") : secret "node-exporter-tls" not found Apr 24 14:24:50.042487 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042387 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-textfile\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.043000 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42ea33ec-d4b8-4502-a44d-c5090664737b-metrics-client-ca\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.043058 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.042979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.045531 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.045509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.055843 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.055820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttc4b\" (UniqueName: \"kubernetes.io/projected/42ea33ec-d4b8-4502-a44d-c5090664737b-kube-api-access-ttc4b\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.375452 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.375411 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h94ff" event={"ID":"39845295-b5c6-484b-ab3a-d6e711d1259c","Type":"ContainerStarted","Data":"f501b1cd1ed7f9811cbbe4afba53b256ed35a7a6d0efd7121cc7b1f8606b0893"} Apr 24 14:24:50.546866 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.546831 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-tls\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.549867 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.549837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/42ea33ec-d4b8-4502-a44d-c5090664737b-node-exporter-tls\") pod \"node-exporter-t7f6c\" (UID: \"42ea33ec-d4b8-4502-a44d-c5090664737b\") " pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:50.819849 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:50.819821 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t7f6c" Apr 24 14:24:51.103804 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:51.103772 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ea33ec_d4b8_4502_a44d_c5090664737b.slice/crio-0de79c7c8e5bc988556be2fe2df24ac79372c27678af5a20b79d7722383bfe9f WatchSource:0}: Error finding container 0de79c7c8e5bc988556be2fe2df24ac79372c27678af5a20b79d7722383bfe9f: Status 404 returned error can't find the container with id 0de79c7c8e5bc988556be2fe2df24ac79372c27678af5a20b79d7722383bfe9f Apr 24 14:24:51.380221 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.380115 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h94ff" event={"ID":"39845295-b5c6-484b-ab3a-d6e711d1259c","Type":"ContainerStarted","Data":"d1fe4fb5fdd4ccae1fe3ba256506c2ccca50e45a1e776d6c109d5ce0fbf502fc"} Apr 24 14:24:51.381355 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.381329 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7f6c" event={"ID":"42ea33ec-d4b8-4502-a44d-c5090664737b","Type":"ContainerStarted","Data":"0de79c7c8e5bc988556be2fe2df24ac79372c27678af5a20b79d7722383bfe9f"} Apr 24 14:24:51.400329 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.400281 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h94ff" podStartSLOduration=1.6949344 podStartE2EDuration="4.400265354s" podCreationTimestamp="2026-04-24 14:24:47 +0000 UTC" firstStartedPulling="2026-04-24 14:24:48.528370606 +0000 UTC m=+49.041203201" lastFinishedPulling="2026-04-24 14:24:51.23370157 +0000 UTC m=+51.746534155" observedRunningTime="2026-04-24 14:24:51.399645533 +0000 UTC m=+51.912478285" watchObservedRunningTime="2026-04-24 14:24:51.400265354 +0000 UTC m=+51.913097962" Apr 24 14:24:51.928149 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.928117 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b7f5db56f-vxgph"] Apr 24 14:24:51.931521 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.931500 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:51.934309 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.934287 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Apr 24 14:24:51.934407 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.934350 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2pvij136qhrn5\"" Apr 24 14:24:51.934465 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.934412 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Apr 24 14:24:51.934465 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.934421 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Apr 24 14:24:51.934597 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.934580 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Apr 24 14:24:51.934746 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.934717 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lbxtf\"" Apr 24 14:24:51.934853 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.934776 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Apr 24 14:24:51.954270 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:51.954246 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b7f5db56f-vxgph"] Apr 24 14:24:52.060220 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.060220 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060197 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.060437 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-tls\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.060437 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579e2c45-99e9-479b-9856-a3414c3f41cd-metrics-client-ca\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.060437 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kskdg\" (UniqueName: \"kubernetes.io/projected/579e2c45-99e9-479b-9856-a3414c3f41cd-kube-api-access-kskdg\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.060437 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.060566 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-grpc-tls\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.060566 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.060500 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.161623 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.161588 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.161805 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.161632 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-tls\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.161805 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.161655 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579e2c45-99e9-479b-9856-a3414c3f41cd-metrics-client-ca\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.161805 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.161716 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kskdg\" (UniqueName: \"kubernetes.io/projected/579e2c45-99e9-479b-9856-a3414c3f41cd-kube-api-access-kskdg\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.161805 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.161762 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.162026 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.161904 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-grpc-tls\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.162081 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.162028 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.162081 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.162076 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.162408 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.162374 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/579e2c45-99e9-479b-9856-a3414c3f41cd-metrics-client-ca\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.165067 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.165042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.165179 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.165140 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-grpc-tls\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.165295 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.165271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.165329 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.165287 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.165385 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.165370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-tls\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.165439 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.165425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/579e2c45-99e9-479b-9856-a3414c3f41cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.170177 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.170160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kskdg\" (UniqueName: \"kubernetes.io/projected/579e2c45-99e9-479b-9856-a3414c3f41cd-kube-api-access-kskdg\") pod \"thanos-querier-b7f5db56f-vxgph\" (UID: \"579e2c45-99e9-479b-9856-a3414c3f41cd\") " pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.292073 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.292040 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:52.385431 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.385396 2577 generic.go:358] "Generic (PLEG): container finished" podID="42ea33ec-d4b8-4502-a44d-c5090664737b" containerID="cbbe471b9a7f931185ed0f8a4d75318fcccaa887429630964147ff44cba7d134" exitCode=0 Apr 24 14:24:52.386036 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.385464 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7f6c" event={"ID":"42ea33ec-d4b8-4502-a44d-c5090664737b","Type":"ContainerDied","Data":"cbbe471b9a7f931185ed0f8a4d75318fcccaa887429630964147ff44cba7d134"} Apr 24 14:24:52.416124 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:52.415921 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b7f5db56f-vxgph"] Apr 24 14:24:52.419780 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:52.419758 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579e2c45_99e9_479b_9856_a3414c3f41cd.slice/crio-0e35b83aab0cf625c2353489c52ca8f5a50558a3a6fc1382052880b981cba7a0 WatchSource:0}: Error finding container 0e35b83aab0cf625c2353489c52ca8f5a50558a3a6fc1382052880b981cba7a0: Status 404 returned error can't find the container with id 0e35b83aab0cf625c2353489c52ca8f5a50558a3a6fc1382052880b981cba7a0 Apr 24 14:24:53.391624 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:53.391559 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" event={"ID":"579e2c45-99e9-479b-9856-a3414c3f41cd","Type":"ContainerStarted","Data":"0e35b83aab0cf625c2353489c52ca8f5a50558a3a6fc1382052880b981cba7a0"} Apr 24 14:24:53.394038 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:53.394007 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7f6c" event={"ID":"42ea33ec-d4b8-4502-a44d-c5090664737b","Type":"ContainerStarted","Data":"355acfe4eb7d796a35089e7de5ad50ab6d4cb67ac480342476c5201ecbc5d7fb"} Apr 24 14:24:53.394169 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:53.394044 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7f6c" event={"ID":"42ea33ec-d4b8-4502-a44d-c5090664737b","Type":"ContainerStarted","Data":"86190a985780461f1760e204c004cc2865785818a4d8e3828cce6e93d437a45c"} Apr 24 14:24:53.416910 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:53.416855 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t7f6c" podStartSLOduration=3.726743936 podStartE2EDuration="4.416839106s" podCreationTimestamp="2026-04-24 14:24:49 +0000 UTC" firstStartedPulling="2026-04-24 14:24:51.105508684 +0000 UTC m=+51.618341270" lastFinishedPulling="2026-04-24 14:24:51.795603841 +0000 UTC m=+52.308436440" observedRunningTime="2026-04-24 14:24:53.415208052 +0000 UTC m=+53.928040662" watchObservedRunningTime="2026-04-24 14:24:53.416839106 +0000 UTC m=+53.929671714" Apr 24 14:24:54.183496 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.183460 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-98dd848d8-wfxvz"] Apr 24 14:24:54.187115 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.187078 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.189997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.189975 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 24 14:24:54.189997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.189990 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 24 14:24:54.191394 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.191363 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 24 14:24:54.191513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.191418 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 24 14:24:54.191513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.191429 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2jz9b\"" Apr 24 14:24:54.191625 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.191548 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ecs59jephrnih\"" Apr 24 14:24:54.194755 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.194533 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-98dd848d8-wfxvz"] Apr 24 14:24:54.283500 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.283455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-secret-metrics-server-tls\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.283500 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.283506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07a1b2cc-f524-4934-b9d8-f47e59937cc1-audit-log\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.283730 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.283617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwp7z\" (UniqueName: \"kubernetes.io/projected/07a1b2cc-f524-4934-b9d8-f47e59937cc1-kube-api-access-hwp7z\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.283730 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.283662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07a1b2cc-f524-4934-b9d8-f47e59937cc1-metrics-server-audit-profiles\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.283815 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.283739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-secret-metrics-server-client-certs\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.283815 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.283788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a1b2cc-f524-4934-b9d8-f47e59937cc1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.283930 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.283906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-client-ca-bundle\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.385276 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.385238 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwp7z\" (UniqueName: \"kubernetes.io/projected/07a1b2cc-f524-4934-b9d8-f47e59937cc1-kube-api-access-hwp7z\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.385276 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.385282 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07a1b2cc-f524-4934-b9d8-f47e59937cc1-metrics-server-audit-profiles\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.385519 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.385338 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-secret-metrics-server-client-certs\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.385519 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.385366 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a1b2cc-f524-4934-b9d8-f47e59937cc1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.385519 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.385392 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-client-ca-bundle\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.385519 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.385420 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-secret-metrics-server-tls\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.385519 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.385448 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07a1b2cc-f524-4934-b9d8-f47e59937cc1-audit-log\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.386133 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.386086 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/07a1b2cc-f524-4934-b9d8-f47e59937cc1-audit-log\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.386269 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.386167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a1b2cc-f524-4934-b9d8-f47e59937cc1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.386434 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.386413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/07a1b2cc-f524-4934-b9d8-f47e59937cc1-metrics-server-audit-profiles\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.389628 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.389610 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-secret-metrics-server-tls\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.389628 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.389617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-client-ca-bundle\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.389777 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.389691 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/07a1b2cc-f524-4934-b9d8-f47e59937cc1-secret-metrics-server-client-certs\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.394282 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.394261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwp7z\" (UniqueName: \"kubernetes.io/projected/07a1b2cc-f524-4934-b9d8-f47e59937cc1-kube-api-access-hwp7z\") pod \"metrics-server-98dd848d8-wfxvz\" (UID: \"07a1b2cc-f524-4934-b9d8-f47e59937cc1\") " pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.498110 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.498055 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:24:54.608075 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.608040 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5"] Apr 24 14:24:54.612481 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.612458 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" Apr 24 14:24:54.615277 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.615249 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-r695l\"" Apr 24 14:24:54.615411 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.615369 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Apr 24 14:24:54.616763 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.616737 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5"] Apr 24 14:24:54.688507 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.688471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e4079e5-c4d1-4b43-b625-bf040b520ccb-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-zzlg5\" (UID: \"6e4079e5-c4d1-4b43-b625-bf040b520ccb\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" Apr 24 14:24:54.789373 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.789343 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e4079e5-c4d1-4b43-b625-bf040b520ccb-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-zzlg5\" (UID: \"6e4079e5-c4d1-4b43-b625-bf040b520ccb\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" Apr 24 14:24:54.792862 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.792224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e4079e5-c4d1-4b43-b625-bf040b520ccb-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-zzlg5\" (UID: \"6e4079e5-c4d1-4b43-b625-bf040b520ccb\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" Apr 24 14:24:54.832042 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.832016 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-98dd848d8-wfxvz"] Apr 24 14:24:54.836629 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:54.836601 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a1b2cc_f524_4934_b9d8_f47e59937cc1.slice/crio-2531e6ef2ee6fb4ea87c7cd8b243ecad9ae89e085d4023d731e6cbb75966e6a1 WatchSource:0}: Error finding container 2531e6ef2ee6fb4ea87c7cd8b243ecad9ae89e085d4023d731e6cbb75966e6a1: Status 404 returned error can't find the container with id 2531e6ef2ee6fb4ea87c7cd8b243ecad9ae89e085d4023d731e6cbb75966e6a1 Apr 24 14:24:54.924575 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:54.924552 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" Apr 24 14:24:55.068824 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:55.068794 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5"] Apr 24 14:24:55.071618 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:24:55.071594 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4079e5_c4d1_4b43_b625_bf040b520ccb.slice/crio-5ac4c3e316425be3f761f25dafbf0a6fdee0dbfc4207d80b6c856447300cb03f WatchSource:0}: Error finding container 5ac4c3e316425be3f761f25dafbf0a6fdee0dbfc4207d80b6c856447300cb03f: Status 404 returned error can't find the container with id 5ac4c3e316425be3f761f25dafbf0a6fdee0dbfc4207d80b6c856447300cb03f Apr 24 14:24:55.403118 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:55.403019 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" event={"ID":"579e2c45-99e9-479b-9856-a3414c3f41cd","Type":"ContainerStarted","Data":"6651d12d1bc4fed3b121980ff688ff77161de26e8840af272637e204f25ea2d3"} Apr 24 14:24:55.403118 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:55.403063 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" event={"ID":"579e2c45-99e9-479b-9856-a3414c3f41cd","Type":"ContainerStarted","Data":"27c65e0ada2aa037e9bce6629ff0bbd05c0d67cb296d3d2ff93b50f5adc9f6e8"} Apr 24 14:24:55.403118 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:55.403076 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" event={"ID":"579e2c45-99e9-479b-9856-a3414c3f41cd","Type":"ContainerStarted","Data":"748ccdf5a7a775ac51d34d1555e8cdfde1f2fd7b5d3c24cca46e6c3baf1c9e88"} Apr 24 14:24:55.404330 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:55.404298 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" event={"ID":"6e4079e5-c4d1-4b43-b625-bf040b520ccb","Type":"ContainerStarted","Data":"5ac4c3e316425be3f761f25dafbf0a6fdee0dbfc4207d80b6c856447300cb03f"} Apr 24 14:24:55.405557 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:55.405520 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" event={"ID":"07a1b2cc-f524-4934-b9d8-f47e59937cc1","Type":"ContainerStarted","Data":"2531e6ef2ee6fb4ea87c7cd8b243ecad9ae89e085d4023d731e6cbb75966e6a1"} Apr 24 14:24:57.415637 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.415594 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" event={"ID":"579e2c45-99e9-479b-9856-a3414c3f41cd","Type":"ContainerStarted","Data":"81830673a048851429ad4fc09757497f9ead84da52f325611eb0c8058b0c26c8"} Apr 24 14:24:57.415637 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.415635 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" event={"ID":"579e2c45-99e9-479b-9856-a3414c3f41cd","Type":"ContainerStarted","Data":"2903a2bd8ed904ae7a11c8cbdff2dab4b1f1c8c0f85fdf974496a51c5fbdde48"} Apr 24 14:24:57.416112 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.415649 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" event={"ID":"579e2c45-99e9-479b-9856-a3414c3f41cd","Type":"ContainerStarted","Data":"ff17fcea89286a97a581f14d540631e3aeba988557923737ae79424e9cbf1b67"} Apr 24 14:24:57.416112 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.415768 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:24:57.416926 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.416906 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" event={"ID":"6e4079e5-c4d1-4b43-b625-bf040b520ccb","Type":"ContainerStarted","Data":"9a3296933fd7c95ee59efea4f7ff47ed83cd2a7f58aca2725c1dacb24f450968"} Apr 24 14:24:57.417146 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.417119 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" Apr 24 14:24:57.418346 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.418320 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" event={"ID":"07a1b2cc-f524-4934-b9d8-f47e59937cc1","Type":"ContainerStarted","Data":"c3ee0d998c9de712df341963f4cc7e82eb7a22e6a58909c93782ebae5b61eb7c"} Apr 24 14:24:57.421931 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.421914 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" Apr 24 14:24:57.437819 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.437758 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" podStartSLOduration=2.181836042 podStartE2EDuration="6.437748374s" podCreationTimestamp="2026-04-24 14:24:51 +0000 UTC" firstStartedPulling="2026-04-24 14:24:52.421919147 +0000 UTC m=+52.934751734" lastFinishedPulling="2026-04-24 14:24:56.677831476 +0000 UTC m=+57.190664066" observedRunningTime="2026-04-24 14:24:57.437461289 +0000 UTC m=+57.950293909" watchObservedRunningTime="2026-04-24 14:24:57.437748374 +0000 UTC m=+57.950580983" Apr 24 14:24:57.459591 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.459552 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" podStartSLOduration=1.618886368 podStartE2EDuration="3.459541453s" podCreationTimestamp="2026-04-24 14:24:54 +0000 UTC" firstStartedPulling="2026-04-24 14:24:54.843029376 +0000 UTC m=+55.355861963" lastFinishedPulling="2026-04-24 14:24:56.683684444 +0000 UTC m=+57.196517048" observedRunningTime="2026-04-24 14:24:57.458720401 +0000 UTC m=+57.971553036" watchObservedRunningTime="2026-04-24 14:24:57.459541453 +0000 UTC m=+57.972374060" Apr 24 14:24:57.473321 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:57.473278 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-zzlg5" podStartSLOduration=1.860406314 podStartE2EDuration="3.473263746s" podCreationTimestamp="2026-04-24 14:24:54 +0000 UTC" firstStartedPulling="2026-04-24 14:24:55.073646679 +0000 UTC m=+55.586479265" lastFinishedPulling="2026-04-24 14:24:56.686504108 +0000 UTC m=+57.199336697" observedRunningTime="2026-04-24 14:24:57.473082139 +0000 UTC m=+57.985914747" watchObservedRunningTime="2026-04-24 14:24:57.473263746 +0000 UTC m=+57.986096356" Apr 24 14:24:59.320022 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:59.319997 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kx6pv" Apr 24 14:24:59.377744 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:24:59.377718 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jdk56" Apr 24 14:25:03.428221 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:03.428190 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b7f5db56f-vxgph" Apr 24 14:25:04.877889 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:04.877847 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:25:04.880509 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:04.880493 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 24 14:25:04.890596 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:04.890565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f07c588-4cdd-4779-a4bf-d23af3f3d566-metrics-certs\") pod \"network-metrics-daemon-fvgmc\" (UID: \"0f07c588-4cdd-4779-a4bf-d23af3f3d566\") " pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:25:04.979282 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:04.979247 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:25:04.982040 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:04.982016 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 24 14:25:04.992291 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:04.992268 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 24 14:25:05.002524 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.002494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62d7b\" (UniqueName: \"kubernetes.io/projected/31799aae-4d20-4f05-a6af-04f6e7fb0d6b-kube-api-access-62d7b\") pod \"network-check-target-njhj7\" (UID: \"31799aae-4d20-4f05-a6af-04f6e7fb0d6b\") " pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:25:05.057630 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.057605 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qmh6n\"" Apr 24 14:25:05.062499 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.062480 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2dnd\"" Apr 24 14:25:05.066360 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.066344 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:25:05.071502 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.071482 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvgmc" Apr 24 14:25:05.194666 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.194608 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-njhj7"] Apr 24 14:25:05.199059 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:25:05.199031 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31799aae_4d20_4f05_a6af_04f6e7fb0d6b.slice/crio-404c3545a1e8c991f22cb499d31021bbcab5565bc2d032ba0435509750f057b4 WatchSource:0}: Error finding container 404c3545a1e8c991f22cb499d31021bbcab5565bc2d032ba0435509750f057b4: Status 404 returned error can't find the container with id 404c3545a1e8c991f22cb499d31021bbcab5565bc2d032ba0435509750f057b4 Apr 24 14:25:05.212446 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.212389 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvgmc"] Apr 24 14:25:05.214697 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:25:05.214672 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f07c588_4cdd_4779_a4bf_d23af3f3d566.slice/crio-a3995ed3ef9554eb5699d14c3693752e84c50b94c5768ce3f4b905fb3c1764ce WatchSource:0}: Error finding container a3995ed3ef9554eb5699d14c3693752e84c50b94c5768ce3f4b905fb3c1764ce: Status 404 returned error can't find the container with id a3995ed3ef9554eb5699d14c3693752e84c50b94c5768ce3f4b905fb3c1764ce Apr 24 14:25:05.439167 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.439137 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvgmc" event={"ID":"0f07c588-4cdd-4779-a4bf-d23af3f3d566","Type":"ContainerStarted","Data":"a3995ed3ef9554eb5699d14c3693752e84c50b94c5768ce3f4b905fb3c1764ce"} Apr 24 14:25:05.440030 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:05.440011 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njhj7" event={"ID":"31799aae-4d20-4f05-a6af-04f6e7fb0d6b","Type":"ContainerStarted","Data":"404c3545a1e8c991f22cb499d31021bbcab5565bc2d032ba0435509750f057b4"} Apr 24 14:25:07.364924 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:07.364889 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66c9d7f6bb-ptns5" Apr 24 14:25:08.450910 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.450866 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvgmc" event={"ID":"0f07c588-4cdd-4779-a4bf-d23af3f3d566","Type":"ContainerStarted","Data":"0daa2b147e426fe60ceac83f1fc38ff01fae9e98a7afc513c43037a9ed41af28"} Apr 24 14:25:08.451394 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.450917 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvgmc" event={"ID":"0f07c588-4cdd-4779-a4bf-d23af3f3d566","Type":"ContainerStarted","Data":"83a4488b66ad745243b40c2c17119093873a957c6f211896a13b9ec452521047"} Apr 24 14:25:08.452180 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.452150 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-njhj7" event={"ID":"31799aae-4d20-4f05-a6af-04f6e7fb0d6b","Type":"ContainerStarted","Data":"47162ee63e41299c2ed5f027f52c46b09820e22626537032e231d06aac7591aa"} Apr 24 14:25:08.452323 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.452307 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:25:08.467176 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.467138 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fvgmc" podStartSLOduration=65.589056754 podStartE2EDuration="1m8.467127303s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:25:05.216459777 +0000 UTC m=+65.729292362" lastFinishedPulling="2026-04-24 14:25:08.094530325 +0000 UTC m=+68.607362911" observedRunningTime="2026-04-24 14:25:08.465775346 +0000 UTC m=+68.978607948" watchObservedRunningTime="2026-04-24 14:25:08.467127303 +0000 UTC m=+68.979959910" Apr 24 14:25:08.480065 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.480019 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-njhj7" podStartSLOduration=65.559044058 podStartE2EDuration="1m8.480007904s" podCreationTimestamp="2026-04-24 14:24:00 +0000 UTC" firstStartedPulling="2026-04-24 14:25:05.20111844 +0000 UTC m=+65.713951032" lastFinishedPulling="2026-04-24 14:25:08.122082278 +0000 UTC m=+68.634914878" observedRunningTime="2026-04-24 14:25:08.479962992 +0000 UTC m=+68.992795597" watchObservedRunningTime="2026-04-24 14:25:08.480007904 +0000 UTC m=+68.992840494" Apr 24 14:25:08.785319 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.785231 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6bcc868b7-4mhsv"] Apr 24 14:25:08.787318 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.787293 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6bcc868b7-4mhsv" Apr 24 14:25:08.789930 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.789909 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 24 14:25:08.790048 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.789949 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5vpwd\"" Apr 24 14:25:08.790364 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.790346 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 24 14:25:08.801759 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.801738 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6bcc868b7-4mhsv"] Apr 24 14:25:08.911785 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:08.911752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xrp7\" (UniqueName: \"kubernetes.io/projected/892ef02e-9577-42da-a618-c4d33bdf46e2-kube-api-access-8xrp7\") pod \"downloads-6bcc868b7-4mhsv\" (UID: \"892ef02e-9577-42da-a618-c4d33bdf46e2\") " pod="openshift-console/downloads-6bcc868b7-4mhsv" Apr 24 14:25:09.013003 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:09.012970 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xrp7\" (UniqueName: \"kubernetes.io/projected/892ef02e-9577-42da-a618-c4d33bdf46e2-kube-api-access-8xrp7\") pod \"downloads-6bcc868b7-4mhsv\" (UID: \"892ef02e-9577-42da-a618-c4d33bdf46e2\") " pod="openshift-console/downloads-6bcc868b7-4mhsv" Apr 24 14:25:09.020792 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:09.020763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xrp7\" (UniqueName: \"kubernetes.io/projected/892ef02e-9577-42da-a618-c4d33bdf46e2-kube-api-access-8xrp7\") pod \"downloads-6bcc868b7-4mhsv\" (UID: \"892ef02e-9577-42da-a618-c4d33bdf46e2\") " pod="openshift-console/downloads-6bcc868b7-4mhsv" Apr 24 14:25:09.095610 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:09.095525 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6bcc868b7-4mhsv" Apr 24 14:25:09.212602 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:09.212567 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6bcc868b7-4mhsv"] Apr 24 14:25:09.215625 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:25:09.215598 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892ef02e_9577_42da_a618_c4d33bdf46e2.slice/crio-e371b6ba61f4b4fb4201557eaacdf6945edefa14f8e09575207018b7fc91f917 WatchSource:0}: Error finding container e371b6ba61f4b4fb4201557eaacdf6945edefa14f8e09575207018b7fc91f917: Status 404 returned error can't find the container with id e371b6ba61f4b4fb4201557eaacdf6945edefa14f8e09575207018b7fc91f917 Apr 24 14:25:09.456333 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:09.456299 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6bcc868b7-4mhsv" event={"ID":"892ef02e-9577-42da-a618-c4d33bdf46e2","Type":"ContainerStarted","Data":"e371b6ba61f4b4fb4201557eaacdf6945edefa14f8e09575207018b7fc91f917"} Apr 24 14:25:11.941154 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:11.941086 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:25:11.944046 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:11.944021 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 24 14:25:11.953734 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:11.953711 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd6b3902-a06e-4b22-b7f0-5990d385525e-original-pull-secret\") pod \"global-pull-secret-syncer-gclmc\" (UID: \"dd6b3902-a06e-4b22-b7f0-5990d385525e\") " pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:25:12.250349 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:12.250266 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gclmc" Apr 24 14:25:12.379069 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:12.379033 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gclmc"] Apr 24 14:25:12.383880 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:25:12.383839 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6b3902_a06e_4b22_b7f0_5990d385525e.slice/crio-c8abd1436c687e820d5a653733a4ff7b242b80c8791c01f6a618d414e652dff4 WatchSource:0}: Error finding container c8abd1436c687e820d5a653733a4ff7b242b80c8791c01f6a618d414e652dff4: Status 404 returned error can't find the container with id c8abd1436c687e820d5a653733a4ff7b242b80c8791c01f6a618d414e652dff4 Apr 24 14:25:12.465680 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:12.465641 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gclmc" event={"ID":"dd6b3902-a06e-4b22-b7f0-5990d385525e","Type":"ContainerStarted","Data":"c8abd1436c687e820d5a653733a4ff7b242b80c8791c01f6a618d414e652dff4"} Apr 24 14:25:14.499011 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:14.498959 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:25:14.499495 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:14.499050 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:25:17.482191 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.482147 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gclmc" event={"ID":"dd6b3902-a06e-4b22-b7f0-5990d385525e","Type":"ContainerStarted","Data":"3e400e6a812d216c2c0922490c496e74c8d8dea8824fd49499c2436af4e0760d"} Apr 24 14:25:17.508113 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.508043 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gclmc" podStartSLOduration=66.551708596 podStartE2EDuration="1m10.508023799s" podCreationTimestamp="2026-04-24 14:24:07 +0000 UTC" firstStartedPulling="2026-04-24 14:25:12.386060052 +0000 UTC m=+72.898892653" lastFinishedPulling="2026-04-24 14:25:16.342375265 +0000 UTC m=+76.855207856" observedRunningTime="2026-04-24 14:25:17.50650709 +0000 UTC m=+78.019339711" watchObservedRunningTime="2026-04-24 14:25:17.508023799 +0000 UTC m=+78.020856410" Apr 24 14:25:17.851460 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.851379 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c89b4c65-r79lg"] Apr 24 14:25:17.853736 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.853710 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:17.857335 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.857309 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 24 14:25:17.857447 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.857322 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 24 14:25:17.857523 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.857455 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 24 14:25:17.857523 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.857462 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nhb6x\"" Apr 24 14:25:17.857624 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.857537 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 24 14:25:17.857798 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.857779 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 24 14:25:17.865604 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.865580 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c89b4c65-r79lg"] Apr 24 14:25:17.987451 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.987412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-service-ca\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:17.987451 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.987460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-serving-cert\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:17.987697 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.987545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-oauth-config\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:17.987697 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.987596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-console-config\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:17.987697 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.987629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqd82\" (UniqueName: \"kubernetes.io/projected/2d6f378f-980d-4fd9-92de-df5f79313625-kube-api-access-bqd82\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:17.987855 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:17.987709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-oauth-serving-cert\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.088990 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.088896 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-oauth-config\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089034 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-console-config\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089082 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqd82\" (UniqueName: \"kubernetes.io/projected/2d6f378f-980d-4fd9-92de-df5f79313625-kube-api-access-bqd82\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089185 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089128 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-oauth-serving-cert\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089316 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-service-ca\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089420 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089370 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-serving-cert\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089862 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-console-config\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089956 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089858 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-oauth-serving-cert\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.089997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.089970 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-service-ca\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.091647 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.091623 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-oauth-config\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.091908 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.091884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-serving-cert\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.097147 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.097128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqd82\" (UniqueName: \"kubernetes.io/projected/2d6f378f-980d-4fd9-92de-df5f79313625-kube-api-access-bqd82\") pod \"console-6c89b4c65-r79lg\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:18.165584 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:18.165491 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:24.970262 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:24.970219 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c89b4c65-r79lg"] Apr 24 14:25:24.972403 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:25:24.972379 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6f378f_980d_4fd9_92de_df5f79313625.slice/crio-1c0af0fba9ad2ea1e7ef9f0de0e1908ae6d8403d0e0f6589e5c37fe5408c1b83 WatchSource:0}: Error finding container 1c0af0fba9ad2ea1e7ef9f0de0e1908ae6d8403d0e0f6589e5c37fe5408c1b83: Status 404 returned error can't find the container with id 1c0af0fba9ad2ea1e7ef9f0de0e1908ae6d8403d0e0f6589e5c37fe5408c1b83 Apr 24 14:25:25.508542 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:25.508489 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6bcc868b7-4mhsv" event={"ID":"892ef02e-9577-42da-a618-c4d33bdf46e2","Type":"ContainerStarted","Data":"6837608ddb8435c1c3c1a2d2bc7744ead1815754e5b1ebfd8b98e1bc0e4f2dee"} Apr 24 14:25:25.509558 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:25.509535 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6bcc868b7-4mhsv" Apr 24 14:25:25.511118 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:25.511064 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c89b4c65-r79lg" event={"ID":"2d6f378f-980d-4fd9-92de-df5f79313625","Type":"ContainerStarted","Data":"1c0af0fba9ad2ea1e7ef9f0de0e1908ae6d8403d0e0f6589e5c37fe5408c1b83"} Apr 24 14:25:25.524046 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:25.524015 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6bcc868b7-4mhsv" Apr 24 14:25:25.529122 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:25.529007 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-6bcc868b7-4mhsv" podStartSLOduration=1.811584321 podStartE2EDuration="17.528989181s" podCreationTimestamp="2026-04-24 14:25:08 +0000 UTC" firstStartedPulling="2026-04-24 14:25:09.217471297 +0000 UTC m=+69.730303883" lastFinishedPulling="2026-04-24 14:25:24.934876155 +0000 UTC m=+85.447708743" observedRunningTime="2026-04-24 14:25:25.525767433 +0000 UTC m=+86.038600042" watchObservedRunningTime="2026-04-24 14:25:25.528989181 +0000 UTC m=+86.041821791" Apr 24 14:25:27.043148 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.043110 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b654c7d8-fpk6g"] Apr 24 14:25:27.060872 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.060842 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b654c7d8-fpk6g"] Apr 24 14:25:27.061040 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.060977 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.064954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.064435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wmc6\" (UniqueName: \"kubernetes.io/projected/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-kube-api-access-7wmc6\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.064954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.064494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-service-ca\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.064954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.064524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-oauth-config\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.064954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.064555 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-trusted-ca-bundle\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.064954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.064608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-serving-cert\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.064954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.064644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-oauth-serving-cert\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.064954 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.064680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-config\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.069998 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.069789 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 24 14:25:27.165967 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.165925 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-oauth-serving-cert\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.166210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.165992 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-config\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.166210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.166043 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wmc6\" (UniqueName: \"kubernetes.io/projected/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-kube-api-access-7wmc6\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.166210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.166087 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-service-ca\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.166210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.166134 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-oauth-config\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.166210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.166160 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-trusted-ca-bundle\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.166470 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.166219 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-serving-cert\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.167921 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.167885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-oauth-serving-cert\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.167921 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.167899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-service-ca\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.168453 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.168428 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-config\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.168558 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.168459 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-trusted-ca-bundle\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.170404 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.170378 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-serving-cert\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.171258 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.171214 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-oauth-config\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.175436 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.175412 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wmc6\" (UniqueName: \"kubernetes.io/projected/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-kube-api-access-7wmc6\") pod \"console-5b654c7d8-fpk6g\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:27.374500 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:27.374369 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:28.468817 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:28.468782 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b654c7d8-fpk6g"] Apr 24 14:25:28.471684 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:25:28.471648 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1297a7ad_456d_4ff2_8453_7a5fe57d08b8.slice/crio-10518403a37274ffac5254a7add5a6503dc509e29e114c18bc41aea5f218f512 WatchSource:0}: Error finding container 10518403a37274ffac5254a7add5a6503dc509e29e114c18bc41aea5f218f512: Status 404 returned error can't find the container with id 10518403a37274ffac5254a7add5a6503dc509e29e114c18bc41aea5f218f512 Apr 24 14:25:28.523219 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:28.523176 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b654c7d8-fpk6g" event={"ID":"1297a7ad-456d-4ff2-8453-7a5fe57d08b8","Type":"ContainerStarted","Data":"10518403a37274ffac5254a7add5a6503dc509e29e114c18bc41aea5f218f512"} Apr 24 14:25:29.527997 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:29.527945 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b654c7d8-fpk6g" event={"ID":"1297a7ad-456d-4ff2-8453-7a5fe57d08b8","Type":"ContainerStarted","Data":"81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685"} Apr 24 14:25:29.529877 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:29.529852 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c89b4c65-r79lg" event={"ID":"2d6f378f-980d-4fd9-92de-df5f79313625","Type":"ContainerStarted","Data":"03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3"} Apr 24 14:25:29.546913 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:29.546849 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b654c7d8-fpk6g" podStartSLOduration=2.042265358 podStartE2EDuration="2.546832011s" podCreationTimestamp="2026-04-24 14:25:27 +0000 UTC" firstStartedPulling="2026-04-24 14:25:28.474344736 +0000 UTC m=+88.987177321" lastFinishedPulling="2026-04-24 14:25:28.978911385 +0000 UTC m=+89.491743974" observedRunningTime="2026-04-24 14:25:29.546289117 +0000 UTC m=+90.059121749" watchObservedRunningTime="2026-04-24 14:25:29.546832011 +0000 UTC m=+90.059664620" Apr 24 14:25:34.504162 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:34.504128 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:25:34.508186 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:34.508163 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-98dd848d8-wfxvz" Apr 24 14:25:34.522472 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:34.522426 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6c89b4c65-r79lg" podStartSLOduration=13.726141638 podStartE2EDuration="17.52241352s" podCreationTimestamp="2026-04-24 14:25:17 +0000 UTC" firstStartedPulling="2026-04-24 14:25:24.974756858 +0000 UTC m=+85.487589459" lastFinishedPulling="2026-04-24 14:25:28.771028746 +0000 UTC m=+89.283861341" observedRunningTime="2026-04-24 14:25:29.564837472 +0000 UTC m=+90.077670081" watchObservedRunningTime="2026-04-24 14:25:34.52241352 +0000 UTC m=+95.035246127" Apr 24 14:25:37.374658 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:37.374619 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:37.375117 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:37.374746 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:37.379457 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:37.379433 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:37.556947 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:37.556921 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:25:37.605220 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:37.605191 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c89b4c65-r79lg"] Apr 24 14:25:38.166032 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:38.165997 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:25:39.458971 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:25:39.458943 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-njhj7" Apr 24 14:26:02.625416 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:02.625350 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6c89b4c65-r79lg" podUID="2d6f378f-980d-4fd9-92de-df5f79313625" containerName="console" containerID="cri-o://03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3" gracePeriod=15 Apr 24 14:26:02.933873 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:02.933848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c89b4c65-r79lg_2d6f378f-980d-4fd9-92de-df5f79313625/console/0.log" Apr 24 14:26:02.934003 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:02.933936 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:26:03.064741 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.064707 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-oauth-serving-cert\") pod \"2d6f378f-980d-4fd9-92de-df5f79313625\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " Apr 24 14:26:03.064928 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.064750 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-console-config\") pod \"2d6f378f-980d-4fd9-92de-df5f79313625\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " Apr 24 14:26:03.064928 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.064779 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-oauth-config\") pod \"2d6f378f-980d-4fd9-92de-df5f79313625\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " Apr 24 14:26:03.064928 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.064808 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-serving-cert\") pod \"2d6f378f-980d-4fd9-92de-df5f79313625\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " Apr 24 14:26:03.064928 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.064834 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-service-ca\") pod \"2d6f378f-980d-4fd9-92de-df5f79313625\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " Apr 24 14:26:03.064928 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.064872 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqd82\" (UniqueName: \"kubernetes.io/projected/2d6f378f-980d-4fd9-92de-df5f79313625-kube-api-access-bqd82\") pod \"2d6f378f-980d-4fd9-92de-df5f79313625\" (UID: \"2d6f378f-980d-4fd9-92de-df5f79313625\") " Apr 24 14:26:03.065263 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.065224 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d6f378f-980d-4fd9-92de-df5f79313625" (UID: "2d6f378f-980d-4fd9-92de-df5f79313625"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:26:03.065405 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.065277 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-console-config" (OuterVolumeSpecName: "console-config") pod "2d6f378f-980d-4fd9-92de-df5f79313625" (UID: "2d6f378f-980d-4fd9-92de-df5f79313625"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:26:03.065405 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.065303 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d6f378f-980d-4fd9-92de-df5f79313625" (UID: "2d6f378f-980d-4fd9-92de-df5f79313625"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:26:03.067128 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.067083 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d6f378f-980d-4fd9-92de-df5f79313625" (UID: "2d6f378f-980d-4fd9-92de-df5f79313625"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:26:03.067128 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.067120 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6f378f-980d-4fd9-92de-df5f79313625-kube-api-access-bqd82" (OuterVolumeSpecName: "kube-api-access-bqd82") pod "2d6f378f-980d-4fd9-92de-df5f79313625" (UID: "2d6f378f-980d-4fd9-92de-df5f79313625"). InnerVolumeSpecName "kube-api-access-bqd82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 14:26:03.067289 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.067133 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d6f378f-980d-4fd9-92de-df5f79313625" (UID: "2d6f378f-980d-4fd9-92de-df5f79313625"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:26:03.165739 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.165698 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqd82\" (UniqueName: \"kubernetes.io/projected/2d6f378f-980d-4fd9-92de-df5f79313625-kube-api-access-bqd82\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:03.165739 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.165733 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-oauth-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:03.165739 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.165745 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-console-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:03.165966 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.165755 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-oauth-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:03.165966 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.165765 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d6f378f-980d-4fd9-92de-df5f79313625-console-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:03.165966 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.165774 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d6f378f-980d-4fd9-92de-df5f79313625-service-ca\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:03.622686 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.622658 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c89b4c65-r79lg_2d6f378f-980d-4fd9-92de-df5f79313625/console/0.log" Apr 24 14:26:03.622891 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.622704 2577 generic.go:358] "Generic (PLEG): container finished" podID="2d6f378f-980d-4fd9-92de-df5f79313625" containerID="03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3" exitCode=2 Apr 24 14:26:03.622891 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.622742 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c89b4c65-r79lg" event={"ID":"2d6f378f-980d-4fd9-92de-df5f79313625","Type":"ContainerDied","Data":"03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3"} Apr 24 14:26:03.622891 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.622773 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c89b4c65-r79lg" Apr 24 14:26:03.622891 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.622789 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c89b4c65-r79lg" event={"ID":"2d6f378f-980d-4fd9-92de-df5f79313625","Type":"ContainerDied","Data":"1c0af0fba9ad2ea1e7ef9f0de0e1908ae6d8403d0e0f6589e5c37fe5408c1b83"} Apr 24 14:26:03.622891 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.622812 2577 scope.go:117] "RemoveContainer" containerID="03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3" Apr 24 14:26:03.630992 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.630926 2577 scope.go:117] "RemoveContainer" containerID="03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3" Apr 24 14:26:03.631310 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:26:03.631188 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3\": container with ID starting with 03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3 not found: ID does not exist" containerID="03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3" Apr 24 14:26:03.631310 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.631212 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3"} err="failed to get container status \"03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3\": rpc error: code = NotFound desc = could not find container \"03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3\": container with ID starting with 03e4055057c7a48873fdc8e4485c4e13b991b1df5ab6308f5301bef5ab0e58e3 not found: ID does not exist" Apr 24 14:26:03.643583 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.643563 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c89b4c65-r79lg"] Apr 24 14:26:03.646978 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:03.646958 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c89b4c65-r79lg"] Apr 24 14:26:04.142610 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:04.142576 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d6f378f-980d-4fd9-92de-df5f79313625" path="/var/lib/kubelet/pods/2d6f378f-980d-4fd9-92de-df5f79313625/volumes" Apr 24 14:26:18.024332 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.024297 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ddfdf87cd-vshfh"] Apr 24 14:26:18.024785 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.024559 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6f378f-980d-4fd9-92de-df5f79313625" containerName="console" Apr 24 14:26:18.024785 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.024570 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6f378f-980d-4fd9-92de-df5f79313625" containerName="console" Apr 24 14:26:18.024785 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.024623 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d6f378f-980d-4fd9-92de-df5f79313625" containerName="console" Apr 24 14:26:18.027323 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.027306 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.042502 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.042476 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddfdf87cd-vshfh"] Apr 24 14:26:18.184483 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.184456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-config\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.184657 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.184505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-oauth-config\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.184657 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.184529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxskf\" (UniqueName: \"kubernetes.io/projected/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-kube-api-access-mxskf\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.184657 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.184545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-service-ca\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.184657 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.184560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-trusted-ca-bundle\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.184657 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.184578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-oauth-serving-cert\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.184657 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.184600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-serving-cert\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285142 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285038 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-serving-cert\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285142 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285089 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-config\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285164 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-oauth-config\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285194 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxskf\" (UniqueName: \"kubernetes.io/projected/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-kube-api-access-mxskf\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285219 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-service-ca\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285241 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-trusted-ca-bundle\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285271 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-oauth-serving-cert\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.285930 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285904 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-config\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.286047 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-service-ca\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.286047 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.285989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-oauth-serving-cert\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.286277 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.286254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-trusted-ca-bundle\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.287709 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.287685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-serving-cert\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.288086 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.288070 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-oauth-config\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.292978 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.292952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxskf\" (UniqueName: \"kubernetes.io/projected/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-kube-api-access-mxskf\") pod \"console-6ddfdf87cd-vshfh\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.336890 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.336857 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:18.454451 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.454420 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ddfdf87cd-vshfh"] Apr 24 14:26:18.664292 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.664190 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddfdf87cd-vshfh" event={"ID":"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d","Type":"ContainerStarted","Data":"33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18"} Apr 24 14:26:18.664292 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.664233 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddfdf87cd-vshfh" event={"ID":"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d","Type":"ContainerStarted","Data":"95e4e578cd7e502bf549367e7187818a1c372959dcbb2d4dd1cfb9456073dd96"} Apr 24 14:26:18.681269 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:18.681217 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6ddfdf87cd-vshfh" podStartSLOduration=0.68120262 podStartE2EDuration="681.20262ms" podCreationTimestamp="2026-04-24 14:26:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 14:26:18.68084958 +0000 UTC m=+139.193682191" watchObservedRunningTime="2026-04-24 14:26:18.68120262 +0000 UTC m=+139.194035218" Apr 24 14:26:28.337432 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:28.337375 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:28.337432 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:28.337437 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:28.346437 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:28.346412 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:28.693863 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:28.693834 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:26:28.742795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:28.742761 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b654c7d8-fpk6g"] Apr 24 14:26:53.761397 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:53.761341 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5b654c7d8-fpk6g" podUID="1297a7ad-456d-4ff2-8453-7a5fe57d08b8" containerName="console" containerID="cri-o://81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685" gracePeriod=15 Apr 24 14:26:53.994783 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:53.994762 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b654c7d8-fpk6g_1297a7ad-456d-4ff2-8453-7a5fe57d08b8/console/0.log" Apr 24 14:26:53.994899 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:53.994820 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:26:54.056700 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.056627 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-config\") pod \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " Apr 24 14:26:54.056700 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.056665 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-trusted-ca-bundle\") pod \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " Apr 24 14:26:54.056700 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.056685 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-oauth-serving-cert\") pod \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " Apr 24 14:26:54.056700 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.056702 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-serving-cert\") pod \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " Apr 24 14:26:54.057006 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.056828 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-oauth-config\") pod \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " Apr 24 14:26:54.057006 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.056861 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-service-ca\") pod \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " Apr 24 14:26:54.057006 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.056896 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wmc6\" (UniqueName: \"kubernetes.io/projected/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-kube-api-access-7wmc6\") pod \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\" (UID: \"1297a7ad-456d-4ff2-8453-7a5fe57d08b8\") " Apr 24 14:26:54.057251 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.057208 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-config" (OuterVolumeSpecName: "console-config") pod "1297a7ad-456d-4ff2-8453-7a5fe57d08b8" (UID: "1297a7ad-456d-4ff2-8453-7a5fe57d08b8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:26:54.057251 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.057215 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1297a7ad-456d-4ff2-8453-7a5fe57d08b8" (UID: "1297a7ad-456d-4ff2-8453-7a5fe57d08b8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:26:54.057251 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.057221 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1297a7ad-456d-4ff2-8453-7a5fe57d08b8" (UID: "1297a7ad-456d-4ff2-8453-7a5fe57d08b8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:26:54.057488 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.057329 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-service-ca" (OuterVolumeSpecName: "service-ca") pod "1297a7ad-456d-4ff2-8453-7a5fe57d08b8" (UID: "1297a7ad-456d-4ff2-8453-7a5fe57d08b8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:26:54.059028 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.058996 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-kube-api-access-7wmc6" (OuterVolumeSpecName: "kube-api-access-7wmc6") pod "1297a7ad-456d-4ff2-8453-7a5fe57d08b8" (UID: "1297a7ad-456d-4ff2-8453-7a5fe57d08b8"). InnerVolumeSpecName "kube-api-access-7wmc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 14:26:54.059210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.059036 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1297a7ad-456d-4ff2-8453-7a5fe57d08b8" (UID: "1297a7ad-456d-4ff2-8453-7a5fe57d08b8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:26:54.059210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.059076 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1297a7ad-456d-4ff2-8453-7a5fe57d08b8" (UID: "1297a7ad-456d-4ff2-8453-7a5fe57d08b8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:26:54.157674 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.157648 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:54.157674 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.157673 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-trusted-ca-bundle\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:54.157827 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.157684 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-oauth-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:54.157827 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.157694 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:54.157827 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.157703 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-console-oauth-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:54.157827 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.157711 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-service-ca\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:54.157827 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.157720 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wmc6\" (UniqueName: \"kubernetes.io/projected/1297a7ad-456d-4ff2-8453-7a5fe57d08b8-kube-api-access-7wmc6\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:26:54.760338 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.760310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b654c7d8-fpk6g_1297a7ad-456d-4ff2-8453-7a5fe57d08b8/console/0.log" Apr 24 14:26:54.760510 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.760352 2577 generic.go:358] "Generic (PLEG): container finished" podID="1297a7ad-456d-4ff2-8453-7a5fe57d08b8" containerID="81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685" exitCode=2 Apr 24 14:26:54.760510 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.760430 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b654c7d8-fpk6g" event={"ID":"1297a7ad-456d-4ff2-8453-7a5fe57d08b8","Type":"ContainerDied","Data":"81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685"} Apr 24 14:26:54.760510 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.760447 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b654c7d8-fpk6g" Apr 24 14:26:54.760510 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.760458 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b654c7d8-fpk6g" event={"ID":"1297a7ad-456d-4ff2-8453-7a5fe57d08b8","Type":"ContainerDied","Data":"10518403a37274ffac5254a7add5a6503dc509e29e114c18bc41aea5f218f512"} Apr 24 14:26:54.760510 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.760474 2577 scope.go:117] "RemoveContainer" containerID="81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685" Apr 24 14:26:54.768204 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.767976 2577 scope.go:117] "RemoveContainer" containerID="81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685" Apr 24 14:26:54.768417 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:26:54.768260 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685\": container with ID starting with 81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685 not found: ID does not exist" containerID="81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685" Apr 24 14:26:54.768417 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.768284 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685"} err="failed to get container status \"81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685\": rpc error: code = NotFound desc = could not find container \"81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685\": container with ID starting with 81841e697db6b35af48715d9fa4297fecdcc9dc2df55634be9ec5ae38193f685 not found: ID does not exist" Apr 24 14:26:54.777055 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.777035 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b654c7d8-fpk6g"] Apr 24 14:26:54.781010 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:54.780990 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b654c7d8-fpk6g"] Apr 24 14:26:56.143564 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:26:56.143525 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1297a7ad-456d-4ff2-8453-7a5fe57d08b8" path="/var/lib/kubelet/pods/1297a7ad-456d-4ff2-8453-7a5fe57d08b8/volumes" Apr 24 14:27:35.007523 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.007485 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f97c9bfb8-phlqn"] Apr 24 14:27:35.007988 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.007750 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1297a7ad-456d-4ff2-8453-7a5fe57d08b8" containerName="console" Apr 24 14:27:35.007988 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.007761 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1297a7ad-456d-4ff2-8453-7a5fe57d08b8" containerName="console" Apr 24 14:27:35.007988 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.007822 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="1297a7ad-456d-4ff2-8453-7a5fe57d08b8" containerName="console" Apr 24 14:27:35.010685 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.010669 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.025234 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.025207 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f97c9bfb8-phlqn"] Apr 24 14:27:35.168497 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.168464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvnb\" (UniqueName: \"kubernetes.io/projected/a03658d8-06a2-48b9-a187-b569f67dcc24-kube-api-access-2bvnb\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.168662 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.168514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-console-config\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.168662 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.168538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-serving-cert\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.168662 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.168588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-oauth-serving-cert\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.168662 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.168629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-trusted-ca-bundle\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.168795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.168663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-oauth-config\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.168795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.168695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-service-ca\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.269814 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.269731 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-oauth-config\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.269814 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.269773 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-service-ca\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.269867 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvnb\" (UniqueName: \"kubernetes.io/projected/a03658d8-06a2-48b9-a187-b569f67dcc24-kube-api-access-2bvnb\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.269906 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-console-config\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.269932 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-serving-cert\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270188 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.269997 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-oauth-serving-cert\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270188 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.270051 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-trusted-ca-bundle\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270744 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.270716 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-console-config\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270872 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.270783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-service-ca\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.270872 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.270802 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-oauth-serving-cert\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.271133 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.271111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-trusted-ca-bundle\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.272223 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.272204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-oauth-config\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.272364 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.272348 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-serving-cert\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.277446 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.277428 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvnb\" (UniqueName: \"kubernetes.io/projected/a03658d8-06a2-48b9-a187-b569f67dcc24-kube-api-access-2bvnb\") pod \"console-7f97c9bfb8-phlqn\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.319349 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.319316 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:35.438276 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.438242 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f97c9bfb8-phlqn"] Apr 24 14:27:35.441572 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:27:35.441541 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03658d8_06a2_48b9_a187_b569f67dcc24.slice/crio-8365a80651385149d2853fa493459bb8ffbfb0668f9f45bf686ba14f1d87f0f7 WatchSource:0}: Error finding container 8365a80651385149d2853fa493459bb8ffbfb0668f9f45bf686ba14f1d87f0f7: Status 404 returned error can't find the container with id 8365a80651385149d2853fa493459bb8ffbfb0668f9f45bf686ba14f1d87f0f7 Apr 24 14:27:35.870996 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.870954 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f97c9bfb8-phlqn" event={"ID":"a03658d8-06a2-48b9-a187-b569f67dcc24","Type":"ContainerStarted","Data":"6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac"} Apr 24 14:27:35.870996 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.870997 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f97c9bfb8-phlqn" event={"ID":"a03658d8-06a2-48b9-a187-b569f67dcc24","Type":"ContainerStarted","Data":"8365a80651385149d2853fa493459bb8ffbfb0668f9f45bf686ba14f1d87f0f7"} Apr 24 14:27:35.888166 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:35.888121 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f97c9bfb8-phlqn" podStartSLOduration=1.88808525 podStartE2EDuration="1.88808525s" podCreationTimestamp="2026-04-24 14:27:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 14:27:35.88722864 +0000 UTC m=+216.400061241" watchObservedRunningTime="2026-04-24 14:27:35.88808525 +0000 UTC m=+216.400917858" Apr 24 14:27:45.320247 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:45.320199 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:45.320247 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:45.320244 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:45.324927 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:45.324905 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:45.901201 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:45.901173 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:27:45.950819 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:27:45.950783 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ddfdf87cd-vshfh"] Apr 24 14:28:10.970563 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:10.970507 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6ddfdf87cd-vshfh" podUID="8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" containerName="console" containerID="cri-o://33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18" gracePeriod=15 Apr 24 14:28:11.202369 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.202344 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ddfdf87cd-vshfh_8d1bdfe5-8821-4e07-97e1-12c1f28cc79d/console/0.log" Apr 24 14:28:11.202485 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.202417 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:28:11.344250 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344161 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-oauth-config\") pod \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " Apr 24 14:28:11.344250 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344210 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-trusted-ca-bundle\") pod \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " Apr 24 14:28:11.344250 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344226 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-oauth-serving-cert\") pod \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " Apr 24 14:28:11.344250 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344254 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-serving-cert\") pod \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " Apr 24 14:28:11.344542 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344383 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-config\") pod \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " Apr 24 14:28:11.344542 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344435 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-service-ca\") pod \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " Apr 24 14:28:11.344542 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344471 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxskf\" (UniqueName: \"kubernetes.io/projected/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-kube-api-access-mxskf\") pod \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\" (UID: \"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d\") " Apr 24 14:28:11.344724 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344696 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" (UID: "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:28:11.344784 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344722 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" (UID: "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:28:11.344836 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344797 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-config" (OuterVolumeSpecName: "console-config") pod "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" (UID: "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:28:11.344836 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.344809 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" (UID: "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:28:11.346398 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.346373 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" (UID: "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:28:11.346491 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.346427 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" (UID: "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:28:11.346491 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.346479 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-kube-api-access-mxskf" (OuterVolumeSpecName: "kube-api-access-mxskf") pod "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" (UID: "8d1bdfe5-8821-4e07-97e1-12c1f28cc79d"). InnerVolumeSpecName "kube-api-access-mxskf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 14:28:11.445707 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.445671 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:28:11.445707 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.445701 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-service-ca\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:28:11.445707 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.445710 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxskf\" (UniqueName: \"kubernetes.io/projected/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-kube-api-access-mxskf\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:28:11.445921 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.445720 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-oauth-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:28:11.445921 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.445729 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-trusted-ca-bundle\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:28:11.445921 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.445738 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-oauth-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:28:11.445921 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.445747 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d-console-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:28:11.968577 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.968545 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ddfdf87cd-vshfh_8d1bdfe5-8821-4e07-97e1-12c1f28cc79d/console/0.log" Apr 24 14:28:11.968795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.968589 2577 generic.go:358] "Generic (PLEG): container finished" podID="8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" containerID="33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18" exitCode=2 Apr 24 14:28:11.968795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.968625 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddfdf87cd-vshfh" event={"ID":"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d","Type":"ContainerDied","Data":"33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18"} Apr 24 14:28:11.968795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.968656 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ddfdf87cd-vshfh" Apr 24 14:28:11.968795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.968667 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ddfdf87cd-vshfh" event={"ID":"8d1bdfe5-8821-4e07-97e1-12c1f28cc79d","Type":"ContainerDied","Data":"95e4e578cd7e502bf549367e7187818a1c372959dcbb2d4dd1cfb9456073dd96"} Apr 24 14:28:11.968795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.968683 2577 scope.go:117] "RemoveContainer" containerID="33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18" Apr 24 14:28:11.976844 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.976668 2577 scope.go:117] "RemoveContainer" containerID="33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18" Apr 24 14:28:11.977049 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:28:11.976897 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18\": container with ID starting with 33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18 not found: ID does not exist" containerID="33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18" Apr 24 14:28:11.977049 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.976920 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18"} err="failed to get container status \"33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18\": rpc error: code = NotFound desc = could not find container \"33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18\": container with ID starting with 33108ad10a869430b7dae0e121a4362f804f412056af82e30baf3e8943d4df18 not found: ID does not exist" Apr 24 14:28:11.991216 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.991183 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ddfdf87cd-vshfh"] Apr 24 14:28:11.993546 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:11.993526 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ddfdf87cd-vshfh"] Apr 24 14:28:12.142588 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:12.142553 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" path="/var/lib/kubelet/pods/8d1bdfe5-8821-4e07-97e1-12c1f28cc79d/volumes" Apr 24 14:28:45.684495 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.684418 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb"] Apr 24 14:28:45.684932 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.684695 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" containerName="console" Apr 24 14:28:45.684932 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.684707 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" containerName="console" Apr 24 14:28:45.684932 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.684756 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d1bdfe5-8821-4e07-97e1-12c1f28cc79d" containerName="console" Apr 24 14:28:45.687698 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.687683 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.690465 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.690443 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Apr 24 14:28:45.691383 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.691366 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mdnmj\"" Apr 24 14:28:45.691445 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.691368 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Apr 24 14:28:45.695789 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.695766 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb"] Apr 24 14:28:45.805347 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.805309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.805510 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.805368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.805510 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.805432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d8r7\" (UniqueName: \"kubernetes.io/projected/f8e30d37-bff6-4515-b78d-bafd7d6078f9-kube-api-access-7d8r7\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.906183 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.906152 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7d8r7\" (UniqueName: \"kubernetes.io/projected/f8e30d37-bff6-4515-b78d-bafd7d6078f9-kube-api-access-7d8r7\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.906331 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.906193 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.906331 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.906225 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.906560 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.906544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.906613 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.906594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.914789 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.914763 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d8r7\" (UniqueName: \"kubernetes.io/projected/f8e30d37-bff6-4515-b78d-bafd7d6078f9-kube-api-access-7d8r7\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:45.997016 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:45.996989 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:28:46.324205 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:46.324129 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb"] Apr 24 14:28:46.327172 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:28:46.327139 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e30d37_bff6_4515_b78d_bafd7d6078f9.slice/crio-4a8c8e36cccff04584aabbc5bd4a48a9de6e1495fb86751b11a2a09759052016 WatchSource:0}: Error finding container 4a8c8e36cccff04584aabbc5bd4a48a9de6e1495fb86751b11a2a09759052016: Status 404 returned error can't find the container with id 4a8c8e36cccff04584aabbc5bd4a48a9de6e1495fb86751b11a2a09759052016 Apr 24 14:28:47.063130 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:47.063071 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" event={"ID":"f8e30d37-bff6-4515-b78d-bafd7d6078f9","Type":"ContainerStarted","Data":"4a8c8e36cccff04584aabbc5bd4a48a9de6e1495fb86751b11a2a09759052016"} Apr 24 14:28:52.079047 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:52.079013 2577 generic.go:358] "Generic (PLEG): container finished" podID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerID="3f20d6e9f77a1f579fe4a212645a3ca5bc04245212879d2021df7933dbd0fd19" exitCode=0 Apr 24 14:28:52.079532 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:52.079086 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" event={"ID":"f8e30d37-bff6-4515-b78d-bafd7d6078f9","Type":"ContainerDied","Data":"3f20d6e9f77a1f579fe4a212645a3ca5bc04245212879d2021df7933dbd0fd19"} Apr 24 14:28:55.090536 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:55.090489 2577 generic.go:358] "Generic (PLEG): container finished" podID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerID="c049000a32ba7aabed2e14f55e867942863ead1050739014e42558c351db6680" exitCode=0 Apr 24 14:28:55.090902 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:28:55.090540 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" event={"ID":"f8e30d37-bff6-4515-b78d-bafd7d6078f9","Type":"ContainerDied","Data":"c049000a32ba7aabed2e14f55e867942863ead1050739014e42558c351db6680"} Apr 24 14:29:01.276976 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:01.276944 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:29:01.277445 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:01.277085 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:29:02.115197 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:02.115161 2577 generic.go:358] "Generic (PLEG): container finished" podID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerID="ee650c4ee56e903db95b8e78b58363334e8ecc53baa4a8fbd8af32d3c90acea8" exitCode=0 Apr 24 14:29:02.115362 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:02.115217 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" event={"ID":"f8e30d37-bff6-4515-b78d-bafd7d6078f9","Type":"ContainerDied","Data":"ee650c4ee56e903db95b8e78b58363334e8ecc53baa4a8fbd8af32d3c90acea8"} Apr 24 14:29:03.237028 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.237005 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:29:03.319800 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.319768 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-bundle\") pod \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " Apr 24 14:29:03.319974 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.319820 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-util\") pod \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " Apr 24 14:29:03.319974 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.319854 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d8r7\" (UniqueName: \"kubernetes.io/projected/f8e30d37-bff6-4515-b78d-bafd7d6078f9-kube-api-access-7d8r7\") pod \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\" (UID: \"f8e30d37-bff6-4515-b78d-bafd7d6078f9\") " Apr 24 14:29:03.320483 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.320452 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-bundle" (OuterVolumeSpecName: "bundle") pod "f8e30d37-bff6-4515-b78d-bafd7d6078f9" (UID: "f8e30d37-bff6-4515-b78d-bafd7d6078f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 24 14:29:03.322020 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.321999 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e30d37-bff6-4515-b78d-bafd7d6078f9-kube-api-access-7d8r7" (OuterVolumeSpecName: "kube-api-access-7d8r7") pod "f8e30d37-bff6-4515-b78d-bafd7d6078f9" (UID: "f8e30d37-bff6-4515-b78d-bafd7d6078f9"). InnerVolumeSpecName "kube-api-access-7d8r7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 14:29:03.324276 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.324253 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-util" (OuterVolumeSpecName: "util") pod "f8e30d37-bff6-4515-b78d-bafd7d6078f9" (UID: "f8e30d37-bff6-4515-b78d-bafd7d6078f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 24 14:29:03.420503 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.420408 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-bundle\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:29:03.420503 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.420453 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8e30d37-bff6-4515-b78d-bafd7d6078f9-util\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:29:03.420503 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:03.420465 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d8r7\" (UniqueName: \"kubernetes.io/projected/f8e30d37-bff6-4515-b78d-bafd7d6078f9-kube-api-access-7d8r7\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:29:04.121448 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:04.121408 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" event={"ID":"f8e30d37-bff6-4515-b78d-bafd7d6078f9","Type":"ContainerDied","Data":"4a8c8e36cccff04584aabbc5bd4a48a9de6e1495fb86751b11a2a09759052016"} Apr 24 14:29:04.121448 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:04.121446 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a8c8e36cccff04584aabbc5bd4a48a9de6e1495fb86751b11a2a09759052016" Apr 24 14:29:04.121645 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:04.121465 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c9ckjb" Apr 24 14:29:07.295166 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295126 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk"] Apr 24 14:29:07.295513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295378 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerName="util" Apr 24 14:29:07.295513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295388 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerName="util" Apr 24 14:29:07.295513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295405 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerName="pull" Apr 24 14:29:07.295513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295410 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerName="pull" Apr 24 14:29:07.295513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295416 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerName="extract" Apr 24 14:29:07.295513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295423 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerName="extract" Apr 24 14:29:07.295513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.295467 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8e30d37-bff6-4515-b78d-bafd7d6078f9" containerName="extract" Apr 24 14:29:07.299511 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.299494 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.302268 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.302245 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Apr 24 14:29:07.302268 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.302257 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Apr 24 14:29:07.302450 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.302263 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Apr 24 14:29:07.302450 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.302406 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-7l9g5\"" Apr 24 14:29:07.308142 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.308120 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk"] Apr 24 14:29:07.348189 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.348154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/f1048598-3944-48a2-88fe-c571d1a361f7-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk\" (UID: \"f1048598-3944-48a2-88fe-c571d1a361f7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.348349 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.348225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l88tc\" (UniqueName: \"kubernetes.io/projected/f1048598-3944-48a2-88fe-c571d1a361f7-kube-api-access-l88tc\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk\" (UID: \"f1048598-3944-48a2-88fe-c571d1a361f7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.448938 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.448899 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l88tc\" (UniqueName: \"kubernetes.io/projected/f1048598-3944-48a2-88fe-c571d1a361f7-kube-api-access-l88tc\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk\" (UID: \"f1048598-3944-48a2-88fe-c571d1a361f7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.449140 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.448956 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/f1048598-3944-48a2-88fe-c571d1a361f7-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk\" (UID: \"f1048598-3944-48a2-88fe-c571d1a361f7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.451278 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.451249 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/f1048598-3944-48a2-88fe-c571d1a361f7-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk\" (UID: \"f1048598-3944-48a2-88fe-c571d1a361f7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.457138 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.457115 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l88tc\" (UniqueName: \"kubernetes.io/projected/f1048598-3944-48a2-88fe-c571d1a361f7-kube-api-access-l88tc\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk\" (UID: \"f1048598-3944-48a2-88fe-c571d1a361f7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.610943 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.610854 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:07.733155 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.733121 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk"] Apr 24 14:29:07.735876 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:29:07.735848 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1048598_3944_48a2_88fe_c571d1a361f7.slice/crio-8563aa8563d5e5c4c73808e257b69203fc94066e3f16c63f74d487870ee433a5 WatchSource:0}: Error finding container 8563aa8563d5e5c4c73808e257b69203fc94066e3f16c63f74d487870ee433a5: Status 404 returned error can't find the container with id 8563aa8563d5e5c4c73808e257b69203fc94066e3f16c63f74d487870ee433a5 Apr 24 14:29:07.738035 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:07.738016 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 14:29:08.134943 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:08.134908 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" event={"ID":"f1048598-3944-48a2-88fe-c571d1a361f7","Type":"ContainerStarted","Data":"8563aa8563d5e5c4c73808e257b69203fc94066e3f16c63f74d487870ee433a5"} Apr 24 14:29:12.147995 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.147955 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" event={"ID":"f1048598-3944-48a2-88fe-c571d1a361f7","Type":"ContainerStarted","Data":"53bf3c63dd3909acc99879a61110d35a124df606e8a063979a768bed7c60b6c3"} Apr 24 14:29:12.148493 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.148107 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:12.174840 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.174745 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" podStartSLOduration=1.009133075 podStartE2EDuration="5.174729806s" podCreationTimestamp="2026-04-24 14:29:07 +0000 UTC" firstStartedPulling="2026-04-24 14:29:07.738177063 +0000 UTC m=+308.251009650" lastFinishedPulling="2026-04-24 14:29:11.903773791 +0000 UTC m=+312.416606381" observedRunningTime="2026-04-24 14:29:12.173210814 +0000 UTC m=+312.686043423" watchObservedRunningTime="2026-04-24 14:29:12.174729806 +0000 UTC m=+312.687562415" Apr 24 14:29:12.650050 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.650015 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-6k7t6"] Apr 24 14:29:12.653194 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.653177 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.655835 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.655812 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Apr 24 14:29:12.655959 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.655813 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Apr 24 14:29:12.655959 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.655888 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-ggsp2\"" Apr 24 14:29:12.662726 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.662706 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-6k7t6"] Apr 24 14:29:12.688283 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.688262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.688283 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.688291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vktr\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-kube-api-access-7vktr\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.688453 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.688321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-cabundle0\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.789685 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.789646 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-cabundle0\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.789847 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.789725 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.789847 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.789746 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vktr\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-kube-api-access-7vktr\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.789925 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:12.789853 2577 projected.go:264] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Apr 24 14:29:12.789925 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:12.789874 2577 secret.go:281] references non-existent secret key: ca.crt Apr 24 14:29:12.789925 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:12.789881 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Apr 24 14:29:12.789925 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:12.789894 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6k7t6: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Apr 24 14:29:12.790061 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:12.789944 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates podName:4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:13.289929893 +0000 UTC m=+313.802762480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates") pod "keda-operator-ffbb595cb-6k7t6" (UID: "4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Apr 24 14:29:12.790297 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.790275 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-cabundle0\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.799173 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.799149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vktr\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-kube-api-access-7vktr\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:12.937482 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.937451 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs"] Apr 24 14:29:12.940720 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.940697 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:12.943279 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.943261 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Apr 24 14:29:12.951927 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.951904 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs"] Apr 24 14:29:12.991676 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.991651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:12.991838 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.991697 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt9v6\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-kube-api-access-kt9v6\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:12.991838 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:12.991722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:13.092422 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.092390 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:13.092619 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.092437 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kt9v6\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-kube-api-access-kt9v6\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:13.092619 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.092466 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:13.092619 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.092579 2577 secret.go:281] references non-existent secret key: tls.crt Apr 24 14:29:13.092619 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.092593 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Apr 24 14:29:13.092619 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.092613 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs: references non-existent secret key: tls.crt Apr 24 14:29:13.092846 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.092685 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates podName:f5b4a51c-0028-4c3f-aeb0-f53d22cab717 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:13.592665595 +0000 UTC m=+314.105498198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates") pod "keda-metrics-apiserver-7c9f485588-v24fs" (UID: "f5b4a51c-0028-4c3f-aeb0-f53d22cab717") : references non-existent secret key: tls.crt Apr 24 14:29:13.093443 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.093421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:13.101619 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.101591 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt9v6\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-kube-api-access-kt9v6\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:13.156307 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.156274 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-dzk7q"] Apr 24 14:29:13.159371 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.159353 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.162909 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.162888 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Apr 24 14:29:13.174859 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.174837 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-dzk7q"] Apr 24 14:29:13.192985 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.192911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3-certificates\") pod \"keda-admission-cf49989db-dzk7q\" (UID: \"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3\") " pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.193132 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.193036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kddhc\" (UniqueName: \"kubernetes.io/projected/e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3-kube-api-access-kddhc\") pod \"keda-admission-cf49989db-dzk7q\" (UID: \"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3\") " pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.294077 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.294039 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3-certificates\") pod \"keda-admission-cf49989db-dzk7q\" (UID: \"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3\") " pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.294246 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.294113 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kddhc\" (UniqueName: \"kubernetes.io/projected/e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3-kube-api-access-kddhc\") pod \"keda-admission-cf49989db-dzk7q\" (UID: \"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3\") " pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.294300 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.294271 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:13.294451 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.294430 2577 secret.go:281] references non-existent secret key: ca.crt Apr 24 14:29:13.294530 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.294453 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Apr 24 14:29:13.294530 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.294466 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6k7t6: references non-existent secret key: ca.crt Apr 24 14:29:13.294623 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.294545 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates podName:4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:14.294523941 +0000 UTC m=+314.807356532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates") pod "keda-operator-ffbb595cb-6k7t6" (UID: "4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4") : references non-existent secret key: ca.crt Apr 24 14:29:13.297232 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.297207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3-certificates\") pod \"keda-admission-cf49989db-dzk7q\" (UID: \"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3\") " pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.304045 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.304017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kddhc\" (UniqueName: \"kubernetes.io/projected/e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3-kube-api-access-kddhc\") pod \"keda-admission-cf49989db-dzk7q\" (UID: \"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3\") " pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.469262 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.469177 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:13.588733 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.588699 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-dzk7q"] Apr 24 14:29:13.591808 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:29:13.591782 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bd8d0a_0c5e_4d6c_b693_7cba9a15c7d3.slice/crio-8d281ad4b4b757c2b2a6b91b42854b9b4b039dd23dd348e3534e4c4ee5088efa WatchSource:0}: Error finding container 8d281ad4b4b757c2b2a6b91b42854b9b4b039dd23dd348e3534e4c4ee5088efa: Status 404 returned error can't find the container with id 8d281ad4b4b757c2b2a6b91b42854b9b4b039dd23dd348e3534e4c4ee5088efa Apr 24 14:29:13.596755 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:13.596731 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:13.596906 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.596886 2577 secret.go:281] references non-existent secret key: tls.crt Apr 24 14:29:13.596957 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.596910 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Apr 24 14:29:13.596957 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.596930 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs: references non-existent secret key: tls.crt Apr 24 14:29:13.597030 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:13.596978 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates podName:f5b4a51c-0028-4c3f-aeb0-f53d22cab717 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:14.596963433 +0000 UTC m=+315.109796023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates") pod "keda-metrics-apiserver-7c9f485588-v24fs" (UID: "f5b4a51c-0028-4c3f-aeb0-f53d22cab717") : references non-existent secret key: tls.crt Apr 24 14:29:14.155446 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:14.155411 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-dzk7q" event={"ID":"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3","Type":"ContainerStarted","Data":"8d281ad4b4b757c2b2a6b91b42854b9b4b039dd23dd348e3534e4c4ee5088efa"} Apr 24 14:29:14.301277 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:14.301243 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:14.301713 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.301369 2577 secret.go:281] references non-existent secret key: ca.crt Apr 24 14:29:14.301713 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.301382 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Apr 24 14:29:14.301713 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.301391 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6k7t6: references non-existent secret key: ca.crt Apr 24 14:29:14.301713 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.301450 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates podName:4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:16.301435135 +0000 UTC m=+316.814267721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates") pod "keda-operator-ffbb595cb-6k7t6" (UID: "4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4") : references non-existent secret key: ca.crt Apr 24 14:29:14.603892 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:14.603853 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:14.604105 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.603993 2577 secret.go:281] references non-existent secret key: tls.crt Apr 24 14:29:14.604105 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.604008 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Apr 24 14:29:14.604105 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.604027 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs: references non-existent secret key: tls.crt Apr 24 14:29:14.604105 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:14.604086 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates podName:f5b4a51c-0028-4c3f-aeb0-f53d22cab717 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:16.604068134 +0000 UTC m=+317.116900725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates") pod "keda-metrics-apiserver-7c9f485588-v24fs" (UID: "f5b4a51c-0028-4c3f-aeb0-f53d22cab717") : references non-existent secret key: tls.crt Apr 24 14:29:16.162211 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:16.162178 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-dzk7q" event={"ID":"e9bd8d0a-0c5e-4d6c-b693-7cba9a15c7d3","Type":"ContainerStarted","Data":"87877cd0be4bf6a2bf29b71f97a5ab95a66cd040e35b1be458bafe2e95b7b5bd"} Apr 24 14:29:16.162607 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:16.162297 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:16.178219 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:16.178181 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-dzk7q" podStartSLOduration=1.496530518 podStartE2EDuration="3.178168058s" podCreationTimestamp="2026-04-24 14:29:13 +0000 UTC" firstStartedPulling="2026-04-24 14:29:13.593139201 +0000 UTC m=+314.105971791" lastFinishedPulling="2026-04-24 14:29:15.274776745 +0000 UTC m=+315.787609331" observedRunningTime="2026-04-24 14:29:16.177190409 +0000 UTC m=+316.690023017" watchObservedRunningTime="2026-04-24 14:29:16.178168058 +0000 UTC m=+316.691000656" Apr 24 14:29:16.321995 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:16.321956 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:16.322188 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.322129 2577 secret.go:281] references non-existent secret key: ca.crt Apr 24 14:29:16.322188 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.322146 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Apr 24 14:29:16.322188 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.322157 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-6k7t6: references non-existent secret key: ca.crt Apr 24 14:29:16.322298 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.322206 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates podName:4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:20.322192731 +0000 UTC m=+320.835025317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates") pod "keda-operator-ffbb595cb-6k7t6" (UID: "4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4") : references non-existent secret key: ca.crt Apr 24 14:29:16.624360 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:16.624316 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:16.624533 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.624456 2577 secret.go:281] references non-existent secret key: tls.crt Apr 24 14:29:16.624533 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.624473 2577 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Apr 24 14:29:16.624533 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.624490 2577 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs: references non-existent secret key: tls.crt Apr 24 14:29:16.624636 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:29:16.624540 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates podName:f5b4a51c-0028-4c3f-aeb0-f53d22cab717 nodeName:}" failed. No retries permitted until 2026-04-24 14:29:20.624525689 +0000 UTC m=+321.137358276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates") pod "keda-metrics-apiserver-7c9f485588-v24fs" (UID: "f5b4a51c-0028-4c3f-aeb0-f53d22cab717") : references non-existent secret key: tls.crt Apr 24 14:29:20.353301 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.353260 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:20.355768 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.355739 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4-certificates\") pod \"keda-operator-ffbb595cb-6k7t6\" (UID: \"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4\") " pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:20.463631 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.463583 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:20.582320 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.582124 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-6k7t6"] Apr 24 14:29:20.584423 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:29:20.584383 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f94fb79_c2b9_45d3_8ce5_52b7eab89cf4.slice/crio-27f20015a8c661d4d85eb596632dca8c413f1cd4b76838f6402d8691c4b105af WatchSource:0}: Error finding container 27f20015a8c661d4d85eb596632dca8c413f1cd4b76838f6402d8691c4b105af: Status 404 returned error can't find the container with id 27f20015a8c661d4d85eb596632dca8c413f1cd4b76838f6402d8691c4b105af Apr 24 14:29:20.657754 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.657657 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:20.660746 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.660722 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5b4a51c-0028-4c3f-aeb0-f53d22cab717-certificates\") pod \"keda-metrics-apiserver-7c9f485588-v24fs\" (UID: \"f5b4a51c-0028-4c3f-aeb0-f53d22cab717\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:20.750905 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.750863 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:20.871357 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:20.871262 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs"] Apr 24 14:29:20.873872 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:29:20.873836 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b4a51c_0028_4c3f_aeb0_f53d22cab717.slice/crio-8d2ea049566150334e985b5f1bb5455ce5d63b1e1f1c012198c93e7956209253 WatchSource:0}: Error finding container 8d2ea049566150334e985b5f1bb5455ce5d63b1e1f1c012198c93e7956209253: Status 404 returned error can't find the container with id 8d2ea049566150334e985b5f1bb5455ce5d63b1e1f1c012198c93e7956209253 Apr 24 14:29:21.175343 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:21.175305 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" event={"ID":"f5b4a51c-0028-4c3f-aeb0-f53d22cab717","Type":"ContainerStarted","Data":"8d2ea049566150334e985b5f1bb5455ce5d63b1e1f1c012198c93e7956209253"} Apr 24 14:29:21.176258 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:21.176233 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" event={"ID":"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4","Type":"ContainerStarted","Data":"27f20015a8c661d4d85eb596632dca8c413f1cd4b76838f6402d8691c4b105af"} Apr 24 14:29:25.191766 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:25.191730 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" event={"ID":"f5b4a51c-0028-4c3f-aeb0-f53d22cab717","Type":"ContainerStarted","Data":"040e25dbbdff08a0a484768a7781dd5654c4b1f8a6b5c67970ae5e25a3615dd5"} Apr 24 14:29:25.192241 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:25.192026 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:25.213851 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:25.213798 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" podStartSLOduration=9.062639714 podStartE2EDuration="13.213781699s" podCreationTimestamp="2026-04-24 14:29:12 +0000 UTC" firstStartedPulling="2026-04-24 14:29:20.875185948 +0000 UTC m=+321.388018534" lastFinishedPulling="2026-04-24 14:29:25.026327933 +0000 UTC m=+325.539160519" observedRunningTime="2026-04-24 14:29:25.212414249 +0000 UTC m=+325.725246858" watchObservedRunningTime="2026-04-24 14:29:25.213781699 +0000 UTC m=+325.726614311" Apr 24 14:29:27.198547 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:27.198503 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" event={"ID":"4f94fb79-c2b9-45d3-8ce5-52b7eab89cf4","Type":"ContainerStarted","Data":"f630f8d0a381860df35c512378f94bf32bb76c602457b84bcd2d7c43b46d4ce4"} Apr 24 14:29:27.198935 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:27.198694 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:29:27.216612 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:27.216559 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" podStartSLOduration=9.481233008 podStartE2EDuration="15.216545754s" podCreationTimestamp="2026-04-24 14:29:12 +0000 UTC" firstStartedPulling="2026-04-24 14:29:20.585610416 +0000 UTC m=+321.098443001" lastFinishedPulling="2026-04-24 14:29:26.32092315 +0000 UTC m=+326.833755747" observedRunningTime="2026-04-24 14:29:27.215168868 +0000 UTC m=+327.728001476" watchObservedRunningTime="2026-04-24 14:29:27.216545754 +0000 UTC m=+327.729378360" Apr 24 14:29:33.154526 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:33.154494 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-xjzmk" Apr 24 14:29:36.199456 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:36.199425 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-v24fs" Apr 24 14:29:37.167159 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:37.167130 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-dzk7q" Apr 24 14:29:48.203943 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:29:48.203912 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-6k7t6" Apr 24 14:30:18.973892 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.973851 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-d59p2"] Apr 24 14:30:18.977197 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.977174 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:18.979914 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.979886 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Apr 24 14:30:18.980043 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.979886 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-6gpxq\"" Apr 24 14:30:18.980921 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.980902 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Apr 24 14:30:18.981029 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.980940 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Apr 24 14:30:18.984217 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.984115 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-knzsh"] Apr 24 14:30:18.987250 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.987230 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:18.987473 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.987453 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-d59p2"] Apr 24 14:30:18.989585 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.989563 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Apr 24 14:30:18.989670 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.989653 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-h62t7\"" Apr 24 14:30:18.996344 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:18.996323 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-knzsh"] Apr 24 14:30:19.019426 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.019395 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-86cc847c5c-kmvcj"] Apr 24 14:30:19.019760 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.019723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgggz\" (UniqueName: \"kubernetes.io/projected/fe429d58-e154-4e2e-af8c-358a653d66b1-kube-api-access-mgggz\") pod \"kserve-controller-manager-b7dc77d59-d59p2\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:19.019821 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.019771 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe429d58-e154-4e2e-af8c-358a653d66b1-cert\") pod \"kserve-controller-manager-b7dc77d59-d59p2\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:19.022587 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.022572 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.025453 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.025439 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-lngv4\"" Apr 24 14:30:19.025718 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.025703 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Apr 24 14:30:19.036422 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.036396 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-86cc847c5c-kmvcj"] Apr 24 14:30:19.121318 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.121277 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz2kr\" (UniqueName: \"kubernetes.io/projected/02826335-5a08-424a-9ea8-13845b10c359-kube-api-access-vz2kr\") pod \"seaweedfs-86cc847c5c-kmvcj\" (UID: \"02826335-5a08-424a-9ea8-13845b10c359\") " pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.121495 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.121332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc73399-a45f-4848-844b-09396f327eef-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-knzsh\" (UID: \"bcc73399-a45f-4848-844b-09396f327eef\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:19.121495 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.121379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrc89\" (UniqueName: \"kubernetes.io/projected/bcc73399-a45f-4848-844b-09396f327eef-kube-api-access-rrc89\") pod \"llmisvc-controller-manager-68cc5db7c4-knzsh\" (UID: \"bcc73399-a45f-4848-844b-09396f327eef\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:19.121495 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.121463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02826335-5a08-424a-9ea8-13845b10c359-data\") pod \"seaweedfs-86cc847c5c-kmvcj\" (UID: \"02826335-5a08-424a-9ea8-13845b10c359\") " pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.121608 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.121510 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgggz\" (UniqueName: \"kubernetes.io/projected/fe429d58-e154-4e2e-af8c-358a653d66b1-kube-api-access-mgggz\") pod \"kserve-controller-manager-b7dc77d59-d59p2\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:19.121608 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.121535 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe429d58-e154-4e2e-af8c-358a653d66b1-cert\") pod \"kserve-controller-manager-b7dc77d59-d59p2\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:19.124007 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.123968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe429d58-e154-4e2e-af8c-358a653d66b1-cert\") pod \"kserve-controller-manager-b7dc77d59-d59p2\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:19.133548 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.133518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgggz\" (UniqueName: \"kubernetes.io/projected/fe429d58-e154-4e2e-af8c-358a653d66b1-kube-api-access-mgggz\") pod \"kserve-controller-manager-b7dc77d59-d59p2\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:19.222248 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.222211 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrc89\" (UniqueName: \"kubernetes.io/projected/bcc73399-a45f-4848-844b-09396f327eef-kube-api-access-rrc89\") pod \"llmisvc-controller-manager-68cc5db7c4-knzsh\" (UID: \"bcc73399-a45f-4848-844b-09396f327eef\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:19.222432 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.222272 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02826335-5a08-424a-9ea8-13845b10c359-data\") pod \"seaweedfs-86cc847c5c-kmvcj\" (UID: \"02826335-5a08-424a-9ea8-13845b10c359\") " pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.222432 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.222299 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vz2kr\" (UniqueName: \"kubernetes.io/projected/02826335-5a08-424a-9ea8-13845b10c359-kube-api-access-vz2kr\") pod \"seaweedfs-86cc847c5c-kmvcj\" (UID: \"02826335-5a08-424a-9ea8-13845b10c359\") " pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.222432 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.222320 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc73399-a45f-4848-844b-09396f327eef-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-knzsh\" (UID: \"bcc73399-a45f-4848-844b-09396f327eef\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:19.222708 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.222675 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/02826335-5a08-424a-9ea8-13845b10c359-data\") pod \"seaweedfs-86cc847c5c-kmvcj\" (UID: \"02826335-5a08-424a-9ea8-13845b10c359\") " pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.224744 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.224698 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc73399-a45f-4848-844b-09396f327eef-cert\") pod \"llmisvc-controller-manager-68cc5db7c4-knzsh\" (UID: \"bcc73399-a45f-4848-844b-09396f327eef\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:19.232341 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.232319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrc89\" (UniqueName: \"kubernetes.io/projected/bcc73399-a45f-4848-844b-09396f327eef-kube-api-access-rrc89\") pod \"llmisvc-controller-manager-68cc5db7c4-knzsh\" (UID: \"bcc73399-a45f-4848-844b-09396f327eef\") " pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:19.232452 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.232429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz2kr\" (UniqueName: \"kubernetes.io/projected/02826335-5a08-424a-9ea8-13845b10c359-kube-api-access-vz2kr\") pod \"seaweedfs-86cc847c5c-kmvcj\" (UID: \"02826335-5a08-424a-9ea8-13845b10c359\") " pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.288888 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.288848 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:19.297881 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.297848 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:19.332024 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.331984 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:19.427570 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.427490 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-d59p2"] Apr 24 14:30:19.450890 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.450850 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-68cc5db7c4-knzsh"] Apr 24 14:30:19.454427 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:30:19.454397 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbcc73399_a45f_4848_844b_09396f327eef.slice/crio-33b8affc29a2600d2fb6475c7cea89194a81da5a7d017bfc04707714379a3981 WatchSource:0}: Error finding container 33b8affc29a2600d2fb6475c7cea89194a81da5a7d017bfc04707714379a3981: Status 404 returned error can't find the container with id 33b8affc29a2600d2fb6475c7cea89194a81da5a7d017bfc04707714379a3981 Apr 24 14:30:19.478241 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:19.478152 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-86cc847c5c-kmvcj"] Apr 24 14:30:19.480744 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:30:19.480715 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02826335_5a08_424a_9ea8_13845b10c359.slice/crio-b3a54ca6887353b512b36e7092a166617822ef8abfb35625e241e887129a71e5 WatchSource:0}: Error finding container b3a54ca6887353b512b36e7092a166617822ef8abfb35625e241e887129a71e5: Status 404 returned error can't find the container with id b3a54ca6887353b512b36e7092a166617822ef8abfb35625e241e887129a71e5 Apr 24 14:30:20.354958 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:20.354918 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" event={"ID":"fe429d58-e154-4e2e-af8c-358a653d66b1","Type":"ContainerStarted","Data":"d76734f2f9f832b4e3ede1b397e91b8475b6bfc010c18ca947190f6d2b1f7234"} Apr 24 14:30:20.357044 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:20.357005 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-86cc847c5c-kmvcj" event={"ID":"02826335-5a08-424a-9ea8-13845b10c359","Type":"ContainerStarted","Data":"b3a54ca6887353b512b36e7092a166617822ef8abfb35625e241e887129a71e5"} Apr 24 14:30:20.358894 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:20.358848 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" event={"ID":"bcc73399-a45f-4848-844b-09396f327eef","Type":"ContainerStarted","Data":"33b8affc29a2600d2fb6475c7cea89194a81da5a7d017bfc04707714379a3981"} Apr 24 14:30:24.374861 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.374829 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" event={"ID":"bcc73399-a45f-4848-844b-09396f327eef","Type":"ContainerStarted","Data":"17bad0c07021a0a8a60f7394f5ef31ff5071d8a56eed642ddbdde8c0740e1781"} Apr 24 14:30:24.375328 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.374885 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:24.376224 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.376196 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" event={"ID":"fe429d58-e154-4e2e-af8c-358a653d66b1","Type":"ContainerStarted","Data":"c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36"} Apr 24 14:30:24.376351 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.376242 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:24.377406 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.377388 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-86cc847c5c-kmvcj" event={"ID":"02826335-5a08-424a-9ea8-13845b10c359","Type":"ContainerStarted","Data":"232f5fc8ec5c61910ff718207691cb6f4801fbdf5b9a09660e0957de02422a4f"} Apr 24 14:30:24.377521 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.377493 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:24.395887 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.395839 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" podStartSLOduration=1.703366444 podStartE2EDuration="6.395825024s" podCreationTimestamp="2026-04-24 14:30:18 +0000 UTC" firstStartedPulling="2026-04-24 14:30:19.456397487 +0000 UTC m=+379.969230088" lastFinishedPulling="2026-04-24 14:30:24.148856082 +0000 UTC m=+384.661688668" observedRunningTime="2026-04-24 14:30:24.394845081 +0000 UTC m=+384.907677691" watchObservedRunningTime="2026-04-24 14:30:24.395825024 +0000 UTC m=+384.908657631" Apr 24 14:30:24.415507 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.415461 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" podStartSLOduration=2.476717857 podStartE2EDuration="6.415446089s" podCreationTimestamp="2026-04-24 14:30:18 +0000 UTC" firstStartedPulling="2026-04-24 14:30:19.433236551 +0000 UTC m=+379.946069137" lastFinishedPulling="2026-04-24 14:30:23.371964782 +0000 UTC m=+383.884797369" observedRunningTime="2026-04-24 14:30:24.414081117 +0000 UTC m=+384.926913746" watchObservedRunningTime="2026-04-24 14:30:24.415446089 +0000 UTC m=+384.928278696" Apr 24 14:30:24.435177 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:24.435115 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-86cc847c5c-kmvcj" podStartSLOduration=1.717889005 podStartE2EDuration="6.435081187s" podCreationTimestamp="2026-04-24 14:30:18 +0000 UTC" firstStartedPulling="2026-04-24 14:30:19.4820853 +0000 UTC m=+379.994917887" lastFinishedPulling="2026-04-24 14:30:24.199277479 +0000 UTC m=+384.712110069" observedRunningTime="2026-04-24 14:30:24.432110473 +0000 UTC m=+384.944943081" watchObservedRunningTime="2026-04-24 14:30:24.435081187 +0000 UTC m=+384.947913796" Apr 24 14:30:30.383203 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:30.383170 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-86cc847c5c-kmvcj" Apr 24 14:30:55.382688 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:55.382656 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-68cc5db7c4-knzsh" Apr 24 14:30:55.385756 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:55.385731 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:56.630683 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.630651 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-d59p2"] Apr 24 14:30:56.631087 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.630874 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" podUID="fe429d58-e154-4e2e-af8c-358a653d66b1" containerName="manager" containerID="cri-o://c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36" gracePeriod=10 Apr 24 14:30:56.652469 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.652440 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-sn2c5"] Apr 24 14:30:56.724044 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.724014 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-sn2c5"] Apr 24 14:30:56.724165 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.724153 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:56.826595 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.826558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76766c9-5893-4639-9297-840ff50a0d05-cert\") pod \"kserve-controller-manager-b7dc77d59-sn2c5\" (UID: \"b76766c9-5893-4639-9297-840ff50a0d05\") " pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:56.826720 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.826673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzx6k\" (UniqueName: \"kubernetes.io/projected/b76766c9-5893-4639-9297-840ff50a0d05-kube-api-access-hzx6k\") pod \"kserve-controller-manager-b7dc77d59-sn2c5\" (UID: \"b76766c9-5893-4639-9297-840ff50a0d05\") " pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:56.896624 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.896601 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:56.928026 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.927994 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76766c9-5893-4639-9297-840ff50a0d05-cert\") pod \"kserve-controller-manager-b7dc77d59-sn2c5\" (UID: \"b76766c9-5893-4639-9297-840ff50a0d05\") " pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:56.928228 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.928055 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzx6k\" (UniqueName: \"kubernetes.io/projected/b76766c9-5893-4639-9297-840ff50a0d05-kube-api-access-hzx6k\") pod \"kserve-controller-manager-b7dc77d59-sn2c5\" (UID: \"b76766c9-5893-4639-9297-840ff50a0d05\") " pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:56.930385 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.930360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76766c9-5893-4639-9297-840ff50a0d05-cert\") pod \"kserve-controller-manager-b7dc77d59-sn2c5\" (UID: \"b76766c9-5893-4639-9297-840ff50a0d05\") " pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:56.937811 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:56.937781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzx6k\" (UniqueName: \"kubernetes.io/projected/b76766c9-5893-4639-9297-840ff50a0d05-kube-api-access-hzx6k\") pod \"kserve-controller-manager-b7dc77d59-sn2c5\" (UID: \"b76766c9-5893-4639-9297-840ff50a0d05\") " pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:57.028527 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.028490 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe429d58-e154-4e2e-af8c-358a653d66b1-cert\") pod \"fe429d58-e154-4e2e-af8c-358a653d66b1\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " Apr 24 14:30:57.028689 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.028549 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgggz\" (UniqueName: \"kubernetes.io/projected/fe429d58-e154-4e2e-af8c-358a653d66b1-kube-api-access-mgggz\") pod \"fe429d58-e154-4e2e-af8c-358a653d66b1\" (UID: \"fe429d58-e154-4e2e-af8c-358a653d66b1\") " Apr 24 14:30:57.030605 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.030572 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe429d58-e154-4e2e-af8c-358a653d66b1-cert" (OuterVolumeSpecName: "cert") pod "fe429d58-e154-4e2e-af8c-358a653d66b1" (UID: "fe429d58-e154-4e2e-af8c-358a653d66b1"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:30:57.030722 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.030618 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe429d58-e154-4e2e-af8c-358a653d66b1-kube-api-access-mgggz" (OuterVolumeSpecName: "kube-api-access-mgggz") pod "fe429d58-e154-4e2e-af8c-358a653d66b1" (UID: "fe429d58-e154-4e2e-af8c-358a653d66b1"). InnerVolumeSpecName "kube-api-access-mgggz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 14:30:57.080166 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.080135 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:57.129892 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.129862 2577 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe429d58-e154-4e2e-af8c-358a653d66b1-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:30:57.130008 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.129899 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgggz\" (UniqueName: \"kubernetes.io/projected/fe429d58-e154-4e2e-af8c-358a653d66b1-kube-api-access-mgggz\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:30:57.196119 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.196074 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-sn2c5"] Apr 24 14:30:57.198469 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:30:57.198442 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76766c9_5893_4639_9297_840ff50a0d05.slice/crio-4817d7a9e11aabcc3d932f72f4f8a8350e65cd4c6fe9ad2da7fab4c79e90076f WatchSource:0}: Error finding container 4817d7a9e11aabcc3d932f72f4f8a8350e65cd4c6fe9ad2da7fab4c79e90076f: Status 404 returned error can't find the container with id 4817d7a9e11aabcc3d932f72f4f8a8350e65cd4c6fe9ad2da7fab4c79e90076f Apr 24 14:30:57.483588 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.483554 2577 generic.go:358] "Generic (PLEG): container finished" podID="fe429d58-e154-4e2e-af8c-358a653d66b1" containerID="c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36" exitCode=0 Apr 24 14:30:57.483743 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.483613 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" Apr 24 14:30:57.483743 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.483637 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" event={"ID":"fe429d58-e154-4e2e-af8c-358a653d66b1","Type":"ContainerDied","Data":"c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36"} Apr 24 14:30:57.483743 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.483668 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b7dc77d59-d59p2" event={"ID":"fe429d58-e154-4e2e-af8c-358a653d66b1","Type":"ContainerDied","Data":"d76734f2f9f832b4e3ede1b397e91b8475b6bfc010c18ca947190f6d2b1f7234"} Apr 24 14:30:57.483743 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.483689 2577 scope.go:117] "RemoveContainer" containerID="c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36" Apr 24 14:30:57.484829 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.484807 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" event={"ID":"b76766c9-5893-4639-9297-840ff50a0d05","Type":"ContainerStarted","Data":"4817d7a9e11aabcc3d932f72f4f8a8350e65cd4c6fe9ad2da7fab4c79e90076f"} Apr 24 14:30:57.491488 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.491468 2577 scope.go:117] "RemoveContainer" containerID="c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36" Apr 24 14:30:57.491752 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:30:57.491730 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36\": container with ID starting with c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36 not found: ID does not exist" containerID="c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36" Apr 24 14:30:57.491805 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.491764 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36"} err="failed to get container status \"c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36\": rpc error: code = NotFound desc = could not find container \"c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36\": container with ID starting with c5011f09a6d1e790f016ecc177cd88d5b2e8fa096d4c23074e619169ee33bc36 not found: ID does not exist" Apr 24 14:30:57.508117 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.506228 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-d59p2"] Apr 24 14:30:57.511067 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:57.511040 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-b7dc77d59-d59p2"] Apr 24 14:30:58.143448 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:58.143370 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe429d58-e154-4e2e-af8c-358a653d66b1" path="/var/lib/kubelet/pods/fe429d58-e154-4e2e-af8c-358a653d66b1/volumes" Apr 24 14:30:58.489080 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:58.489045 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" event={"ID":"b76766c9-5893-4639-9297-840ff50a0d05","Type":"ContainerStarted","Data":"56c837934a1a41511b5d7042e1c07cc5d694d00bd98245185c815fb1f977647b"} Apr 24 14:30:58.489247 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:58.489105 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:30:58.506871 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:30:58.506819 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" podStartSLOduration=1.854786671 podStartE2EDuration="2.506802232s" podCreationTimestamp="2026-04-24 14:30:56 +0000 UTC" firstStartedPulling="2026-04-24 14:30:57.199669959 +0000 UTC m=+417.712502546" lastFinishedPulling="2026-04-24 14:30:57.851685508 +0000 UTC m=+418.364518107" observedRunningTime="2026-04-24 14:30:58.505550112 +0000 UTC m=+419.018382720" watchObservedRunningTime="2026-04-24 14:30:58.506802232 +0000 UTC m=+419.019634840" Apr 24 14:31:21.348767 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.348682 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc4858478-l62p9"] Apr 24 14:31:21.349354 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.349143 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe429d58-e154-4e2e-af8c-358a653d66b1" containerName="manager" Apr 24 14:31:21.349354 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.349162 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe429d58-e154-4e2e-af8c-358a653d66b1" containerName="manager" Apr 24 14:31:21.349354 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.349260 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe429d58-e154-4e2e-af8c-358a653d66b1" containerName="manager" Apr 24 14:31:21.352210 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.352190 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.364508 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.364489 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc4858478-l62p9"] Apr 24 14:31:21.535085 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.535042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzjgw\" (UniqueName: \"kubernetes.io/projected/e49a1885-480c-4ada-97c5-92f0f39ff26c-kube-api-access-fzjgw\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.535296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.535114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-serving-cert\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.535296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.535141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-service-ca\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.535296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.535164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-config\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.535296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.535205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-oauth-serving-cert\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.535296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.535232 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-trusted-ca-bundle\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.535526 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.535311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-oauth-config\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.636820 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.636726 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-oauth-serving-cert\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.636820 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.636766 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-trusted-ca-bundle\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.636820 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.636790 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-oauth-config\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637119 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.636843 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzjgw\" (UniqueName: \"kubernetes.io/projected/e49a1885-480c-4ada-97c5-92f0f39ff26c-kube-api-access-fzjgw\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637119 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.636872 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-serving-cert\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637119 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.636895 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-service-ca\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637119 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.636923 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-config\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637556 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.637531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-oauth-serving-cert\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637677 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.637646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-config\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637677 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.637660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-service-ca\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.637743 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.637727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49a1885-480c-4ada-97c5-92f0f39ff26c-trusted-ca-bundle\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.639774 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.639749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-oauth-config\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.639989 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.639960 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e49a1885-480c-4ada-97c5-92f0f39ff26c-console-serving-cert\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.645454 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.645432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzjgw\" (UniqueName: \"kubernetes.io/projected/e49a1885-480c-4ada-97c5-92f0f39ff26c-kube-api-access-fzjgw\") pod \"console-fc4858478-l62p9\" (UID: \"e49a1885-480c-4ada-97c5-92f0f39ff26c\") " pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.661024 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.660996 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:21.784678 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:21.784647 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc4858478-l62p9"] Apr 24 14:31:21.787999 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:31:21.787965 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49a1885_480c_4ada_97c5_92f0f39ff26c.slice/crio-fe2b4129abeaa3346832aa48d65fc3345e6326f6151db36e401d4fdffad72497 WatchSource:0}: Error finding container fe2b4129abeaa3346832aa48d65fc3345e6326f6151db36e401d4fdffad72497: Status 404 returned error can't find the container with id fe2b4129abeaa3346832aa48d65fc3345e6326f6151db36e401d4fdffad72497 Apr 24 14:31:22.565501 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:22.565467 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc4858478-l62p9" event={"ID":"e49a1885-480c-4ada-97c5-92f0f39ff26c","Type":"ContainerStarted","Data":"99f3f91daa6d65607ea7c904f8b83e0b4c880438af2d39ed592ddcb615a0e4d4"} Apr 24 14:31:22.565501 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:22.565502 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc4858478-l62p9" event={"ID":"e49a1885-480c-4ada-97c5-92f0f39ff26c","Type":"ContainerStarted","Data":"fe2b4129abeaa3346832aa48d65fc3345e6326f6151db36e401d4fdffad72497"} Apr 24 14:31:22.583458 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:22.583415 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-fc4858478-l62p9" podStartSLOduration=1.583401121 podStartE2EDuration="1.583401121s" podCreationTimestamp="2026-04-24 14:31:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 14:31:22.582610168 +0000 UTC m=+443.095442778" watchObservedRunningTime="2026-04-24 14:31:22.583401121 +0000 UTC m=+443.096233728" Apr 24 14:31:29.498462 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:29.498429 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-b7dc77d59-sn2c5" Apr 24 14:31:31.661882 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:31.661843 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:31.662274 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:31.662167 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:31.666905 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:31.666880 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:32.601692 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:32.601665 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc4858478-l62p9" Apr 24 14:31:32.648296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:32.648266 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f97c9bfb8-phlqn"] Apr 24 14:31:57.666965 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:57.666894 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f97c9bfb8-phlqn" podUID="a03658d8-06a2-48b9-a187-b569f67dcc24" containerName="console" containerID="cri-o://6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac" gracePeriod=15 Apr 24 14:31:57.903364 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:57.903341 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f97c9bfb8-phlqn_a03658d8-06a2-48b9-a187-b569f67dcc24/console/0.log" Apr 24 14:31:57.903481 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:57.903401 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:31:58.042025 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.041985 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bvnb\" (UniqueName: \"kubernetes.io/projected/a03658d8-06a2-48b9-a187-b569f67dcc24-kube-api-access-2bvnb\") pod \"a03658d8-06a2-48b9-a187-b569f67dcc24\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " Apr 24 14:31:58.042025 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042025 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-oauth-serving-cert\") pod \"a03658d8-06a2-48b9-a187-b569f67dcc24\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " Apr 24 14:31:58.042309 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042042 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-trusted-ca-bundle\") pod \"a03658d8-06a2-48b9-a187-b569f67dcc24\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " Apr 24 14:31:58.042309 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042059 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-oauth-config\") pod \"a03658d8-06a2-48b9-a187-b569f67dcc24\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " Apr 24 14:31:58.042309 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042121 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-service-ca\") pod \"a03658d8-06a2-48b9-a187-b569f67dcc24\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " Apr 24 14:31:58.042309 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042147 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-console-config\") pod \"a03658d8-06a2-48b9-a187-b569f67dcc24\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " Apr 24 14:31:58.042309 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042173 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-serving-cert\") pod \"a03658d8-06a2-48b9-a187-b569f67dcc24\" (UID: \"a03658d8-06a2-48b9-a187-b569f67dcc24\") " Apr 24 14:31:58.042558 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042432 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a03658d8-06a2-48b9-a187-b569f67dcc24" (UID: "a03658d8-06a2-48b9-a187-b569f67dcc24"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:31:58.042558 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042506 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a03658d8-06a2-48b9-a187-b569f67dcc24" (UID: "a03658d8-06a2-48b9-a187-b569f67dcc24"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:31:58.042634 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042575 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-console-config" (OuterVolumeSpecName: "console-config") pod "a03658d8-06a2-48b9-a187-b569f67dcc24" (UID: "a03658d8-06a2-48b9-a187-b569f67dcc24"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:31:58.042795 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.042771 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-service-ca" (OuterVolumeSpecName: "service-ca") pod "a03658d8-06a2-48b9-a187-b569f67dcc24" (UID: "a03658d8-06a2-48b9-a187-b569f67dcc24"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 24 14:31:58.044296 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.044267 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a03658d8-06a2-48b9-a187-b569f67dcc24" (UID: "a03658d8-06a2-48b9-a187-b569f67dcc24"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:31:58.044390 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.044300 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03658d8-06a2-48b9-a187-b569f67dcc24-kube-api-access-2bvnb" (OuterVolumeSpecName: "kube-api-access-2bvnb") pod "a03658d8-06a2-48b9-a187-b569f67dcc24" (UID: "a03658d8-06a2-48b9-a187-b569f67dcc24"). InnerVolumeSpecName "kube-api-access-2bvnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 24 14:31:58.044390 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.044297 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a03658d8-06a2-48b9-a187-b569f67dcc24" (UID: "a03658d8-06a2-48b9-a187-b569f67dcc24"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 24 14:31:58.143534 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.143504 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bvnb\" (UniqueName: \"kubernetes.io/projected/a03658d8-06a2-48b9-a187-b569f67dcc24-kube-api-access-2bvnb\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:31:58.143534 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.143528 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-oauth-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:31:58.143534 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.143538 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-trusted-ca-bundle\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:31:58.143749 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.143547 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-oauth-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:31:58.143749 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.143557 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-service-ca\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:31:58.143749 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.143565 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a03658d8-06a2-48b9-a187-b569f67dcc24-console-config\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:31:58.143749 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.143573 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a03658d8-06a2-48b9-a187-b569f67dcc24-console-serving-cert\") on node \"ip-10-0-143-187.ec2.internal\" DevicePath \"\"" Apr 24 14:31:58.687662 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.687636 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f97c9bfb8-phlqn_a03658d8-06a2-48b9-a187-b569f67dcc24/console/0.log" Apr 24 14:31:58.688136 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.687674 2577 generic.go:358] "Generic (PLEG): container finished" podID="a03658d8-06a2-48b9-a187-b569f67dcc24" containerID="6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac" exitCode=2 Apr 24 14:31:58.688136 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.687710 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f97c9bfb8-phlqn" event={"ID":"a03658d8-06a2-48b9-a187-b569f67dcc24","Type":"ContainerDied","Data":"6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac"} Apr 24 14:31:58.688136 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.687734 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f97c9bfb8-phlqn" Apr 24 14:31:58.688136 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.687760 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f97c9bfb8-phlqn" event={"ID":"a03658d8-06a2-48b9-a187-b569f67dcc24","Type":"ContainerDied","Data":"8365a80651385149d2853fa493459bb8ffbfb0668f9f45bf686ba14f1d87f0f7"} Apr 24 14:31:58.688136 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.687782 2577 scope.go:117] "RemoveContainer" containerID="6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac" Apr 24 14:31:58.695527 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.695510 2577 scope.go:117] "RemoveContainer" containerID="6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac" Apr 24 14:31:58.695750 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:31:58.695732 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac\": container with ID starting with 6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac not found: ID does not exist" containerID="6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac" Apr 24 14:31:58.695798 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.695759 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac"} err="failed to get container status \"6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac\": rpc error: code = NotFound desc = could not find container \"6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac\": container with ID starting with 6cd66d9ee1ce664839b973e81eaccb5f8aa3bc9b651924c7a3c6021a817507ac not found: ID does not exist" Apr 24 14:31:58.706814 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.706790 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f97c9bfb8-phlqn"] Apr 24 14:31:58.710902 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:31:58.710884 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f97c9bfb8-phlqn"] Apr 24 14:32:00.143594 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:00.143565 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03658d8-06a2-48b9-a187-b569f67dcc24" path="/var/lib/kubelet/pods/a03658d8-06a2-48b9-a187-b569f67dcc24/volumes" Apr 24 14:32:06.425682 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.425638 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj"] Apr 24 14:32:06.426178 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.426145 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03658d8-06a2-48b9-a187-b569f67dcc24" containerName="console" Apr 24 14:32:06.426178 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.426164 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03658d8-06a2-48b9-a187-b569f67dcc24" containerName="console" Apr 24 14:32:06.426311 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.426239 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="a03658d8-06a2-48b9-a187-b569f67dcc24" containerName="console" Apr 24 14:32:06.430649 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.430627 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.433541 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.433521 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Apr 24 14:32:06.433651 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.433522 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Apr 24 14:32:06.437070 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.437048 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj"] Apr 24 14:32:06.512420 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.512381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ac82ff1-09cd-4202-b51a-b2df667f34c3-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.512604 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.512465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxfbx\" (UniqueName: \"kubernetes.io/projected/7ac82ff1-09cd-4202-b51a-b2df667f34c3-kube-api-access-gxfbx\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.512604 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.512517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/7ac82ff1-09cd-4202-b51a-b2df667f34c3-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.612876 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.612841 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxfbx\" (UniqueName: \"kubernetes.io/projected/7ac82ff1-09cd-4202-b51a-b2df667f34c3-kube-api-access-gxfbx\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.613024 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.612893 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/7ac82ff1-09cd-4202-b51a-b2df667f34c3-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.613131 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.613081 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ac82ff1-09cd-4202-b51a-b2df667f34c3-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.613450 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.613427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7ac82ff1-09cd-4202-b51a-b2df667f34c3-data\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.615234 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.615203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/7ac82ff1-09cd-4202-b51a-b2df667f34c3-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.621888 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.621868 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxfbx\" (UniqueName: \"kubernetes.io/projected/7ac82ff1-09cd-4202-b51a-b2df667f34c3-kube-api-access-gxfbx\") pod \"seaweedfs-tls-custom-5c88b85bb7-bfrmj\" (UID: \"7ac82ff1-09cd-4202-b51a-b2df667f34c3\") " pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.740981 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.740947 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" Apr 24 14:32:06.861363 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:06.861207 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj"] Apr 24 14:32:06.863872 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:32:06.863839 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac82ff1_09cd_4202_b51a_b2df667f34c3.slice/crio-5debc55fa927a49eac99b17f606e9bf9acb4121b03bc99f902b8113724d5810b WatchSource:0}: Error finding container 5debc55fa927a49eac99b17f606e9bf9acb4121b03bc99f902b8113724d5810b: Status 404 returned error can't find the container with id 5debc55fa927a49eac99b17f606e9bf9acb4121b03bc99f902b8113724d5810b Apr 24 14:32:07.718810 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:07.718765 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" event={"ID":"7ac82ff1-09cd-4202-b51a-b2df667f34c3","Type":"ContainerStarted","Data":"c34269ea3504076469508dd53db904919dd85a9b13abffea9cfb156a1b1c0f98"} Apr 24 14:32:07.718810 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:07.718801 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" event={"ID":"7ac82ff1-09cd-4202-b51a-b2df667f34c3","Type":"ContainerStarted","Data":"5debc55fa927a49eac99b17f606e9bf9acb4121b03bc99f902b8113724d5810b"} Apr 24 14:32:07.736630 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:32:07.736577 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-5c88b85bb7-bfrmj" podStartSLOduration=1.476317168 podStartE2EDuration="1.736564134s" podCreationTimestamp="2026-04-24 14:32:06 +0000 UTC" firstStartedPulling="2026-04-24 14:32:06.865136898 +0000 UTC m=+487.377969487" lastFinishedPulling="2026-04-24 14:32:07.125383863 +0000 UTC m=+487.638216453" observedRunningTime="2026-04-24 14:32:07.734466756 +0000 UTC m=+488.247299374" watchObservedRunningTime="2026-04-24 14:32:07.736564134 +0000 UTC m=+488.249396770" Apr 24 14:34:01.297999 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:34:01.297891 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:34:01.300883 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:34:01.298120 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:35:46.625726 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:46.625695 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89"] Apr 24 14:35:46.628697 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:46.628682 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" Apr 24 14:35:46.631356 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:46.631332 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5qb2v\"" Apr 24 14:35:46.638321 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:46.638299 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89"] Apr 24 14:35:46.638944 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:46.638928 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" Apr 24 14:35:46.762371 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:46.762340 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89"] Apr 24 14:35:46.765723 ip-10-0-143-187 kubenswrapper[2577]: W0424 14:35:46.765696 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896eac67_4426_4776_9e2b_e223347995ac.slice/crio-18b208c2819e1798124e9b555adc42b98220dd702c90f0be2007f41627d94830 WatchSource:0}: Error finding container 18b208c2819e1798124e9b555adc42b98220dd702c90f0be2007f41627d94830: Status 404 returned error can't find the container with id 18b208c2819e1798124e9b555adc42b98220dd702c90f0be2007f41627d94830 Apr 24 14:35:46.767534 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:46.767518 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 14:35:47.418598 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:47.418561 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" event={"ID":"896eac67-4426-4776-9e2b-e223347995ac","Type":"ContainerStarted","Data":"18b208c2819e1798124e9b555adc42b98220dd702c90f0be2007f41627d94830"} Apr 24 14:35:48.422931 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:48.422805 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" event={"ID":"896eac67-4426-4776-9e2b-e223347995ac","Type":"ContainerStarted","Data":"429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a"} Apr 24 14:35:48.423369 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:48.422974 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" Apr 24 14:35:48.425111 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:48.425070 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" Apr 24 14:35:48.437683 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:35:48.437636 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" podStartSLOduration=1.209424845 podStartE2EDuration="2.437622164s" podCreationTimestamp="2026-04-24 14:35:46 +0000 UTC" firstStartedPulling="2026-04-24 14:35:46.767643437 +0000 UTC m=+707.280476023" lastFinishedPulling="2026-04-24 14:35:47.995840757 +0000 UTC m=+708.508673342" observedRunningTime="2026-04-24 14:35:48.437169331 +0000 UTC m=+708.950001938" watchObservedRunningTime="2026-04-24 14:35:48.437622164 +0000 UTC m=+708.950454830" Apr 24 14:37:21.723568 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:21.723497 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-7f66cccfb6-h4p89_896eac67-4426-4776-9e2b-e223347995ac/kserve-container/0.log" Apr 24 14:37:21.856513 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:21.856485 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89"] Apr 24 14:37:21.856825 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:21.856771 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" podUID="896eac67-4426-4776-9e2b-e223347995ac" containerName="kserve-container" containerID="cri-o://429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a" gracePeriod=30 Apr 24 14:37:22.104390 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.104369 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" Apr 24 14:37:22.730589 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.730555 2577 generic.go:358] "Generic (PLEG): container finished" podID="896eac67-4426-4776-9e2b-e223347995ac" containerID="429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a" exitCode=2 Apr 24 14:37:22.731002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.730602 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" event={"ID":"896eac67-4426-4776-9e2b-e223347995ac","Type":"ContainerDied","Data":"429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a"} Apr 24 14:37:22.731002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.730613 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" Apr 24 14:37:22.731002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.730624 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89" event={"ID":"896eac67-4426-4776-9e2b-e223347995ac","Type":"ContainerDied","Data":"18b208c2819e1798124e9b555adc42b98220dd702c90f0be2007f41627d94830"} Apr 24 14:37:22.731002 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.730641 2577 scope.go:117] "RemoveContainer" containerID="429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a" Apr 24 14:37:22.738370 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.738348 2577 scope.go:117] "RemoveContainer" containerID="429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a" Apr 24 14:37:22.738602 ip-10-0-143-187 kubenswrapper[2577]: E0424 14:37:22.738587 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a\": container with ID starting with 429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a not found: ID does not exist" containerID="429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a" Apr 24 14:37:22.738661 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.738609 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a"} err="failed to get container status \"429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a\": rpc error: code = NotFound desc = could not find container \"429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a\": container with ID starting with 429b280a9ab8f1c1a85f9424882bcdb47114b267aa9057d9938c4f18eb2a671a not found: ID does not exist" Apr 24 14:37:22.745369 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.745347 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89"] Apr 24 14:37:22.750758 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:22.750733 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-7f66cccfb6-h4p89"] Apr 24 14:37:24.143928 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:37:24.143891 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="896eac67-4426-4776-9e2b-e223347995ac" path="/var/lib/kubelet/pods/896eac67-4426-4776-9e2b-e223347995ac/volumes" Apr 24 14:39:01.321030 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:39:01.320928 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:39:01.321030 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:39:01.320936 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:44:01.342347 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:44:01.342230 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:44:01.345410 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:44:01.343000 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:49:01.363136 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:49:01.362998 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:49:01.366204 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:49:01.364684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:54:01.382906 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:54:01.382791 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:54:01.385701 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:54:01.385682 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:59:01.406034 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:59:01.405908 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 14:59:01.410614 ip-10-0-143-187 kubenswrapper[2577]: I0424 14:59:01.410593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:04:01.425745 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:04:01.425621 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:04:01.431297 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:04:01.431277 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:09:01.445728 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:09:01.445703 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:09:01.451906 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:09:01.451883 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:14:01.465644 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:14:01.465540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:14:01.473168 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:14:01.473145 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:19:01.488290 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:19:01.488182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:19:01.494127 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:19:01.494107 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:24:01.509004 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:24:01.508900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:24:01.515022 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:24:01.515004 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:28:09.215858 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:09.215825 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gclmc_dd6b3902-a06e-4b22-b7f0-5990d385525e/global-pull-secret-syncer/0.log" Apr 24 15:28:09.357261 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:09.357226 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m49gc_0243e7c7-6f6f-41a6-a151-ae5c594532aa/konnectivity-agent/0.log" Apr 24 15:28:09.463950 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:09.463917 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-187.ec2.internal_2a8c5c56c9bc8e6777ce9cbd08c33017/haproxy/0.log" Apr 24 15:28:13.354862 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:13.354839 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-98dd848d8-wfxvz_07a1b2cc-f524-4934-b9d8-f47e59937cc1/metrics-server/0.log" Apr 24 15:28:13.379088 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:13.379063 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-zzlg5_6e4079e5-c4d1-4b43-b625-bf040b520ccb/monitoring-plugin/0.log" Apr 24 15:28:13.577285 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:13.577256 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t7f6c_42ea33ec-d4b8-4502-a44d-c5090664737b/node-exporter/0.log" Apr 24 15:28:13.602019 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:13.601994 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t7f6c_42ea33ec-d4b8-4502-a44d-c5090664737b/kube-rbac-proxy/0.log" Apr 24 15:28:13.625392 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:13.625330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t7f6c_42ea33ec-d4b8-4502-a44d-c5090664737b/init-textfile/0.log" Apr 24 15:28:14.092278 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:14.092250 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b7f5db56f-vxgph_579e2c45-99e9-479b-9856-a3414c3f41cd/thanos-query/0.log" Apr 24 15:28:14.116854 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:14.116822 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b7f5db56f-vxgph_579e2c45-99e9-479b-9856-a3414c3f41cd/kube-rbac-proxy-web/0.log" Apr 24 15:28:14.148472 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:14.148444 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b7f5db56f-vxgph_579e2c45-99e9-479b-9856-a3414c3f41cd/kube-rbac-proxy/0.log" Apr 24 15:28:14.194053 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:14.194023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b7f5db56f-vxgph_579e2c45-99e9-479b-9856-a3414c3f41cd/prom-label-proxy/0.log" Apr 24 15:28:14.229174 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:14.229150 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b7f5db56f-vxgph_579e2c45-99e9-479b-9856-a3414c3f41cd/kube-rbac-proxy-rules/0.log" Apr 24 15:28:14.258429 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:14.258405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b7f5db56f-vxgph_579e2c45-99e9-479b-9856-a3414c3f41cd/kube-rbac-proxy-metrics/0.log" Apr 24 15:28:16.077606 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.077572 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fc4858478-l62p9_e49a1885-480c-4ada-97c5-92f0f39ff26c/console/0.log" Apr 24 15:28:16.109531 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.109501 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6bcc868b7-4mhsv_892ef02e-9577-42da-a618-c4d33bdf46e2/download-server/0.log" Apr 24 15:28:16.402449 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.402364 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c"] Apr 24 15:28:16.402682 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.402670 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="896eac67-4426-4776-9e2b-e223347995ac" containerName="kserve-container" Apr 24 15:28:16.402730 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.402683 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="896eac67-4426-4776-9e2b-e223347995ac" containerName="kserve-container" Apr 24 15:28:16.402766 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.402739 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="896eac67-4426-4776-9e2b-e223347995ac" containerName="kserve-container" Apr 24 15:28:16.405696 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.405674 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.408490 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.408465 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vl4w\"/\"kube-root-ca.crt\"" Apr 24 15:28:16.408603 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.408469 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vl4w\"/\"openshift-service-ca.crt\"" Apr 24 15:28:16.408603 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.408572 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6vl4w\"/\"default-dockercfg-9rknq\"" Apr 24 15:28:16.415480 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.415460 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c"] Apr 24 15:28:16.535478 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.535446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-podres\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.535655 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.535486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-sys\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.535655 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.535505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-proc\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.535655 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.535595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-lib-modules\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.535655 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.535629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvnr7\" (UniqueName: \"kubernetes.io/projected/7bc69314-bd39-42ed-9fdb-c160979676b7-kube-api-access-xvnr7\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636332 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636301 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-lib-modules\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636479 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636339 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvnr7\" (UniqueName: \"kubernetes.io/projected/7bc69314-bd39-42ed-9fdb-c160979676b7-kube-api-access-xvnr7\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636479 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636361 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-podres\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636479 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636393 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-sys\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636479 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636412 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-proc\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636638 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-proc\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636638 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636497 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-lib-modules\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636638 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636508 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-sys\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.636638 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.636532 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7bc69314-bd39-42ed-9fdb-c160979676b7-podres\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.644287 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.644254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvnr7\" (UniqueName: \"kubernetes.io/projected/7bc69314-bd39-42ed-9fdb-c160979676b7-kube-api-access-xvnr7\") pod \"perf-node-gather-daemonset-rtl6c\" (UID: \"7bc69314-bd39-42ed-9fdb-c160979676b7\") " pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.716017 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.715989 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:16.832125 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.832071 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c"] Apr 24 15:28:16.834505 ip-10-0-143-187 kubenswrapper[2577]: W0424 15:28:16.834479 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7bc69314_bd39_42ed_9fdb_c160979676b7.slice/crio-2b20a9611c028f3bec305a6b91d1bf8e55d6771f957a4f85893d4b4da45b7b4c WatchSource:0}: Error finding container 2b20a9611c028f3bec305a6b91d1bf8e55d6771f957a4f85893d4b4da45b7b4c: Status 404 returned error can't find the container with id 2b20a9611c028f3bec305a6b91d1bf8e55d6771f957a4f85893d4b4da45b7b4c Apr 24 15:28:16.835957 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:16.835940 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 24 15:28:17.299769 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.299745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jdk56_23b5abfa-6cab-43b2-9877-4ac806e03f9d/dns/0.log" Apr 24 15:28:17.319133 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.319109 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jdk56_23b5abfa-6cab-43b2-9877-4ac806e03f9d/kube-rbac-proxy/0.log" Apr 24 15:28:17.452548 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.452509 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" event={"ID":"7bc69314-bd39-42ed-9fdb-c160979676b7","Type":"ContainerStarted","Data":"fde54a02c19443ff8fa3218a2b8f28ff8f8a82b8d2fa1156a15b1b057b4e525b"} Apr 24 15:28:17.452743 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.452556 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" event={"ID":"7bc69314-bd39-42ed-9fdb-c160979676b7","Type":"ContainerStarted","Data":"2b20a9611c028f3bec305a6b91d1bf8e55d6771f957a4f85893d4b4da45b7b4c"} Apr 24 15:28:17.452743 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.452651 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:17.463027 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.463008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8rjmh_d2cb5481-10b0-4339-b6ef-04e4e02e18f9/dns-node-resolver/0.log" Apr 24 15:28:17.469020 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.468980 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" podStartSLOduration=1.468970183 podStartE2EDuration="1.468970183s" podCreationTimestamp="2026-04-24 15:28:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-24 15:28:17.466823298 +0000 UTC m=+3857.979655906" watchObservedRunningTime="2026-04-24 15:28:17.468970183 +0000 UTC m=+3857.981802792" Apr 24 15:28:17.917702 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.917670 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66c9d7f6bb-ptns5_5a209e20-3a84-4e4d-9c4a-8ef8626232c3/registry/0.log" Apr 24 15:28:17.965272 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:17.965246 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h86r5_2b2925e7-7ff4-4aa1-817e-9212a10cc8e1/node-ca/0.log" Apr 24 15:28:19.002698 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:19.002625 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5jn2n_f881448e-a5ef-4cb5-a379-fa149299394b/serve-healthcheck-canary/0.log" Apr 24 15:28:19.531532 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:19.531506 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h94ff_39845295-b5c6-484b-ab3a-d6e711d1259c/kube-rbac-proxy/0.log" Apr 24 15:28:19.551082 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:19.551054 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h94ff_39845295-b5c6-484b-ab3a-d6e711d1259c/exporter/0.log" Apr 24 15:28:19.571768 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:19.571743 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h94ff_39845295-b5c6-484b-ab3a-d6e711d1259c/extractor/0.log" Apr 24 15:28:21.554979 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:21.554953 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-b7dc77d59-sn2c5_b76766c9-5893-4639-9297-840ff50a0d05/manager/0.log" Apr 24 15:28:21.574436 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:21.574410 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-68cc5db7c4-knzsh_bcc73399-a45f-4848-844b-09396f327eef/manager/0.log" Apr 24 15:28:22.100846 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:22.100818 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-86cc847c5c-kmvcj_02826335-5a08-424a-9ea8-13845b10c359/seaweedfs/0.log" Apr 24 15:28:22.127369 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:22.127344 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-5c88b85bb7-bfrmj_7ac82ff1-09cd-4202-b51a-b2df667f34c3/seaweedfs-tls-custom/0.log" Apr 24 15:28:23.465260 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:23.465229 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6vl4w/perf-node-gather-daemonset-rtl6c" Apr 24 15:28:28.042309 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.042277 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv87b_cbc7782e-13cd-4b3b-9742-662bfb96c6fc/kube-multus-additional-cni-plugins/0.log" Apr 24 15:28:28.064328 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.064302 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv87b_cbc7782e-13cd-4b3b-9742-662bfb96c6fc/egress-router-binary-copy/0.log" Apr 24 15:28:28.088893 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.088867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv87b_cbc7782e-13cd-4b3b-9742-662bfb96c6fc/cni-plugins/0.log" Apr 24 15:28:28.114731 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.114708 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv87b_cbc7782e-13cd-4b3b-9742-662bfb96c6fc/bond-cni-plugin/0.log" Apr 24 15:28:28.139128 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.139082 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv87b_cbc7782e-13cd-4b3b-9742-662bfb96c6fc/routeoverride-cni/0.log" Apr 24 15:28:28.162238 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.162213 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv87b_cbc7782e-13cd-4b3b-9742-662bfb96c6fc/whereabouts-cni-bincopy/0.log" Apr 24 15:28:28.182976 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.182952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tv87b_cbc7782e-13cd-4b3b-9742-662bfb96c6fc/whereabouts-cni/0.log" Apr 24 15:28:28.235787 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.235712 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rppr2_51abbf9b-3457-4508-a7e3-0f1a997126d8/kube-multus/0.log" Apr 24 15:28:28.343162 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.343131 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fvgmc_0f07c588-4cdd-4779-a4bf-d23af3f3d566/network-metrics-daemon/0.log" Apr 24 15:28:28.362311 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:28.362283 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fvgmc_0f07c588-4cdd-4779-a4bf-d23af3f3d566/kube-rbac-proxy/0.log" Apr 24 15:28:29.352831 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.352800 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-controller/0.log" Apr 24 15:28:29.370766 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.370735 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/0.log" Apr 24 15:28:29.386805 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.386778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovn-acl-logging/1.log" Apr 24 15:28:29.405341 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.405317 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/kube-rbac-proxy-node/0.log" Apr 24 15:28:29.424834 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.424811 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/kube-rbac-proxy-ovn-metrics/0.log" Apr 24 15:28:29.444263 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.444241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/northd/0.log" Apr 24 15:28:29.467139 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.467115 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/nbdb/0.log" Apr 24 15:28:29.486145 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.486125 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/sbdb/0.log" Apr 24 15:28:29.600076 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:29.600033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kx6pv_ed2a96bf-5d4c-49fb-b377-94105ee5d017/ovnkube-controller/0.log" Apr 24 15:28:31.213450 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:31.213418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-njhj7_31799aae-4d20-4f05-a6af-04f6e7fb0d6b/network-check-target-container/0.log" Apr 24 15:28:32.166663 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:32.166624 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-d9djn_9caca091-9126-4a82-a6a4-88c3b7802e83/iptables-alerter/0.log" Apr 24 15:28:32.885360 ip-10-0-143-187 kubenswrapper[2577]: I0424 15:28:32.885329 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-k4cnh_a63313f9-269d-481f-b407-508d97a93776/tuned/0.log"