May 20 13:49:39.778673 ip-10-0-128-199 systemd[1]: Starting Kubernetes Kubelet... May 20 13:49:40.289888 ip-10-0-128-199 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 13:49:40.289888 ip-10-0-128-199 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 13:49:40.289888 ip-10-0-128-199 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 13:49:40.289888 ip-10-0-128-199 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 13:49:40.289888 ip-10-0-128-199 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 13:49:40.293165 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.293063 2552 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298940 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298966 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298972 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298976 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298979 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298982 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298985 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 13:49:40.298974 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298988 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298991 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298994 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.298997 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299001 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299006 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299009 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299012 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299015 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299018 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299021 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299024 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299027 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299029 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299032 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299035 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299037 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299040 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299051 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 13:49:40.299338 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299054 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299057 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299060 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299062 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299068 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299071 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299074 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299077 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299080 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299082 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299085 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299087 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299090 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299094 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299097 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299101 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299103 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299106 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299109 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 13:49:40.299792 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299112 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299114 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299117 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299120 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299122 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299125 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299128 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299131 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299134 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299136 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299139 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299142 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299144 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299147 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299149 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299152 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299154 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299157 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299159 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299162 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 13:49:40.300286 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299164 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299169 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299173 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299176 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299179 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299181 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299184 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299187 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299190 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299193 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299195 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299198 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299201 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299205 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299207 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299210 2552 feature_gate.go:328] unrecognized feature gate: Example May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299215 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299218 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299220 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299223 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 13:49:40.300798 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299226 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299696 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299702 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299705 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299708 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299711 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299714 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299716 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299719 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299722 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299725 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299728 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299731 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299734 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299737 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299739 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299742 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299745 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299747 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299750 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 13:49:40.301278 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299754 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299757 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299759 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299762 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299765 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299768 2552 feature_gate.go:328] unrecognized feature gate: Example May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299771 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299774 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299777 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299780 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299783 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299785 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299788 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299790 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299793 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299796 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299798 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299801 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299804 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 13:49:40.301814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299806 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299809 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299812 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299814 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299817 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299819 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299823 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299826 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299829 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299831 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299834 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299836 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299839 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299842 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299845 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299848 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299850 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299854 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299857 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299860 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 13:49:40.302339 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299863 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299865 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299868 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299871 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299873 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299876 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299879 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299881 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299885 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299888 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299892 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299895 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299898 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299901 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299903 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299906 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299909 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299912 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299915 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 13:49:40.302833 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299918 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299921 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299923 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299926 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299928 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299931 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299935 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299938 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.299940 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300861 2552 flags.go:64] FLAG: --address="0.0.0.0" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300875 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300884 2552 flags.go:64] FLAG: --anonymous-auth="true" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300888 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300902 2552 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300906 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300916 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300920 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300924 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300927 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300931 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300934 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300938 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 13:49:40.303330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300941 2552 flags.go:64] FLAG: --cgroup-root="" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300944 2552 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300947 2552 flags.go:64] FLAG: --client-ca-file="" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300950 2552 flags.go:64] FLAG: --cloud-config="" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300953 2552 flags.go:64] FLAG: --cloud-provider="external" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300956 2552 flags.go:64] FLAG: --cluster-dns="[]" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300961 2552 flags.go:64] FLAG: --cluster-domain="" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300964 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300967 2552 flags.go:64] FLAG: --config-dir="" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300970 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300974 2552 flags.go:64] FLAG: --container-log-max-files="5" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300979 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300982 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300986 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300989 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300993 2552 flags.go:64] FLAG: --contention-profiling="false" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300996 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.300999 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301002 2552 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301005 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301010 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301013 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301016 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301019 2552 flags.go:64] FLAG: --enable-load-reader="false" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301024 2552 flags.go:64] FLAG: --enable-server="true" May 20 13:49:40.303866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301027 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301032 2552 flags.go:64] FLAG: --event-burst="100" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301035 2552 flags.go:64] FLAG: --event-qps="50" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301038 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301042 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301045 2552 flags.go:64] FLAG: --eviction-hard="" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301049 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301052 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301056 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301059 2552 flags.go:64] FLAG: --eviction-soft="" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301062 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301065 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301068 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301071 2552 flags.go:64] FLAG: --experimental-mounter-path="" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301074 2552 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301077 2552 flags.go:64] FLAG: --fail-swap-on="true" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301080 2552 flags.go:64] FLAG: --feature-gates="" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301085 2552 flags.go:64] FLAG: --file-check-frequency="20s" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301088 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301091 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301095 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301098 2552 flags.go:64] FLAG: --healthz-port="10248" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301102 2552 flags.go:64] FLAG: --help="false" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301105 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-128-199.ec2.internal" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301108 2552 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 13:49:40.304492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301111 2552 flags.go:64] FLAG: --http-check-frequency="20s" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301114 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301117 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301121 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301124 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301127 2552 flags.go:64] FLAG: --image-service-endpoint="" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301130 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301133 2552 flags.go:64] FLAG: --kube-api-burst="100" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301136 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301139 2552 flags.go:64] FLAG: --kube-api-qps="50" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301142 2552 flags.go:64] FLAG: --kube-reserved="" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301145 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301148 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301151 2552 flags.go:64] FLAG: --kubelet-cgroups="" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301154 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301157 2552 flags.go:64] FLAG: --lock-file="" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301161 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301164 2552 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301167 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301173 2552 flags.go:64] FLAG: --log-json-split-stream="false" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301176 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301179 2552 flags.go:64] FLAG: --log-text-split-stream="false" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301182 2552 flags.go:64] FLAG: --logging-format="text" May 20 13:49:40.305089 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301185 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301189 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301192 2552 flags.go:64] FLAG: --manifest-url="" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301196 2552 flags.go:64] FLAG: --manifest-url-header="" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301201 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301204 2552 flags.go:64] FLAG: --max-open-files="1000000" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301209 2552 flags.go:64] FLAG: --max-pods="110" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301213 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301216 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301218 2552 flags.go:64] FLAG: --memory-manager-policy="None" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301221 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301225 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301228 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301231 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301240 2552 flags.go:64] FLAG: --node-status-max-images="50" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301243 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301246 2552 flags.go:64] FLAG: --oom-score-adj="-999" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301250 2552 flags.go:64] FLAG: --pod-cidr="" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301253 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301258 2552 flags.go:64] FLAG: --pod-manifest-path="" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301261 2552 flags.go:64] FLAG: --pod-max-pids="-1" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301264 2552 flags.go:64] FLAG: --pods-per-core="0" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301268 2552 flags.go:64] FLAG: --port="10250" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301271 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 13:49:40.305761 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301276 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d7c7edd1647bdac" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301280 2552 flags.go:64] FLAG: --qos-reserved="" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301284 2552 flags.go:64] FLAG: --read-only-port="10255" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301287 2552 flags.go:64] FLAG: --register-node="true" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301291 2552 flags.go:64] FLAG: --register-schedulable="true" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301294 2552 flags.go:64] FLAG: --register-with-taints="" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301298 2552 flags.go:64] FLAG: --registry-burst="10" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301301 2552 flags.go:64] FLAG: --registry-qps="5" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301304 2552 flags.go:64] FLAG: --reserved-cpus="" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301307 2552 flags.go:64] FLAG: --reserved-memory="" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301331 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301336 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301341 2552 flags.go:64] FLAG: --rotate-certificates="false" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301344 2552 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301347 2552 flags.go:64] FLAG: --runonce="false" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301350 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301354 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301357 2552 flags.go:64] FLAG: --seccomp-default="false" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301360 2552 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301363 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301366 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301369 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301373 2552 flags.go:64] FLAG: --storage-driver-password="root" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301376 2552 flags.go:64] FLAG: --storage-driver-secure="false" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301379 2552 flags.go:64] FLAG: --storage-driver-table="stats" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301382 2552 flags.go:64] FLAG: --storage-driver-user="root" May 20 13:49:40.306351 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301386 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301390 2552 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301393 2552 flags.go:64] FLAG: --system-cgroups="" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301396 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301403 2552 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301405 2552 flags.go:64] FLAG: --tls-cert-file="" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301411 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301416 2552 flags.go:64] FLAG: --tls-min-version="" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301419 2552 flags.go:64] FLAG: --tls-private-key-file="" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301422 2552 flags.go:64] FLAG: --topology-manager-policy="none" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301425 2552 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301428 2552 flags.go:64] FLAG: --topology-manager-scope="container" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301431 2552 flags.go:64] FLAG: --v="2" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301436 2552 flags.go:64] FLAG: --version="false" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301440 2552 flags.go:64] FLAG: --vmodule="" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301445 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301448 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301562 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301565 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301569 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301572 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301575 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301577 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 13:49:40.306968 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301580 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301582 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301585 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301589 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301593 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301596 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301600 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301603 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301605 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301608 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301611 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301614 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301617 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301620 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301622 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301627 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301630 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301633 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301635 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301638 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 13:49:40.307563 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301641 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301643 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301646 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301649 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301651 2552 feature_gate.go:328] unrecognized feature gate: Example May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301654 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301656 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301659 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301662 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301665 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301667 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301671 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301674 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301678 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301681 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301683 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301686 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301689 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301692 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 13:49:40.308498 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301695 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301698 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301700 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301703 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301707 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301709 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301712 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301715 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301719 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301722 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301725 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301727 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301730 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301733 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301736 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301738 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301741 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301743 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301746 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301748 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 13:49:40.309304 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301751 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301753 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301756 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301758 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301761 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301763 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301766 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301768 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301770 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301773 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301776 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301779 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301781 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301784 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301787 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301789 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301791 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301794 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301797 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301800 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 13:49:40.310194 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.301804 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.301809 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.309623 2552 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.309653 2552 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309733 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309743 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309747 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309753 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309757 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309761 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309765 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309770 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309774 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309779 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309783 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309787 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 13:49:40.311069 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309791 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309796 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309801 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309805 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309809 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309813 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309818 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309822 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309827 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309831 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309835 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309839 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309844 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309849 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309854 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309860 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309867 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309872 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309876 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 13:49:40.311503 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309882 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309887 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309891 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309896 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309901 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309905 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309909 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309913 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309918 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309922 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309926 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309931 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309935 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309939 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309944 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309948 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309952 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309956 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309961 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309965 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 20 13:49:40.312056 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309970 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309974 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309979 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309983 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309988 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309992 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.309996 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310001 2552 feature_gate.go:328] unrecognized feature gate: Example May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310006 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310010 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310014 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310018 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310024 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310028 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310033 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310037 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310042 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310046 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310050 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310055 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 13:49:40.312730 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310059 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310063 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310067 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310071 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310076 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310080 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310084 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310089 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310093 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310098 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310102 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310108 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310114 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310119 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310124 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 13:49:40.313403 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.310133 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310298 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310306 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310329 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310334 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310339 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310343 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310347 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310351 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310355 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310360 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310364 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310368 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310374 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310379 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310383 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310387 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310391 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310395 2552 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 13:49:40.313791 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310400 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310405 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310409 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310414 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310418 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310422 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310427 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310431 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310435 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310440 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310445 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310449 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310454 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310458 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310463 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310468 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310472 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310477 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310481 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310486 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 13:49:40.314297 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310491 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310495 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310499 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310503 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310508 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310512 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310517 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310521 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310525 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310530 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310535 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310539 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310543 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310547 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310551 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310555 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310560 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310563 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310568 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310572 2552 feature_gate.go:328] unrecognized feature gate: Example May 20 13:49:40.314814 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310576 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310580 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310584 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310588 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310592 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310596 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310601 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310605 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310610 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310614 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310621 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310626 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310633 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310638 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310643 2552 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310647 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310651 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310656 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310660 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 13:49:40.315341 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310665 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310669 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310673 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310677 2552 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310681 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310686 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310690 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310694 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:40.310698 2552 feature_gate.go:328] unrecognized feature gate: Example2 May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.310706 2552 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 13:49:40.315823 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.311606 2552 server.go:962] "Client rotation is on, will bootstrap in background" May 20 13:49:40.317404 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.317382 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 13:49:40.318509 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.318495 2552 server.go:1019] "Starting client certificate rotation" May 20 13:49:40.318623 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.318603 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 13:49:40.318659 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.318646 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 13:49:40.346062 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.346028 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 13:49:40.348093 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.348068 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 13:49:40.366154 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.366122 2552 log.go:25] "Validated CRI v1 runtime API" May 20 13:49:40.372522 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.372498 2552 log.go:25] "Validated CRI v1 image API" May 20 13:49:40.374046 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.374024 2552 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 13:49:40.379230 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.379202 2552 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a9033c1b-aca3-482e-ade8-f507cfe12a4f:/dev/nvme0n1p4 f46405ad-f116-4001-b22e-8e62259a429e:/dev/nvme0n1p3] May 20 13:49:40.379230 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.379225 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 13:49:40.381901 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.381879 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 13:49:40.383688 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.383567 2552 manager.go:217] Machine: {Timestamp:2026-05-20 13:49:40.383035511 +0000 UTC m=+0.468448785 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089692 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d46365d4ca8dbb876246cec53ef7 SystemUUID:ec21d463-65d4-ca8d-bb87-6246cec53ef7 BootID:5e69e00e-19dc-4ce1-8ef4-8d0feaff3628 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:df:f0:9c:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:df:f0:9c:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:65:3d:ac:3b:8c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 13:49:40.384492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.384480 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 13:49:40.384640 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.384627 2552 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 13:49:40.386932 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.386904 2552 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 13:49:40.387086 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.386936 2552 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 13:49:40.387134 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.387096 2552 topology_manager.go:138] "Creating topology manager with none policy" May 20 13:49:40.387134 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.387105 2552 container_manager_linux.go:306] "Creating device plugin manager" May 20 13:49:40.387134 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.387114 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 13:49:40.388093 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.388081 2552 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 13:49:40.390512 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.390500 2552 state_mem.go:36] "Initialized new in-memory state store" May 20 13:49:40.390817 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.390807 2552 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 13:49:40.393531 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.393519 2552 kubelet.go:491] "Attempting to sync node with API server" May 20 13:49:40.393574 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.393536 2552 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 13:49:40.393574 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.393549 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 13:49:40.393574 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.393559 2552 kubelet.go:397] "Adding apiserver pod source" May 20 13:49:40.393574 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.393568 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 13:49:40.394839 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.394825 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 13:49:40.394896 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.394845 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 13:49:40.398793 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.398772 2552 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 13:49:40.401097 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.401078 2552 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 13:49:40.402559 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402545 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 13:49:40.402608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402566 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 13:49:40.402608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402575 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 13:49:40.402608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402580 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 13:49:40.402608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402589 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 13:49:40.402608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402595 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 13:49:40.402608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402600 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 13:49:40.402608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402606 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 13:49:40.402788 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402613 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 13:49:40.402788 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402619 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 13:49:40.402788 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.402629 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 13:49:40.403341 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.403332 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 13:49:40.404375 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.404358 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 13:49:40.404499 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.404385 2552 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 13:49:40.406601 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.406368 2552 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 20 13:49:40.406695 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.406463 2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 13:49:40.406695 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.406499 2552 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 13:49:40.407827 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.407815 2552 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 13:49:40.407876 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.407852 2552 server.go:1295] "Started kubelet" May 20 13:49:40.407945 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.407910 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 13:49:40.407990 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.407938 2552 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 13:49:40.409273 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.409248 2552 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 13:49:40.410048 ip-10-0-128-199 systemd[1]: Started Kubernetes Kubelet. May 20 13:49:40.411407 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.410858 2552 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 13:49:40.412498 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.412475 2552 server.go:317] "Adding debug handlers to kubelet server" May 20 13:49:40.419771 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.419747 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 13:49:40.419771 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.419765 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 13:49:40.419976 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.419841 2552 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 13:49:40.419976 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.419852 2552 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 13:49:40.419976 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.419959 2552 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 13:49:40.420110 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.420022 2552 reconstruct.go:97] "Volume reconstruction finished" May 20 13:49:40.420110 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.420030 2552 reconciler.go:26] "Reconciler: start to sync state" May 20 13:49:40.420915 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.420888 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:40.423299 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.423275 2552 factory.go:55] Registering systemd factory May 20 13:49:40.423448 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.423345 2552 factory.go:223] Registration of the systemd container factory successfully May 20 13:49:40.423648 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.423615 2552 factory.go:153] Registering CRI-O factory May 20 13:49:40.423742 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.423651 2552 factory.go:223] Registration of the crio container factory successfully May 20 13:49:40.423895 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.423769 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 13:49:40.423895 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.423808 2552 factory.go:103] Registering Raw factory May 20 13:49:40.423895 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.423824 2552 manager.go:1196] Started watching for new ooms in manager May 20 13:49:40.424218 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.424202 2552 manager.go:319] Starting recovery of all containers May 20 13:49:40.424345 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.424303 2552 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 13:49:40.424554 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.424534 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nn782" May 20 13:49:40.425839 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.425813 2552 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 20 13:49:40.425839 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.425826 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 20 13:49:40.427112 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.425908 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-199.ec2.internal.18b14a433b657a0f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-199.ec2.internal,UID:ip-10-0-128-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-199.ec2.internal,},FirstTimestamp:2026-05-20 13:49:40.407826959 +0000 UTC m=+0.493240233,LastTimestamp:2026-05-20 13:49:40.407826959 +0000 UTC m=+0.493240233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-199.ec2.internal,}" May 20 13:49:40.429530 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.429484 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 13:49:40.433676 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.433652 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nn782" May 20 13:49:40.434979 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.434953 2552 manager.go:324] Recovery completed May 20 13:49:40.440613 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.440591 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 13:49:40.442836 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.442819 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory" May 20 13:49:40.442925 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.442849 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure" May 20 13:49:40.442925 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.442860 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID" May 20 13:49:40.443409 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.443395 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 13:49:40.443409 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.443408 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 13:49:40.443533 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.443427 2552 state_mem.go:36] "Initialized new in-memory state store" May 20 13:49:40.444810 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.444744 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-199.ec2.internal.18b14a433d7bab7b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-199.ec2.internal,UID:ip-10-0-128-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-199.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-199.ec2.internal,},FirstTimestamp:2026-05-20 13:49:40.442835835 +0000 UTC m=+0.528249108,LastTimestamp:2026-05-20 13:49:40.442835835 +0000 UTC m=+0.528249108,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-199.ec2.internal,}" May 20 13:49:40.447355 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.447340 2552 policy_none.go:49] "None policy: Start" May 20 13:49:40.447429 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.447361 2552 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 13:49:40.447429 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.447375 2552 state_mem.go:35] "Initializing new in-memory state store" May 20 13:49:40.483026 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.483005 2552 manager.go:341] "Starting Device Plugin manager" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.483121 2552 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.483135 2552 server.go:85] "Starting device plugin registration server" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.483472 2552 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.483485 2552 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.483640 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.483715 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.483722 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.484334 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 13:49:40.507220 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.484374 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:40.521923 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.521850 2552 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 13:49:40.521923 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.521883 2552 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 13:49:40.521923 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.521903 2552 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 13:49:40.521923 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.521910 2552 kubelet.go:2451] "Starting kubelet main sync loop" May 20 13:49:40.522171 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.521951 2552 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 13:49:40.525299 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.525278 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 13:49:40.584072 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.584036 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 13:49:40.585224 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.585207 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory" May 20 13:49:40.585281 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.585240 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure" May 20 13:49:40.585281 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.585249 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID" May 20 13:49:40.585359 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.585291 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-199.ec2.internal" May 20 13:49:40.595458 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.595434 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-199.ec2.internal" May 20 13:49:40.595508 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.595469 2552 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-199.ec2.internal\": node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:40.622821 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.622774 2552 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal"] May 20 13:49:40.622914 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.622865 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 13:49:40.623802 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.623789 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory" May 20 13:49:40.623850 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.623818 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure" May 20 13:49:40.623850 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.623834 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID" May 20 13:49:40.626237 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.626223 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 13:49:40.626450 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.626430 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.626496 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.626465 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 13:49:40.626977 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.626958 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory" May 20 13:49:40.626977 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.626970 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory" May 20 13:49:40.627090 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.626989 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure" May 20 13:49:40.627090 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.627007 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID" May 20 13:49:40.627090 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.626989 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure" May 20 13:49:40.627090 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.627080 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID" May 20 13:49:40.629239 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.629221 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:40.629360 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.629346 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" May 20 13:49:40.629422 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.629384 2552 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 13:49:40.630060 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.630040 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientMemory" May 20 13:49:40.630134 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.630072 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasNoDiskPressure" May 20 13:49:40.630134 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.630084 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeHasSufficientPID" May 20 13:49:40.646000 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.645962 2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-199.ec2.internal\" not found" node="ip-10-0-128-199.ec2.internal" May 20 13:49:40.649463 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.649446 2552 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-199.ec2.internal\" not found" node="ip-10-0-128-199.ec2.internal" May 20 13:49:40.730378 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.730344 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:40.821816 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.821739 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f449def4ab9b9a195375009b0eb8f88e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"f449def4ab9b9a195375009b0eb8f88e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.821816 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.821775 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f449def4ab9b9a195375009b0eb8f88e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"f449def4ab9b9a195375009b0eb8f88e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.821816 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.821795 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a443e8c9080bfbbf1a963ab72a458b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-199.ec2.internal\" (UID: \"95a443e8c9080bfbbf1a963ab72a458b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" May 20 13:49:40.830825 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.830796 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:40.922544 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.922508 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f449def4ab9b9a195375009b0eb8f88e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"f449def4ab9b9a195375009b0eb8f88e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.922622 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.922549 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f449def4ab9b9a195375009b0eb8f88e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"f449def4ab9b9a195375009b0eb8f88e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.922622 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.922573 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a443e8c9080bfbbf1a963ab72a458b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-199.ec2.internal\" (UID: \"95a443e8c9080bfbbf1a963ab72a458b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" May 20 13:49:40.922622 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.922619 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f449def4ab9b9a195375009b0eb8f88e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"f449def4ab9b9a195375009b0eb8f88e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.922708 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.922624 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f449def4ab9b9a195375009b0eb8f88e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal\" (UID: \"f449def4ab9b9a195375009b0eb8f88e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.922708 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.922658 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a443e8c9080bfbbf1a963ab72a458b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-199.ec2.internal\" (UID: \"95a443e8c9080bfbbf1a963ab72a458b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" May 20 13:49:40.931659 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:40.931618 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:40.948792 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.948767 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:40.951559 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:40.951540 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" May 20 13:49:41.032649 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.032601 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.133158 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.133093 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.233702 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.233664 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.317834 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.317798 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 13:49:41.318552 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.317993 2552 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 13:49:41.334298 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.334260 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.420589 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.420566 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 13:49:41.432452 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.432416 2552 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 13:49:41.434364 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.434346 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.436706 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.436669 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 13:44:40 +0000 UTC" deadline="2027-10-16 17:54:34.056792912 +0000 UTC" May 20 13:49:41.436799 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.436706 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12340h4m52.620091127s" May 20 13:49:41.469935 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.469904 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ppbnf" May 20 13:49:41.479560 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.479533 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ppbnf" May 20 13:49:41.535466 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.535436 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.538795 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:41.538757 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a443e8c9080bfbbf1a963ab72a458b.slice/crio-d61de8d3b540d2b07952639f880d50315c327647ce6e60cf3dc3aeac44cac023 WatchSource:0}: Error finding container d61de8d3b540d2b07952639f880d50315c327647ce6e60cf3dc3aeac44cac023: Status 404 returned error can't find the container with id d61de8d3b540d2b07952639f880d50315c327647ce6e60cf3dc3aeac44cac023 May 20 13:49:41.542697 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.542666 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 13:49:41.548455 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:41.548426 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf449def4ab9b9a195375009b0eb8f88e.slice/crio-8f1ab557bae51bc9104c370ebd252968350309acd639123f7af61d4a25ef36b2 WatchSource:0}: Error finding container 8f1ab557bae51bc9104c370ebd252968350309acd639123f7af61d4a25ef36b2: Status 404 returned error can't find the container with id 8f1ab557bae51bc9104c370ebd252968350309acd639123f7af61d4a25ef36b2 May 20 13:49:41.636352 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.636297 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.639104 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.639080 2552 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 13:49:41.736600 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.736515 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.809795 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.809759 2552 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 13:49:41.837227 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.837190 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.938212 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:41.938169 2552 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-199.ec2.internal\" not found" May 20 13:49:41.964293 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:41.964112 2552 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 13:49:42.020429 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.020343 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" May 20 13:49:42.032397 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.032356 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 13:49:42.033612 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.033582 2552 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" May 20 13:49:42.045457 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.045425 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 13:49:42.395706 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.395620 2552 apiserver.go:52] "Watching apiserver" May 20 13:49:42.401897 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.401864 2552 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 13:49:42.403297 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.403256 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-4n8gm","openshift-multus/network-metrics-daemon-p2jmv","openshift-network-diagnostics/network-check-target-9dmw9","openshift-ovn-kubernetes/ovnkube-node-h5w7v","kube-system/konnectivity-agent-sdw7x","kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh","openshift-dns/node-resolver-ttn2r","openshift-image-registry/node-ca-dzcdv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal","openshift-multus/multus-2cnhf","openshift-network-operator/iptables-alerter-wcbdd","openshift-cluster-node-tuning-operator/tuned-gl9qq"] May 20 13:49:42.407993 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.407962 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.410449 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.410215 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:42.410449 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.410302 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:42.410449 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.410337 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:42.410449 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.410413 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:42.410748 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.410728 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 13:49:42.410803 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.410735 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 13:49:42.410803 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.410773 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 13:49:42.410899 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.410821 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9nlc\"" May 20 13:49:42.412634 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.412611 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.414797 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.414776 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.415038 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.415018 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 13:49:42.415297 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.415278 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 13:49:42.415414 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.415369 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 13:49:42.415523 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.415509 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 13:49:42.415585 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.415530 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ccb8z\"" May 20 13:49:42.415652 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.415636 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 13:49:42.417056 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.417035 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cnhf" May 20 13:49:42.417154 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.417075 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hckg\"" May 20 13:49:42.417445 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.417422 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 13:49:42.417567 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.417539 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 13:49:42.422257 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.419655 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.422257 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.419826 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c94sq\"" May 20 13:49:42.422257 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.419839 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 13:49:42.422257 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.422086 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8xlhp\"" May 20 13:49:42.423010 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.422834 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 13:49:42.423010 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.422914 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 13:49:42.423010 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.422956 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 13:49:42.423960 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.423714 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.425754 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.425739 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ssjdd\"" May 20 13:49:42.426108 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.425836 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 13:49:42.426108 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.425969 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 13:49:42.426392 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.426375 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.428735 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.428701 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.429059 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.428987 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 13:49:42.429234 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.429174 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 13:49:42.429337 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.429243 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lddbp\"" May 20 13:49:42.429337 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.429307 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 13:49:42.429449 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.429377 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 13:49:42.429670 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.429654 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 13:49:42.429670 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.429666 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 13:49:42.431082 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431062 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 13:49:42.431177 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431119 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ww9k6\"" May 20 13:49:42.431273 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431157 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 13:49:42.431508 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431454 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-registration-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.431508 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431493 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 13:49:42.431633 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431493 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.431633 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-device-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.431633 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431580 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.431633 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431585 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.431819 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-cnibin\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.431819 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431670 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.431819 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431698 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac4906fa-5821-4932-a5fe-965573d8f96e-tmp-dir\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.431819 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431725 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4-agent-certs\") pod \"konnectivity-agent-sdw7x\" (UID: \"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4\") " pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.431819 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4-konnectivity-ca\") pod \"konnectivity-agent-sdw7x\" (UID: \"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4\") " pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.431819 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431773 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-cnibin\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.431819 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431796 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-cni-bin\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431822 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431847 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac4906fa-5821-4932-a5fe-965573d8f96e-hosts-file\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431884 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-cni-multus\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-conf-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431936 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-socket-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431957 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcd6n\" (UniqueName: \"kubernetes.io/projected/36452282-6303-4873-8e65-3dbf6166bb05-kube-api-access-gcd6n\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.431981 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbhl\" (UniqueName: \"kubernetes.io/projected/0968bab8-1e4f-4bee-974b-7245aac58209-kube-api-access-chbhl\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432002 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-system-cni-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432032 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-cni-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432093 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-hostroot\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432139 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432130 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-daemon-config\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-sys-fs\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432195 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-system-cni-dir\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432217 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2683c424-59e2-4ac8-85c6-adb67def8d4f-host\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432257 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2683c424-59e2-4ac8-85c6-adb67def8d4f-serviceca\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-k8s-cni-cncf-io\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432334 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-netns\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-multus-certs\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432405 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-os-release\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432458 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-socket-dir-parent\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432501 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-kubelet\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjmwl\" (UniqueName: \"kubernetes.io/projected/d0c21dba-b43a-4d9b-8191-ec788fa761e0-kube-api-access-jjmwl\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432570 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjtpl\" (UniqueName: \"kubernetes.io/projected/2f74777a-5415-4cd8-b34f-86521909bc50-kube-api-access-mjtpl\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432599 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.432668 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432623 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwplc\" (UniqueName: \"kubernetes.io/projected/2683c424-59e2-4ac8-85c6-adb67def8d4f-kube-api-access-cwplc\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.433560 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432645 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-os-release\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.433560 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432670 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0c21dba-b43a-4d9b-8191-ec788fa761e0-cni-binary-copy\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.433560 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432692 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-etc-kubernetes\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.433560 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432713 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.433560 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.432781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78td\" (UniqueName: \"kubernetes.io/projected/ac4906fa-5821-4932-a5fe-965573d8f96e-kube-api-access-t78td\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.433923 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.433899 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 13:49:42.433923 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.433916 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 13:49:42.434087 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.433991 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7lnq6\"" May 20 13:49:42.480346 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.480294 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 13:44:41 +0000 UTC" deadline="2028-01-30 23:42:45.156775514 +0000 UTC" May 20 13:49:42.480346 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.480338 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14889h53m2.676440136s" May 20 13:49:42.520843 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.520810 2552 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 13:49:42.525912 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.525859 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" event={"ID":"f449def4ab9b9a195375009b0eb8f88e","Type":"ContainerStarted","Data":"8f1ab557bae51bc9104c370ebd252968350309acd639123f7af61d4a25ef36b2"} May 20 13:49:42.526910 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.526882 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" event={"ID":"95a443e8c9080bfbbf1a963ab72a458b","Type":"ContainerStarted","Data":"d61de8d3b540d2b07952639f880d50315c327647ce6e60cf3dc3aeac44cac023"} May 20 13:49:42.532984 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.532947 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwplc\" (UniqueName: \"kubernetes.io/projected/2683c424-59e2-4ac8-85c6-adb67def8d4f-kube-api-access-cwplc\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.532984 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.532991 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-etc-kubernetes\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.533228 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533016 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-kubelet\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.533228 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533039 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-var-lib-kubelet\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.533228 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533062 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-host\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.533228 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533153 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-etc-kubernetes\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.533228 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-env-overrides\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.533228 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533227 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-ovnkube-script-lib\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qzk7\" (UniqueName: \"kubernetes.io/projected/8cbf7364-8411-408b-9455-bb929a9088fc-kube-api-access-2qzk7\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533279 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysctl-d\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533302 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f49780be-f70f-4b46-b68f-756e0fbc1a83-tmp\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533342 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-cnibin\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533359 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-kubernetes\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533374 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-lib-modules\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533393 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-cnibin\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533427 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-cnibin\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533436 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533485 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-slash\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.533553 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533493 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-cnibin\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533602 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-etc-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533635 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-socket-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533662 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcd6n\" (UniqueName: \"kubernetes.io/projected/36452282-6303-4873-8e65-3dbf6166bb05-kube-api-access-gcd6n\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533688 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-sys\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533719 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-system-cni-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533762 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-hostroot\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533783 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-system-cni-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533784 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-socket-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533801 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-daemon-config\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533817 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-hostroot\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533835 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-sys-fs\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533862 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-system-cni-dir\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533892 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-modprobe-d\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533907 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-sys-fs\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533916 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysconfig\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533923 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-system-cni-dir\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.534080 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533942 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2683c424-59e2-4ac8-85c6-adb67def8d4f-host\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533968 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2683c424-59e2-4ac8-85c6-adb67def8d4f-serviceca\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533985 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2683c424-59e2-4ac8-85c6-adb67def8d4f-host\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.533995 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-k8s-cni-cncf-io\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534020 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-multus-certs\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534050 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-log-socket\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534078 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-socket-dir-parent\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534106 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-kubelet\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534119 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-multus-certs\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534128 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-k8s-cni-cncf-io\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534131 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjmwl\" (UniqueName: \"kubernetes.io/projected/d0c21dba-b43a-4d9b-8191-ec788fa761e0-kube-api-access-jjmwl\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534170 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534175 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-socket-dir-parent\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534185 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-kubelet\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534199 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534229 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534229 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm596\" (UniqueName: \"kubernetes.io/projected/f49780be-f70f-4b46-b68f-756e0fbc1a83-kube-api-access-rm596\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.534894 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534277 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-os-release\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534300 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0c21dba-b43a-4d9b-8191-ec788fa761e0-cni-binary-copy\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534341 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534369 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t78td\" (UniqueName: \"kubernetes.io/projected/ac4906fa-5821-4932-a5fe-965573d8f96e-kube-api-access-t78td\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534395 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-var-lib-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534411 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-daemon-config\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534423 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-ovn\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534398 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-os-release\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534432 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2683c424-59e2-4ac8-85c6-adb67def8d4f-serviceca\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cbf7364-8411-408b-9455-bb929a9088fc-ovn-node-metrics-cert\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534501 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-systemd\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534545 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-registration-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534586 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534590 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-registration-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-cni-bin\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534670 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/646aad3c-162b-4e94-8e66-2c7d2c3f4575-iptables-alerter-script\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534717 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-device-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.535597 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534758 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534811 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-device-dir\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534817 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f74777a-5415-4cd8-b34f-86521909bc50-etc-selinux\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534826 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534843 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534869 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0c21dba-b43a-4d9b-8191-ec788fa761e0-cni-binary-copy\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534890 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534910 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac4906fa-5821-4932-a5fe-965573d8f96e-tmp-dir\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534959 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-systemd-units\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.534986 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535006 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535011 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysctl-conf\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535061 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4-agent-certs\") pod \"konnectivity-agent-sdw7x\" (UID: \"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4\") " pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535079 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0968bab8-1e4f-4bee-974b-7245aac58209-cni-binary-copy\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535088 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4-konnectivity-ca\") pod \"konnectivity-agent-sdw7x\" (UID: \"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4\") " pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535114 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-cni-bin\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535155 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-cni-bin\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac4906fa-5821-4932-a5fe-965573d8f96e-tmp-dir\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535252 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac4906fa-5821-4932-a5fe-965573d8f96e-hosts-file\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535357 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-ovnkube-config\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535368 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac4906fa-5821-4932-a5fe-965573d8f96e-hosts-file\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535390 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-cni-multus\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535415 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-conf-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535438 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chbhl\" (UniqueName: \"kubernetes.io/projected/0968bab8-1e4f-4bee-974b-7245aac58209-kube-api-access-chbhl\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535458 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-cni-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535481 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535490 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-var-lib-cni-multus\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535474 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535502 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-run\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535542 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/646aad3c-162b-4e94-8e66-2c7d2c3f4575-host-slash\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535555 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-cni-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535558 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4-konnectivity-ca\") pod \"konnectivity-agent-sdw7x\" (UID: \"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4\") " pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535566 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4llsx\" (UniqueName: \"kubernetes.io/projected/646aad3c-162b-4e94-8e66-2c7d2c3f4575-kube-api-access-4llsx\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535606 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-multus-conf-dir\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.536996 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535604 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-netns\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535636 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-os-release\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.535606 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535687 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-cni-netd\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535706 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0968bab8-1e4f-4bee-974b-7245aac58209-os-release\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0c21dba-b43a-4d9b-8191-ec788fa761e0-host-run-netns\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.535765 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:43.03570309 +0000 UTC m=+3.121116390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535789 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjtpl\" (UniqueName: \"kubernetes.io/projected/2f74777a-5415-4cd8-b34f-86521909bc50-kube-api-access-mjtpl\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535821 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-run-netns\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535845 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-systemd\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-node-log\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.537824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.535909 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-tuned\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.538846 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.538641 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4-agent-certs\") pod \"konnectivity-agent-sdw7x\" (UID: \"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4\") " pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.538939 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.538813 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 13:49:42.538939 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.538901 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 13:49:42.538939 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.538916 2552 projected.go:194] Error preparing data for projected volume kube-api-access-wpjqm for pod openshift-network-diagnostics/network-check-target-9dmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:42.539127 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:42.538975 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm podName:250bd337-fccf-462c-a9f7-d6df8b909ac6 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:43.038954147 +0000 UTC m=+3.124367426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wpjqm" (UniqueName: "kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm") pod "network-check-target-9dmw9" (UID: "250bd337-fccf-462c-a9f7-d6df8b909ac6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:42.541684 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.541660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwplc\" (UniqueName: \"kubernetes.io/projected/2683c424-59e2-4ac8-85c6-adb67def8d4f-kube-api-access-cwplc\") pod \"node-ca-dzcdv\" (UID: \"2683c424-59e2-4ac8-85c6-adb67def8d4f\") " pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.541800 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.541710 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcd6n\" (UniqueName: \"kubernetes.io/projected/36452282-6303-4873-8e65-3dbf6166bb05-kube-api-access-gcd6n\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:42.547221 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.547096 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjmwl\" (UniqueName: \"kubernetes.io/projected/d0c21dba-b43a-4d9b-8191-ec788fa761e0-kube-api-access-jjmwl\") pod \"multus-2cnhf\" (UID: \"d0c21dba-b43a-4d9b-8191-ec788fa761e0\") " pod="openshift-multus/multus-2cnhf" May 20 13:49:42.547221 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.547208 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78td\" (UniqueName: \"kubernetes.io/projected/ac4906fa-5821-4932-a5fe-965573d8f96e-kube-api-access-t78td\") pod \"node-resolver-ttn2r\" (UID: \"ac4906fa-5821-4932-a5fe-965573d8f96e\") " pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.547639 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.547515 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbhl\" (UniqueName: \"kubernetes.io/projected/0968bab8-1e4f-4bee-974b-7245aac58209-kube-api-access-chbhl\") pod \"multus-additional-cni-plugins-4n8gm\" (UID: \"0968bab8-1e4f-4bee-974b-7245aac58209\") " pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.547639 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.547519 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjtpl\" (UniqueName: \"kubernetes.io/projected/2f74777a-5415-4cd8-b34f-86521909bc50-kube-api-access-mjtpl\") pod \"aws-ebs-csi-driver-node-vpglh\" (UID: \"2f74777a-5415-4cd8-b34f-86521909bc50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.562841 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.562813 2552 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 13:49:42.636809 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636758 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-modprobe-d\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.636809 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636806 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysconfig\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637040 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636869 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-log-socket\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637040 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636899 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rm596\" (UniqueName: \"kubernetes.io/projected/f49780be-f70f-4b46-b68f-756e0fbc1a83-kube-api-access-rm596\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637040 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636929 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-var-lib-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637040 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636935 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysconfig\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637040 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636970 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-log-socket\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637040 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-modprobe-d\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637040 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.636978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-var-lib-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637077 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-ovn\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637104 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cbf7364-8411-408b-9455-bb929a9088fc-ovn-node-metrics-cert\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637126 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-systemd\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637158 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-cni-bin\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-ovn\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637184 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/646aad3c-162b-4e94-8e66-2c7d2c3f4575-iptables-alerter-script\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637235 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-systemd\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637264 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-systemd-units\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637292 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637300 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-cni-bin\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637331 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysctl-conf\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637363 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637372 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-systemd-units\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637390 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-ovnkube-config\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637432 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-run\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637456 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/646aad3c-162b-4e94-8e66-2c7d2c3f4575-host-slash\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637482 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysctl-conf\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637483 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4llsx\" (UniqueName: \"kubernetes.io/projected/646aad3c-162b-4e94-8e66-2c7d2c3f4575-kube-api-access-4llsx\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637518 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637542 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-cni-netd\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637558 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-run\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637566 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-run-netns\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637574 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637590 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-systemd\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637517 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637623 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-node-log\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637635 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-run-ovn-kubernetes\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.637830 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637649 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-tuned\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637676 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-kubelet\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637675 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/646aad3c-162b-4e94-8e66-2c7d2c3f4575-host-slash\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637699 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-var-lib-kubelet\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637687 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-run-netns\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637724 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-cni-netd\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637772 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-host\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637726 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-host\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637786 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/646aad3c-162b-4e94-8e66-2c7d2c3f4575-iptables-alerter-script\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637810 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-var-lib-kubelet\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637833 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-kubelet\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637832 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-env-overrides\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637844 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-run-systemd\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637880 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-node-log\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637880 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-ovnkube-script-lib\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637929 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qzk7\" (UniqueName: \"kubernetes.io/projected/8cbf7364-8411-408b-9455-bb929a9088fc-kube-api-access-2qzk7\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.637986 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysctl-d\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638013 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f49780be-f70f-4b46-b68f-756e0fbc1a83-tmp\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.638588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638038 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-kubernetes\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638063 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-lib-modules\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638105 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-slash\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638109 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-ovnkube-config\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638130 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-etc-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638156 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-sys\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-kubernetes\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638235 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-etc-openvswitch\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638240 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cbf7364-8411-408b-9455-bb929a9088fc-host-slash\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638233 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-env-overrides\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638286 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-sys\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638342 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-sysctl-d\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638352 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f49780be-f70f-4b46-b68f-756e0fbc1a83-lib-modules\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.639584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.638417 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cbf7364-8411-408b-9455-bb929a9088fc-ovnkube-script-lib\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.640366 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.640342 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f49780be-f70f-4b46-b68f-756e0fbc1a83-etc-tuned\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.640494 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.640406 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f49780be-f70f-4b46-b68f-756e0fbc1a83-tmp\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.640571 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.640553 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cbf7364-8411-408b-9455-bb929a9088fc-ovn-node-metrics-cert\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.645189 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.645162 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qzk7\" (UniqueName: \"kubernetes.io/projected/8cbf7364-8411-408b-9455-bb929a9088fc-kube-api-access-2qzk7\") pod \"ovnkube-node-h5w7v\" (UID: \"8cbf7364-8411-408b-9455-bb929a9088fc\") " pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.645701 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.645680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4llsx\" (UniqueName: \"kubernetes.io/projected/646aad3c-162b-4e94-8e66-2c7d2c3f4575-kube-api-access-4llsx\") pod \"iptables-alerter-wcbdd\" (UID: \"646aad3c-162b-4e94-8e66-2c7d2c3f4575\") " pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.645821 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.645727 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm596\" (UniqueName: \"kubernetes.io/projected/f49780be-f70f-4b46-b68f-756e0fbc1a83-kube-api-access-rm596\") pod \"tuned-gl9qq\" (UID: \"f49780be-f70f-4b46-b68f-756e0fbc1a83\") " pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:42.719840 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.719806 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dzcdv" May 20 13:49:42.728815 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.728783 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" May 20 13:49:42.737648 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.737617 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sdw7x" May 20 13:49:42.743496 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.743457 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2cnhf" May 20 13:49:42.750324 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.750284 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" May 20 13:49:42.757203 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.757173 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ttn2r" May 20 13:49:42.764045 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.764018 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:49:42.770698 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.770675 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wcbdd" May 20 13:49:42.776337 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:42.776295 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" May 20 13:49:43.041693 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.041605 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:43.041870 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.041690 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:43.041870 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:43.041801 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 13:49:43.041870 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:43.041825 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:43.042034 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:43.041898 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:44.041881519 +0000 UTC m=+4.127294784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:43.042034 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:43.041829 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 13:49:43.042034 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:43.041946 2552 projected.go:194] Error preparing data for projected volume kube-api-access-wpjqm for pod openshift-network-diagnostics/network-check-target-9dmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:43.042034 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:43.042001 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm podName:250bd337-fccf-462c-a9f7-d6df8b909ac6 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:44.041985389 +0000 UTC m=+4.127398666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpjqm" (UniqueName: "kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm") pod "network-check-target-9dmw9" (UID: "250bd337-fccf-462c-a9f7-d6df8b909ac6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:43.125836 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.125809 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0968bab8_1e4f_4bee_974b_7245aac58209.slice/crio-2141d5a4c9db92f5f6d0607b9792e1ad174037e36c8a2577ee76f016446eef74 WatchSource:0}: Error finding container 2141d5a4c9db92f5f6d0607b9792e1ad174037e36c8a2577ee76f016446eef74: Status 404 returned error can't find the container with id 2141d5a4c9db92f5f6d0607b9792e1ad174037e36c8a2577ee76f016446eef74 May 20 13:49:43.127001 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.126972 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4deeff_cbf5_43e0_b2c0_06b1f91f06c4.slice/crio-1c707098f3a8cfb03abf372bc3a0610613d3c3ddc8b7dc26a70f0ad5105c6f1c WatchSource:0}: Error finding container 1c707098f3a8cfb03abf372bc3a0610613d3c3ddc8b7dc26a70f0ad5105c6f1c: Status 404 returned error can't find the container with id 1c707098f3a8cfb03abf372bc3a0610613d3c3ddc8b7dc26a70f0ad5105c6f1c May 20 13:49:43.133076 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.133050 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbf7364_8411_408b_9455_bb929a9088fc.slice/crio-a65223165d64f08c800bc1f669f34d5ed0d56d0a4f4f05e7f1e5971547c51bce WatchSource:0}: Error finding container a65223165d64f08c800bc1f669f34d5ed0d56d0a4f4f05e7f1e5971547c51bce: Status 404 returned error can't find the container with id a65223165d64f08c800bc1f669f34d5ed0d56d0a4f4f05e7f1e5971547c51bce May 20 13:49:43.133983 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.133939 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4906fa_5821_4932_a5fe_965573d8f96e.slice/crio-e33d4170e80cb6d468bdca10460f6bc0ec5a6e8cd2bae97ea07d44dd313cf2b8 WatchSource:0}: Error finding container e33d4170e80cb6d468bdca10460f6bc0ec5a6e8cd2bae97ea07d44dd313cf2b8: Status 404 returned error can't find the container with id e33d4170e80cb6d468bdca10460f6bc0ec5a6e8cd2bae97ea07d44dd313cf2b8 May 20 13:49:43.134666 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.134560 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2683c424_59e2_4ac8_85c6_adb67def8d4f.slice/crio-5d9176307a496a3bbfd09eb9b9595666509084ea2f32845b5dcbd8bcdf7e5bf5 WatchSource:0}: Error finding container 5d9176307a496a3bbfd09eb9b9595666509084ea2f32845b5dcbd8bcdf7e5bf5: Status 404 returned error can't find the container with id 5d9176307a496a3bbfd09eb9b9595666509084ea2f32845b5dcbd8bcdf7e5bf5 May 20 13:49:43.135588 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.135564 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c21dba_b43a_4d9b_8191_ec788fa761e0.slice/crio-d172008bb2cfec494a52d8b3c143dcbed853ec5e676ac483bfe269a4c18f7172 WatchSource:0}: Error finding container d172008bb2cfec494a52d8b3c143dcbed853ec5e676ac483bfe269a4c18f7172: Status 404 returned error can't find the container with id d172008bb2cfec494a52d8b3c143dcbed853ec5e676ac483bfe269a4c18f7172 May 20 13:49:43.136637 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.136597 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646aad3c_162b_4e94_8e66_2c7d2c3f4575.slice/crio-7351966e39153a54357c21a2f3c1bec79b6e3460b8bfd7dcffd97ec5b803a103 WatchSource:0}: Error finding container 7351966e39153a54357c21a2f3c1bec79b6e3460b8bfd7dcffd97ec5b803a103: Status 404 returned error can't find the container with id 7351966e39153a54357c21a2f3c1bec79b6e3460b8bfd7dcffd97ec5b803a103 May 20 13:49:43.137706 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.137679 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f74777a_5415_4cd8_b34f_86521909bc50.slice/crio-b09b7e9f966ed8babde90af82837508bcdce50b651b9c696ba5bf6a03d4a61dc WatchSource:0}: Error finding container b09b7e9f966ed8babde90af82837508bcdce50b651b9c696ba5bf6a03d4a61dc: Status 404 returned error can't find the container with id b09b7e9f966ed8babde90af82837508bcdce50b651b9c696ba5bf6a03d4a61dc May 20 13:49:43.138640 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:49:43.138619 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49780be_f70f_4b46_b68f_756e0fbc1a83.slice/crio-e83aedc20084fd88b73284fba0f2e935f2e6642ae7fb953ea04f8b4b57c23032 WatchSource:0}: Error finding container e83aedc20084fd88b73284fba0f2e935f2e6642ae7fb953ea04f8b4b57c23032: Status 404 returned error can't find the container with id e83aedc20084fd88b73284fba0f2e935f2e6642ae7fb953ea04f8b4b57c23032 May 20 13:49:43.481371 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.481325 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 13:44:41 +0000 UTC" deadline="2027-10-19 06:02:58.517754716 +0000 UTC" May 20 13:49:43.481371 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.481365 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12400h13m15.036392757s" May 20 13:49:43.533855 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.533812 2552 generic.go:358] "Generic (PLEG): container finished" podID="f449def4ab9b9a195375009b0eb8f88e" containerID="8fafd61bb1e950d5746bfccc38d70a940de5e3637ac9905a4c2d99b71a94a9c8" exitCode=0 May 20 13:49:43.534073 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.534027 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" event={"ID":"f449def4ab9b9a195375009b0eb8f88e","Type":"ContainerDied","Data":"8fafd61bb1e950d5746bfccc38d70a940de5e3637ac9905a4c2d99b71a94a9c8"} May 20 13:49:43.547777 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.547739 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" event={"ID":"f49780be-f70f-4b46-b68f-756e0fbc1a83","Type":"ContainerStarted","Data":"e83aedc20084fd88b73284fba0f2e935f2e6642ae7fb953ea04f8b4b57c23032"} May 20 13:49:43.553823 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.553770 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" event={"ID":"2f74777a-5415-4cd8-b34f-86521909bc50","Type":"ContainerStarted","Data":"b09b7e9f966ed8babde90af82837508bcdce50b651b9c696ba5bf6a03d4a61dc"} May 20 13:49:43.557288 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.557222 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cnhf" event={"ID":"d0c21dba-b43a-4d9b-8191-ec788fa761e0","Type":"ContainerStarted","Data":"d172008bb2cfec494a52d8b3c143dcbed853ec5e676ac483bfe269a4c18f7172"} May 20 13:49:43.561133 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.561100 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dzcdv" event={"ID":"2683c424-59e2-4ac8-85c6-adb67def8d4f","Type":"ContainerStarted","Data":"5d9176307a496a3bbfd09eb9b9595666509084ea2f32845b5dcbd8bcdf7e5bf5"} May 20 13:49:43.564082 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.564048 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ttn2r" event={"ID":"ac4906fa-5821-4932-a5fe-965573d8f96e","Type":"ContainerStarted","Data":"e33d4170e80cb6d468bdca10460f6bc0ec5a6e8cd2bae97ea07d44dd313cf2b8"} May 20 13:49:43.570626 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.570527 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdw7x" event={"ID":"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4","Type":"ContainerStarted","Data":"1c707098f3a8cfb03abf372bc3a0610613d3c3ddc8b7dc26a70f0ad5105c6f1c"} May 20 13:49:43.573769 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.573733 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerStarted","Data":"2141d5a4c9db92f5f6d0607b9792e1ad174037e36c8a2577ee76f016446eef74"} May 20 13:49:43.581206 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.581162 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" event={"ID":"95a443e8c9080bfbbf1a963ab72a458b","Type":"ContainerStarted","Data":"c6b6ea7978bc2a85ee15e744368befcc4547326d45600a6899e4c15091aed882"} May 20 13:49:43.584999 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.584963 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wcbdd" event={"ID":"646aad3c-162b-4e94-8e66-2c7d2c3f4575","Type":"ContainerStarted","Data":"7351966e39153a54357c21a2f3c1bec79b6e3460b8bfd7dcffd97ec5b803a103"} May 20 13:49:43.587617 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.587580 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"a65223165d64f08c800bc1f669f34d5ed0d56d0a4f4f05e7f1e5971547c51bce"} May 20 13:49:43.597354 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:43.597263 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-199.ec2.internal" podStartSLOduration=1.597240809 podStartE2EDuration="1.597240809s" podCreationTimestamp="2026-05-20 13:49:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:49:43.59626008 +0000 UTC m=+3.681673386" watchObservedRunningTime="2026-05-20 13:49:43.597240809 +0000 UTC m=+3.682654093" May 20 13:49:44.050602 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:44.050503 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:44.050602 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:44.050578 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:44.050836 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.050761 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 13:49:44.050836 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.050772 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:44.050950 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.050850 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:46.050825709 +0000 UTC m=+6.136238986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:44.051157 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.050781 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 13:49:44.051157 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.051070 2552 projected.go:194] Error preparing data for projected volume kube-api-access-wpjqm for pod openshift-network-diagnostics/network-check-target-9dmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:44.051157 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.051132 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm podName:250bd337-fccf-462c-a9f7-d6df8b909ac6 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:46.05111533 +0000 UTC m=+6.136528609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpjqm" (UniqueName: "kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm") pod "network-check-target-9dmw9" (UID: "250bd337-fccf-462c-a9f7-d6df8b909ac6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:44.540490 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:44.539608 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:44.540490 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.539734 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:44.540490 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:44.540254 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:44.540490 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:44.540394 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:44.602850 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:44.602392 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" event={"ID":"f449def4ab9b9a195375009b0eb8f88e","Type":"ContainerStarted","Data":"a1f2ae8c5bd5d148f0f8bdd8f350ba34e34faf363d0173dd152bc7b1b3a5ba3f"} May 20 13:49:44.624342 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:44.623490 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-199.ec2.internal" podStartSLOduration=2.623471274 podStartE2EDuration="2.623471274s" podCreationTimestamp="2026-05-20 13:49:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:49:44.623062027 +0000 UTC m=+4.708475311" watchObservedRunningTime="2026-05-20 13:49:44.623471274 +0000 UTC m=+4.708884558" May 20 13:49:46.068330 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:46.068281 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:46.068799 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:46.068366 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:46.068799 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.068501 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:46.068799 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.068566 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:50.068546361 +0000 UTC m=+10.153959622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:46.069011 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.068984 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 13:49:46.069011 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.069005 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 13:49:46.069100 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.069018 2552 projected.go:194] Error preparing data for projected volume kube-api-access-wpjqm for pod openshift-network-diagnostics/network-check-target-9dmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:46.069100 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.069062 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm podName:250bd337-fccf-462c-a9f7-d6df8b909ac6 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:50.069047735 +0000 UTC m=+10.154461008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpjqm" (UniqueName: "kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm") pod "network-check-target-9dmw9" (UID: "250bd337-fccf-462c-a9f7-d6df8b909ac6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:46.523379 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:46.523233 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:46.523379 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:46.523273 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:46.523379 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.523396 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:46.523868 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:46.523818 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:48.522456 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:48.522421 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:48.522456 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:48.522435 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:48.523030 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:48.522545 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:48.523030 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:48.522974 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:50.101828 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:50.101924 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.102056 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.102124 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:58.102102136 +0000 UTC m=+18.187515414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.102474 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.102496 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.102508 2552 projected.go:194] Error preparing data for projected volume kube-api-access-wpjqm for pod openshift-network-diagnostics/network-check-target-9dmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:50.102599 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.102558 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm podName:250bd337-fccf-462c-a9f7-d6df8b909ac6 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:58.102540626 +0000 UTC m=+18.187953893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpjqm" (UniqueName: "kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm") pod "network-check-target-9dmw9" (UID: "250bd337-fccf-462c-a9f7-d6df8b909ac6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:50.524043 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:50.523955 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:50.524215 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.524087 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:50.524215 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:50.524172 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:50.524343 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:50.524258 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:51.201145 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.201007 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nx5w4"] May 20 13:49:51.207824 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.207465 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.207824 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:51.207558 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:49:51.311408 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.311360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-dbus\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.311588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.311432 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-kubelet-config\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.311588 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.311521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.412560 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.412525 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.412745 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.412579 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-dbus\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.412745 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.412615 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-kubelet-config\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.412745 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:51.412711 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 13:49:51.412745 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.412731 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-kubelet-config\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.412985 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:51.412787 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret podName:700a8d0c-f2b6-422e-a756-ae3c07ab68f5 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:51.91276714 +0000 UTC m=+11.998180409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret") pod "global-pull-secret-syncer-nx5w4" (UID: "700a8d0c-f2b6-422e-a756-ae3c07ab68f5") : object "kube-system"/"original-pull-secret" not registered May 20 13:49:51.412985 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.412811 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-dbus\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.917630 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:51.917563 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:51.917830 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:51.917754 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 13:49:51.917830 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:51.917813 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret podName:700a8d0c-f2b6-422e-a756-ae3c07ab68f5 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:52.917796498 +0000 UTC m=+13.003209774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret") pod "global-pull-secret-syncer-nx5w4" (UID: "700a8d0c-f2b6-422e-a756-ae3c07ab68f5") : object "kube-system"/"original-pull-secret" not registered May 20 13:49:52.522958 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:52.522921 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:52.523437 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:52.522969 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:52.523437 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:52.523084 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:49:52.523437 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:52.523192 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:52.523437 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:52.523327 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:52.523656 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:52.523437 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:52.926331 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:52.926217 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:52.926519 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:52.926378 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 13:49:52.926519 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:52.926462 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret podName:700a8d0c-f2b6-422e-a756-ae3c07ab68f5 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:54.926439775 +0000 UTC m=+15.011853042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret") pod "global-pull-secret-syncer-nx5w4" (UID: "700a8d0c-f2b6-422e-a756-ae3c07ab68f5") : object "kube-system"/"original-pull-secret" not registered May 20 13:49:54.523099 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:54.523057 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:54.523600 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:54.523100 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:54.523600 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:54.523216 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:54.523600 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:54.523255 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:49:54.523600 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:54.523303 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:54.523600 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:54.523421 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:54.937401 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:54.937295 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:54.937557 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:54.937450 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 13:49:54.937557 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:54.937518 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret podName:700a8d0c-f2b6-422e-a756-ae3c07ab68f5 nodeName:}" failed. No retries permitted until 2026-05-20 13:49:58.937497995 +0000 UTC m=+19.022911273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret") pod "global-pull-secret-syncer-nx5w4" (UID: "700a8d0c-f2b6-422e-a756-ae3c07ab68f5") : object "kube-system"/"original-pull-secret" not registered May 20 13:49:56.522431 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:56.522289 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:56.522431 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:56.522289 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:56.522950 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:56.522441 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:56.522950 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:56.522292 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:56.522950 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:56.522495 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:49:56.522950 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:56.522617 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:58.161833 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:58.161791 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:58.162269 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:58.161863 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:58.162269 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.161954 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:58.162269 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.161986 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 13:49:58.162269 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.162002 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 13:49:58.162269 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.162016 2552 projected.go:194] Error preparing data for projected volume kube-api-access-wpjqm for pod openshift-network-diagnostics/network-check-target-9dmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:58.162269 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.162042 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:14.162015345 +0000 UTC m=+34.247428614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:49:58.162269 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.162061 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm podName:250bd337-fccf-462c-a9f7-d6df8b909ac6 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:14.162050449 +0000 UTC m=+34.247463715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpjqm" (UniqueName: "kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm") pod "network-check-target-9dmw9" (UID: "250bd337-fccf-462c-a9f7-d6df8b909ac6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:49:58.522920 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:58.522881 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:49:58.522920 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:58.522920 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:49:58.523198 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:58.522947 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:58.523198 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.523072 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:49:58.523198 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.523115 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:49:58.523362 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.523204 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:49:58.967759 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:49:58.967712 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:49:58.968008 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.967857 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 13:49:58.968008 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:49:58.967921 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret podName:700a8d0c-f2b6-422e-a756-ae3c07ab68f5 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:06.967901745 +0000 UTC m=+27.053315020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret") pod "global-pull-secret-syncer-nx5w4" (UID: "700a8d0c-f2b6-422e-a756-ae3c07ab68f5") : object "kube-system"/"original-pull-secret" not registered May 20 13:50:00.526525 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:00.526497 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:00.526949 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:00.526497 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:00.526949 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:00.526614 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:00.526949 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:00.526703 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:00.526949 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:00.526506 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:00.526949 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:00.526818 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:01.646622 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.646588 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" event={"ID":"f49780be-f70f-4b46-b68f-756e0fbc1a83","Type":"ContainerStarted","Data":"a856b69f9b62c13b4b20d41f0fa8d241fd6db6ed490fae90266e24f0185f1cc4"} May 20 13:50:01.648018 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.647989 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" event={"ID":"2f74777a-5415-4cd8-b34f-86521909bc50","Type":"ContainerStarted","Data":"8012799604cfababe33de6f759c9910f790f2e6494bc8f2de0fde291b2c1f5c9"} May 20 13:50:01.649220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.649196 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2cnhf" event={"ID":"d0c21dba-b43a-4d9b-8191-ec788fa761e0","Type":"ContainerStarted","Data":"00cd1f9a15f741da3914ad583c7bc37e0c482acd4b11334937fb17c2fe3ade90"} May 20 13:50:01.650648 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.650621 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dzcdv" event={"ID":"2683c424-59e2-4ac8-85c6-adb67def8d4f","Type":"ContainerStarted","Data":"a987d4a8273b68a76b5d93511dcd61098371d22edc27a0a62683616ec2c61c2a"} May 20 13:50:01.652111 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.652077 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ttn2r" event={"ID":"ac4906fa-5821-4932-a5fe-965573d8f96e","Type":"ContainerStarted","Data":"d92640250a6e4a7b5e4ef09b4a4a72c4a649e08eca6a9f0466dcfa906b87ee5c"} May 20 13:50:01.653332 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.653293 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sdw7x" event={"ID":"6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4","Type":"ContainerStarted","Data":"63ecf8c32eaba30b63d936360d98a42105439f8cdd9090f6b18c22a50ea84c64"} May 20 13:50:01.654705 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.654677 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerStarted","Data":"542739228d4d84c07151ee1b2cfe15219f7269a58582009e7220e0a64adfabfc"} May 20 13:50:01.656131 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.656110 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:50:01.656472 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.656449 2552 generic.go:358] "Generic (PLEG): container finished" podID="8cbf7364-8411-408b-9455-bb929a9088fc" containerID="a0476a005e2e267922bde7ab791424d6dbbf1d45b8722ee21ef484d10d61bc93" exitCode=1 May 20 13:50:01.656566 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.656483 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerDied","Data":"a0476a005e2e267922bde7ab791424d6dbbf1d45b8722ee21ef484d10d61bc93"} May 20 13:50:01.656566 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.656504 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"ce072681e1a30757447bb29b11a47d6e67603988a8069644b58bf02c459a70a2"} May 20 13:50:01.666078 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.666010 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gl9qq" podStartSLOduration=2.603002312 podStartE2EDuration="20.665989821s" podCreationTimestamp="2026-05-20 13:49:41 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.140246763 +0000 UTC m=+3.225660024" lastFinishedPulling="2026-05-20 13:50:01.203234261 +0000 UTC m=+21.288647533" observedRunningTime="2026-05-20 13:50:01.665370112 +0000 UTC m=+21.750783397" watchObservedRunningTime="2026-05-20 13:50:01.665989821 +0000 UTC m=+21.751403131" May 20 13:50:01.681874 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.681809 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dzcdv" podStartSLOduration=3.6163939579999997 podStartE2EDuration="21.681788598s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.136574011 +0000 UTC m=+3.221987286" lastFinishedPulling="2026-05-20 13:50:01.201968659 +0000 UTC m=+21.287381926" observedRunningTime="2026-05-20 13:50:01.68146719 +0000 UTC m=+21.766880473" watchObservedRunningTime="2026-05-20 13:50:01.681788598 +0000 UTC m=+21.767201882" May 20 13:50:01.733298 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.733100 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2cnhf" podStartSLOduration=3.649286157 podStartE2EDuration="21.733084307s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.138450358 +0000 UTC m=+3.223863620" lastFinishedPulling="2026-05-20 13:50:01.222248505 +0000 UTC m=+21.307661770" observedRunningTime="2026-05-20 13:50:01.73305032 +0000 UTC m=+21.818463602" watchObservedRunningTime="2026-05-20 13:50:01.733084307 +0000 UTC m=+21.818497591" May 20 13:50:01.733791 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.733759 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sdw7x" podStartSLOduration=8.429445353 podStartE2EDuration="21.733749703s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.129753733 +0000 UTC m=+3.215166996" lastFinishedPulling="2026-05-20 13:49:56.434058081 +0000 UTC m=+16.519471346" observedRunningTime="2026-05-20 13:50:01.706408004 +0000 UTC m=+21.791821299" watchObservedRunningTime="2026-05-20 13:50:01.733749703 +0000 UTC m=+21.819163039" May 20 13:50:01.781739 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:01.781692 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ttn2r" podStartSLOduration=3.716045081 podStartE2EDuration="21.781677396s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.135797189 +0000 UTC m=+3.221210453" lastFinishedPulling="2026-05-20 13:50:01.201429493 +0000 UTC m=+21.286842768" observedRunningTime="2026-05-20 13:50:01.781183147 +0000 UTC m=+21.866596443" watchObservedRunningTime="2026-05-20 13:50:01.781677396 +0000 UTC m=+21.867090678" May 20 13:50:02.525144 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.525106 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:02.525144 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.525143 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:02.525419 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:02.525206 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:02.525419 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.525236 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:02.525419 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:02.525333 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:02.525419 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:02.525373 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:02.661421 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.661381 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:50:02.661885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.661720 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"1cff3c648b2559e23c69372a31c1860b723a52982cf4d147e5c3dd0bc71a223f"} May 20 13:50:02.661885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.661754 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"603b44e008fbde76b904b5d5e0538f65ad96c75164d6b3b85bb1a4152a9b2241"} May 20 13:50:02.661885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.661765 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"f94ef80dae574f4016c5245589523b811ed2502fb69ead06045827758cc086b8"} May 20 13:50:02.661885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.661775 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"d374719957b88f37e638f66cb5783d01a449f29b1a2c9ffab8e51c9b728c45b7"} May 20 13:50:02.662841 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.662819 2552 generic.go:358] "Generic (PLEG): container finished" podID="0968bab8-1e4f-4bee-974b-7245aac58209" containerID="542739228d4d84c07151ee1b2cfe15219f7269a58582009e7220e0a64adfabfc" exitCode=0 May 20 13:50:02.662967 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.662923 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerDied","Data":"542739228d4d84c07151ee1b2cfe15219f7269a58582009e7220e0a64adfabfc"} May 20 13:50:02.944091 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:02.944061 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 13:50:03.494371 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:03.494109 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T13:50:02.94408097Z","UUID":"81ff0e16-5ca5-43c1-8d73-dcf63474315b","Handler":null,"Name":"","Endpoint":""} May 20 13:50:03.495625 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:03.495607 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 13:50:03.495625 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:03.495631 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 13:50:03.667289 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:03.667248 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" event={"ID":"2f74777a-5415-4cd8-b34f-86521909bc50","Type":"ContainerStarted","Data":"d1c48c09d6b7a85028e2c1882bafa2bfd1af5601c660ef979388c903610f4d74"} May 20 13:50:03.668955 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:03.668920 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wcbdd" event={"ID":"646aad3c-162b-4e94-8e66-2c7d2c3f4575","Type":"ContainerStarted","Data":"32e02e71524bfee28db2b586970a54c35cc6439463a95726e865b59f6278784e"} May 20 13:50:03.686303 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:03.686255 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wcbdd" podStartSLOduration=4.623683791 podStartE2EDuration="22.686241931s" podCreationTimestamp="2026-05-20 13:49:41 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.13885895 +0000 UTC m=+3.224272218" lastFinishedPulling="2026-05-20 13:50:01.201417086 +0000 UTC m=+21.286830358" observedRunningTime="2026-05-20 13:50:03.686223514 +0000 UTC m=+23.771636798" watchObservedRunningTime="2026-05-20 13:50:03.686241931 +0000 UTC m=+23.771655225" May 20 13:50:04.523166 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.523133 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:04.523166 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.523165 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:04.523461 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.523132 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:04.523461 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:04.523274 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:04.523461 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:04.523379 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:04.523609 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:04.523462 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:04.673094 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.673054 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" event={"ID":"2f74777a-5415-4cd8-b34f-86521909bc50","Type":"ContainerStarted","Data":"92eeb15e9dbdf77aea7f558bd0882ee34f6ef4e19f62953a22eeb7ff5350ef63"} May 20 13:50:04.676352 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.676322 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:50:04.676676 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.676650 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"d82e25149844d24e55a82b671fdb445dd489db23e21d5b328f872396c5359a0a"} May 20 13:50:04.692694 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.692632 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vpglh" podStartSLOduration=3.54010122 podStartE2EDuration="24.692610154s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.13982913 +0000 UTC m=+3.225242391" lastFinishedPulling="2026-05-20 13:50:04.292338052 +0000 UTC m=+24.377751325" observedRunningTime="2026-05-20 13:50:04.692267061 +0000 UTC m=+24.777680343" watchObservedRunningTime="2026-05-20 13:50:04.692610154 +0000 UTC m=+24.778023440" May 20 13:50:04.735550 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.735515 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sdw7x" May 20 13:50:04.736246 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:04.736226 2552 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sdw7x" May 20 13:50:05.678658 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:05.678626 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sdw7x" May 20 13:50:05.679268 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:05.679137 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sdw7x" May 20 13:50:06.522826 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:06.522788 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:06.523039 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:06.522843 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:06.523039 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:06.522934 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:06.523039 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:06.523019 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:06.523219 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:06.523035 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:06.523219 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:06.523129 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:07.030730 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.030702 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:07.031286 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:07.030867 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 20 13:50:07.031286 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:07.030954 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret podName:700a8d0c-f2b6-422e-a756-ae3c07ab68f5 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:23.030932628 +0000 UTC m=+43.116345893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret") pod "global-pull-secret-syncer-nx5w4" (UID: "700a8d0c-f2b6-422e-a756-ae3c07ab68f5") : object "kube-system"/"original-pull-secret" not registered May 20 13:50:07.684054 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.683866 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:50:07.684432 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.684403 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"b14ee694633de32ec42ad2f1b6613a76a1841e09a52cc6acb5909d850dcbcf08"} May 20 13:50:07.685540 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.684778 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:50:07.685540 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.684809 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:50:07.685540 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.684988 2552 scope.go:117] "RemoveContainer" containerID="a0476a005e2e267922bde7ab791424d6dbbf1d45b8722ee21ef484d10d61bc93" May 20 13:50:07.687285 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.687124 2552 generic.go:358] "Generic (PLEG): container finished" podID="0968bab8-1e4f-4bee-974b-7245aac58209" containerID="a750c05ea3926062e9392cf6452e7841c8de23c55aa131167b64d685c2031c01" exitCode=0 May 20 13:50:07.687485 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.687378 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerDied","Data":"a750c05ea3926062e9392cf6452e7841c8de23c55aa131167b64d685c2031c01"} May 20 13:50:07.703400 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:07.703376 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:50:08.522277 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.522246 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:08.522636 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.522246 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:08.522636 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.522246 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:08.522636 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:08.522501 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:08.522636 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:08.522583 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:08.522807 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:08.522668 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:08.691625 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.691541 2552 generic.go:358] "Generic (PLEG): container finished" podID="0968bab8-1e4f-4bee-974b-7245aac58209" containerID="b3523fee2c00c2387bf17e6e14f55f6399a7287730e5e2521e6b34dd54f47e94" exitCode=0 May 20 13:50:08.691782 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.691622 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerDied","Data":"b3523fee2c00c2387bf17e6e14f55f6399a7287730e5e2521e6b34dd54f47e94"} May 20 13:50:08.695143 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.695064 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:50:08.695454 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.695427 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" event={"ID":"8cbf7364-8411-408b-9455-bb929a9088fc","Type":"ContainerStarted","Data":"4bd75d6dfb05f1d6752ec4a11a01c4a373dbf0ea5f6b2ef3205e7851f05b7cf7"} May 20 13:50:08.695725 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.695710 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:50:08.711749 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.711721 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:50:08.743712 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:08.743662 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" podStartSLOduration=9.625028762 podStartE2EDuration="27.743647981s" podCreationTimestamp="2026-05-20 13:49:41 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.135018867 +0000 UTC m=+3.220432144" lastFinishedPulling="2026-05-20 13:50:01.253638087 +0000 UTC m=+21.339051363" observedRunningTime="2026-05-20 13:50:08.742874621 +0000 UTC m=+28.828287905" watchObservedRunningTime="2026-05-20 13:50:08.743647981 +0000 UTC m=+28.829061264" May 20 13:50:09.000614 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.000575 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nx5w4"] May 20 13:50:09.000770 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.000685 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:09.000812 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:09.000790 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:09.003675 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.003644 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dmw9"] May 20 13:50:09.003794 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.003748 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:09.003847 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:09.003829 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:09.006257 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.006229 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p2jmv"] May 20 13:50:09.006413 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.006358 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:09.006503 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:09.006476 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:09.701977 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.701881 2552 generic.go:358] "Generic (PLEG): container finished" podID="0968bab8-1e4f-4bee-974b-7245aac58209" containerID="9d40c94d6007c1519a88b0bd38eaac1b84310d6765a72f4127bb6a6106181d1b" exitCode=0 May 20 13:50:09.702349 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:09.701971 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerDied","Data":"9d40c94d6007c1519a88b0bd38eaac1b84310d6765a72f4127bb6a6106181d1b"} May 20 13:50:10.523445 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:10.523409 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:10.523627 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:10.523523 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:10.523627 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:10.523584 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:10.523724 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:10.523665 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:10.523815 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:10.523793 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:10.523937 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:10.523910 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:12.522307 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:12.522271 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:12.522938 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:12.522271 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:12.522938 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:12.522436 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dmw9" podUID="250bd337-fccf-462c-a9f7-d6df8b909ac6" May 20 13:50:12.522938 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:12.522285 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:12.522938 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:12.522493 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p2jmv" podUID="36452282-6303-4873-8e65-3dbf6166bb05" May 20 13:50:12.522938 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:12.522580 2552 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nx5w4" podUID="700a8d0c-f2b6-422e-a756-ae3c07ab68f5" May 20 13:50:14.186937 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.186847 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:14.187428 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.186947 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:14.187428 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.187040 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:50:14.187428 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.187100 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:46.187080749 +0000 UTC m=+66.272494024 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 13:50:14.187428 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.187036 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 13:50:14.187428 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.187158 2552 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 13:50:14.187428 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.187186 2552 projected.go:194] Error preparing data for projected volume kube-api-access-wpjqm for pod openshift-network-diagnostics/network-check-target-9dmw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:50:14.187428 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.187236 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm podName:250bd337-fccf-462c-a9f7-d6df8b909ac6 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:46.187223781 +0000 UTC m=+66.272637046 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpjqm" (UniqueName: "kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm") pod "network-check-target-9dmw9" (UID: "250bd337-fccf-462c-a9f7-d6df8b909ac6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 13:50:14.199071 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.199041 2552 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-199.ec2.internal" event="NodeReady" May 20 13:50:14.199244 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.199187 2552 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 13:50:14.234018 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.233952 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm"] May 20 13:50:14.238730 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.238700 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565"] May 20 13:50:14.238900 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.238854 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.241443 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.241418 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 20 13:50:14.242229 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.241698 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-z6l5q\"" May 20 13:50:14.242229 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.241776 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 20 13:50:14.242229 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.242019 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 20 13:50:14.242229 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.242154 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 20 13:50:14.242564 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.242538 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66fd4ff844-qd7qh"] May 20 13:50:14.242777 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.242744 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.244923 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.244905 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 20 13:50:14.246561 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.246543 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5"] May 20 13:50:14.246746 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.246689 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.249082 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.249060 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 20 13:50:14.249350 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.249300 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 20 13:50:14.249428 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.249361 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lmnhj\"" May 20 13:50:14.250188 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.249791 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 20 13:50:14.254036 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.252546 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm"] May 20 13:50:14.254036 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.252694 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.254036 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.253995 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565"] May 20 13:50:14.254258 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.254069 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5"] May 20 13:50:14.255382 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.255172 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 20 13:50:14.256070 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.255958 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 20 13:50:14.256234 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.256160 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 20 13:50:14.256295 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.256161 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 20 13:50:14.258223 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.258198 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7v6cc"] May 20 13:50:14.258526 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.258504 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 20 13:50:14.262610 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.262589 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:14.265181 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.265156 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 13:50:14.265281 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.265184 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 13:50:14.265281 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.265183 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 13:50:14.265738 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.265720 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lgp7k\"" May 20 13:50:14.269439 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.269413 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66fd4ff844-qd7qh"] May 20 13:50:14.271247 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.271224 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7v6cc"] May 20 13:50:14.354511 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.354475 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t4gw4"] May 20 13:50:14.358343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.358294 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.360979 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.360954 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 13:50:14.361135 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.360987 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 13:50:14.361135 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.361011 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qrdp6\"" May 20 13:50:14.368730 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.368680 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t4gw4"] May 20 13:50:14.387627 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387584 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd6fc199-a5bb-40b6-b61f-b1c8b648ebab-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87d78d4b8-lclxm\" (UID: \"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.387627 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387627 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.387885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387653 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:14.387885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387680 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htv2c\" (UniqueName: \"kubernetes.io/projected/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-kube-api-access-htv2c\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:14.387885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387719 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-image-registry-private-configuration\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.387885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387748 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-bound-sa-token\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.387885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387779 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-installation-pull-secrets\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.387885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387818 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-trusted-ca\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.387885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-ca\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387930 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/035e940a-2d43-4712-987c-89caa8e59db1-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387964 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-ca-trust-extracted\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387980 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndt97\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-kube-api-access-ndt97\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.387999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqg55\" (UniqueName: \"kubernetes.io/projected/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-kube-api-access-gqg55\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388042 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-tmp\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388087 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388127 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kx8f\" (UniqueName: \"kubernetes.io/projected/dd6fc199-a5bb-40b6-b61f-b1c8b648ebab-kube-api-access-9kx8f\") pod \"managed-serviceaccount-addon-agent-87d78d4b8-lclxm\" (UID: \"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.388225 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388165 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzszh\" (UniqueName: \"kubernetes.io/projected/035e940a-2d43-4712-987c-89caa8e59db1-kube-api-access-hzszh\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.388705 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388246 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-hub\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.388705 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388295 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.388705 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.388337 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-certificates\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.489127 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489088 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-trusted-ca\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.489127 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489131 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-ca\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.489448 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489270 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/035e940a-2d43-4712-987c-89caa8e59db1-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.489448 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489332 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-ca-trust-extracted\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.489448 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489361 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndt97\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-kube-api-access-ndt97\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.489448 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489391 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqg55\" (UniqueName: \"kubernetes.io/projected/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-kube-api-access-gqg55\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.489663 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489501 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.489663 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489531 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-tmp\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.489663 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489563 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.489663 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489595 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.489663 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489628 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kx8f\" (UniqueName: \"kubernetes.io/projected/dd6fc199-a5bb-40b6-b61f-b1c8b648ebab-kube-api-access-9kx8f\") pod \"managed-serviceaccount-addon-agent-87d78d4b8-lclxm\" (UID: \"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.489663 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489654 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzszh\" (UniqueName: \"kubernetes.io/projected/035e940a-2d43-4712-987c-89caa8e59db1-kube-api-access-hzszh\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.489954 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489683 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-hub\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.489954 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489710 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.489954 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489743 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-certificates\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.489954 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489752 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-ca-trust-extracted\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.489954 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.489770 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96404fef-e012-444e-98dd-893bcb9fa535-config-volume\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.490195 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.490007 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 13:50:14.490195 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.490027 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fd4ff844-qd7qh: secret "image-registry-tls" not found May 20 13:50:14.490195 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490077 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/035e940a-2d43-4712-987c-89caa8e59db1-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.490195 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.490091 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls podName:2ec236ec-a948-4d65-b0a4-da8f4dec0f4b nodeName:}" failed. No retries permitted until 2026-05-20 13:50:14.990071818 +0000 UTC m=+35.075485091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls") pod "image-registry-66fd4ff844-qd7qh" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b") : secret "image-registry-tls" not found May 20 13:50:14.490195 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490148 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-tmp\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.490474 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490234 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96404fef-e012-444e-98dd-893bcb9fa535-tmp-dir\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.490474 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490300 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd6fc199-a5bb-40b6-b61f-b1c8b648ebab-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87d78d4b8-lclxm\" (UID: \"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.490474 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490361 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.490621 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490583 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-trusted-ca\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.490677 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490636 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:14.490734 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490666 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-certificates\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.490734 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490672 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htv2c\" (UniqueName: \"kubernetes.io/projected/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-kube-api-access-htv2c\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:14.490734 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490720 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdk8p\" (UniqueName: \"kubernetes.io/projected/96404fef-e012-444e-98dd-893bcb9fa535-kube-api-access-mdk8p\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.490946 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490771 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-image-registry-private-configuration\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.490946 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490800 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-bound-sa-token\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.490946 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.490837 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-installation-pull-secrets\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.490946 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.490932 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 13:50:14.491254 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.491006 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert podName:0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:14.990977807 +0000 UTC m=+35.076391090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert") pod "ingress-canary-7v6cc" (UID: "0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0") : secret "canary-serving-cert" not found May 20 13:50:14.494978 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.494826 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.494978 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.494912 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-installation-pull-secrets\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.495173 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.495014 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.495173 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.495088 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd6fc199-a5bb-40b6-b61f-b1c8b648ebab-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87d78d4b8-lclxm\" (UID: \"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.495756 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.495728 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-hub\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.495864 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.495750 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-ca\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.496250 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.496226 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-image-registry-private-configuration\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.496347 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.496299 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/035e940a-2d43-4712-987c-89caa8e59db1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.499530 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.499505 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzszh\" (UniqueName: \"kubernetes.io/projected/035e940a-2d43-4712-987c-89caa8e59db1-kube-api-access-hzszh\") pod \"cluster-proxy-proxy-agent-84d49c476c-wfng5\" (UID: \"035e940a-2d43-4712-987c-89caa8e59db1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.499631 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.499541 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqg55\" (UniqueName: \"kubernetes.io/projected/e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6-kube-api-access-gqg55\") pod \"klusterlet-addon-workmgr-6bcbddb755-rh565\" (UID: \"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.500384 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.500360 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndt97\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-kube-api-access-ndt97\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.500544 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.500518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kx8f\" (UniqueName: \"kubernetes.io/projected/dd6fc199-a5bb-40b6-b61f-b1c8b648ebab-kube-api-access-9kx8f\") pod \"managed-serviceaccount-addon-agent-87d78d4b8-lclxm\" (UID: \"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.500806 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.500763 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htv2c\" (UniqueName: \"kubernetes.io/projected/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-kube-api-access-htv2c\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:14.502432 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.502412 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-bound-sa-token\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.522386 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.522356 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:14.522520 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.522388 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:14.522520 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.522363 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:14.526584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.526411 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 13:50:14.526584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.526425 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 13:50:14.526584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.526554 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 13:50:14.526584 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.526560 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6nbf\"" May 20 13:50:14.526860 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.526712 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rh8zp\"" May 20 13:50:14.526927 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.526909 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 13:50:14.560215 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.560186 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" May 20 13:50:14.569117 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.569086 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:14.585170 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.585127 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:50:14.592198 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.592163 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.592355 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.592223 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96404fef-e012-444e-98dd-893bcb9fa535-config-volume\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.592355 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.592285 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96404fef-e012-444e-98dd-893bcb9fa535-tmp-dir\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.592480 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.592392 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdk8p\" (UniqueName: \"kubernetes.io/projected/96404fef-e012-444e-98dd-893bcb9fa535-kube-api-access-mdk8p\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.592480 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.592422 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 13:50:14.592578 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.592499 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls podName:96404fef-e012-444e-98dd-893bcb9fa535 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:15.09247822 +0000 UTC m=+35.177891503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls") pod "dns-default-t4gw4" (UID: "96404fef-e012-444e-98dd-893bcb9fa535") : secret "dns-default-metrics-tls" not found May 20 13:50:14.592712 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.592689 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96404fef-e012-444e-98dd-893bcb9fa535-tmp-dir\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.592908 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.592882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96404fef-e012-444e-98dd-893bcb9fa535-config-volume\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.602056 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.602024 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdk8p\" (UniqueName: \"kubernetes.io/projected/96404fef-e012-444e-98dd-893bcb9fa535-kube-api-access-mdk8p\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:14.994905 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.994855 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:14.995109 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:14.995033 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:14.995109 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.995045 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 13:50:14.995109 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.995070 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fd4ff844-qd7qh: secret "image-registry-tls" not found May 20 13:50:14.995244 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.995158 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls podName:2ec236ec-a948-4d65-b0a4-da8f4dec0f4b nodeName:}" failed. No retries permitted until 2026-05-20 13:50:15.995136437 +0000 UTC m=+36.080549702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls") pod "image-registry-66fd4ff844-qd7qh" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b") : secret "image-registry-tls" not found May 20 13:50:14.995244 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.995188 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 13:50:14.995369 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:14.995257 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert podName:0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:15.995237346 +0000 UTC m=+36.080650611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert") pod "ingress-canary-7v6cc" (UID: "0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0") : secret "canary-serving-cert" not found May 20 13:50:15.096172 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:15.096126 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:15.096384 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:15.096332 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 13:50:15.096456 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:15.096415 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls podName:96404fef-e012-444e-98dd-893bcb9fa535 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:16.096390984 +0000 UTC m=+36.181804260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls") pod "dns-default-t4gw4" (UID: "96404fef-e012-444e-98dd-893bcb9fa535") : secret "dns-default-metrics-tls" not found May 20 13:50:16.003816 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.003637 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:16.004454 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:16.003790 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 13:50:16.004454 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.003902 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:16.004454 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:16.003929 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert podName:0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:18.003912996 +0000 UTC m=+38.089326276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert") pod "ingress-canary-7v6cc" (UID: "0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0") : secret "canary-serving-cert" not found May 20 13:50:16.004454 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:16.003995 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 13:50:16.004454 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:16.004009 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fd4ff844-qd7qh: secret "image-registry-tls" not found May 20 13:50:16.004454 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:16.004058 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls podName:2ec236ec-a948-4d65-b0a4-da8f4dec0f4b nodeName:}" failed. No retries permitted until 2026-05-20 13:50:18.0040408 +0000 UTC m=+38.089454074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls") pod "image-registry-66fd4ff844-qd7qh" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b") : secret "image-registry-tls" not found May 20 13:50:16.104765 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.104725 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:16.104926 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:16.104889 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 13:50:16.105003 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:16.104955 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls podName:96404fef-e012-444e-98dd-893bcb9fa535 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:18.104939164 +0000 UTC m=+38.190352445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls") pod "dns-default-t4gw4" (UID: "96404fef-e012-444e-98dd-893bcb9fa535") : secret "dns-default-metrics-tls" not found May 20 13:50:16.124644 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.124611 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm"] May 20 13:50:16.130596 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.130564 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565"] May 20 13:50:16.134210 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.134182 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5"] May 20 13:50:16.177527 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:16.177485 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd6fc199_a5bb_40b6_b61f_b1c8b648ebab.slice/crio-66c5ff4bc76e8ec44424f635013ccfba262c13cfc62403b66d23f60d15c261bb WatchSource:0}: Error finding container 66c5ff4bc76e8ec44424f635013ccfba262c13cfc62403b66d23f60d15c261bb: Status 404 returned error can't find the container with id 66c5ff4bc76e8ec44424f635013ccfba262c13cfc62403b66d23f60d15c261bb May 20 13:50:16.177828 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:16.177806 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02b31d4_23b0_4e4e_a9ac_5dfeb5942fc6.slice/crio-133048a452b332dead6de5553fe00278552b301905ffe1fd64a6f9de830f0ae3 WatchSource:0}: Error finding container 133048a452b332dead6de5553fe00278552b301905ffe1fd64a6f9de830f0ae3: Status 404 returned error can't find the container with id 133048a452b332dead6de5553fe00278552b301905ffe1fd64a6f9de830f0ae3 May 20 13:50:16.178544 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:16.178430 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod035e940a_2d43_4712_987c_89caa8e59db1.slice/crio-bd1d6e94a25a894d7edff44495b1ac13f7af73171a9a068b221abc6eae50c100 WatchSource:0}: Error finding container bd1d6e94a25a894d7edff44495b1ac13f7af73171a9a068b221abc6eae50c100: Status 404 returned error can't find the container with id bd1d6e94a25a894d7edff44495b1ac13f7af73171a9a068b221abc6eae50c100 May 20 13:50:16.719087 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.719051 2552 generic.go:358] "Generic (PLEG): container finished" podID="0968bab8-1e4f-4bee-974b-7245aac58209" containerID="f3989d6247aea72616b0ac446beb80c1a1b051a00d0f62b1ceaf39ec6cd4a8f0" exitCode=0 May 20 13:50:16.719352 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.719142 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerDied","Data":"f3989d6247aea72616b0ac446beb80c1a1b051a00d0f62b1ceaf39ec6cd4a8f0"} May 20 13:50:16.720249 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.720224 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" event={"ID":"035e940a-2d43-4712-987c-89caa8e59db1","Type":"ContainerStarted","Data":"bd1d6e94a25a894d7edff44495b1ac13f7af73171a9a068b221abc6eae50c100"} May 20 13:50:16.721254 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.721231 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" event={"ID":"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab","Type":"ContainerStarted","Data":"66c5ff4bc76e8ec44424f635013ccfba262c13cfc62403b66d23f60d15c261bb"} May 20 13:50:16.722124 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:16.722095 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" event={"ID":"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6","Type":"ContainerStarted","Data":"133048a452b332dead6de5553fe00278552b301905ffe1fd64a6f9de830f0ae3"} May 20 13:50:17.739626 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:17.738483 2552 generic.go:358] "Generic (PLEG): container finished" podID="0968bab8-1e4f-4bee-974b-7245aac58209" containerID="9f7922e1706835d6a945989451d772199d7c93247319a7181d37c0593dd0a5d9" exitCode=0 May 20 13:50:17.739626 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:17.738569 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerDied","Data":"9f7922e1706835d6a945989451d772199d7c93247319a7181d37c0593dd0a5d9"} May 20 13:50:18.025719 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:18.025623 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:18.025885 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:18.025719 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:18.025885 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:18.025869 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 13:50:18.026001 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:18.025936 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert podName:0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:22.025913816 +0000 UTC m=+42.111327095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert") pod "ingress-canary-7v6cc" (UID: "0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0") : secret "canary-serving-cert" not found May 20 13:50:18.026389 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:18.026366 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 13:50:18.026389 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:18.026389 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fd4ff844-qd7qh: secret "image-registry-tls" not found May 20 13:50:18.026744 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:18.026438 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls podName:2ec236ec-a948-4d65-b0a4-da8f4dec0f4b nodeName:}" failed. No retries permitted until 2026-05-20 13:50:22.026422081 +0000 UTC m=+42.111835355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls") pod "image-registry-66fd4ff844-qd7qh" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b") : secret "image-registry-tls" not found May 20 13:50:18.127733 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:18.127043 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:18.127733 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:18.127292 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 13:50:18.127733 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:18.127371 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls podName:96404fef-e012-444e-98dd-893bcb9fa535 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:22.127351778 +0000 UTC m=+42.212765060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls") pod "dns-default-t4gw4" (UID: "96404fef-e012-444e-98dd-893bcb9fa535") : secret "dns-default-metrics-tls" not found May 20 13:50:18.745737 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:18.745692 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" event={"ID":"0968bab8-1e4f-4bee-974b-7245aac58209","Type":"ContainerStarted","Data":"fee8a6bc3bb627873d5427e3ad09004c53781143093cbe70a46217aa35ad53c9"} May 20 13:50:18.770429 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:18.770285 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4n8gm" podStartSLOduration=5.679816944 podStartE2EDuration="38.770263439s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:49:43.129022364 +0000 UTC m=+3.214435625" lastFinishedPulling="2026-05-20 13:50:16.219468846 +0000 UTC m=+36.304882120" observedRunningTime="2026-05-20 13:50:18.770010581 +0000 UTC m=+38.855423864" watchObservedRunningTime="2026-05-20 13:50:18.770263439 +0000 UTC m=+38.855676723" May 20 13:50:22.069534 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:22.069492 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:22.070041 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:22.069584 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:22.070041 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:22.069657 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 13:50:22.070041 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:22.069675 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fd4ff844-qd7qh: secret "image-registry-tls" not found May 20 13:50:22.070041 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:22.069717 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 13:50:22.070041 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:22.069748 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls podName:2ec236ec-a948-4d65-b0a4-da8f4dec0f4b nodeName:}" failed. No retries permitted until 2026-05-20 13:50:30.069724207 +0000 UTC m=+50.155137489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls") pod "image-registry-66fd4ff844-qd7qh" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b") : secret "image-registry-tls" not found May 20 13:50:22.070041 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:22.069767 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert podName:0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:30.069758258 +0000 UTC m=+50.155171519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert") pod "ingress-canary-7v6cc" (UID: "0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0") : secret "canary-serving-cert" not found May 20 13:50:22.170231 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:22.170187 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:22.170450 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:22.170333 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 13:50:22.170450 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:22.170417 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls podName:96404fef-e012-444e-98dd-893bcb9fa535 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:30.170392728 +0000 UTC m=+50.255806008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls") pod "dns-default-t4gw4" (UID: "96404fef-e012-444e-98dd-893bcb9fa535") : secret "dns-default-metrics-tls" not found May 20 13:50:23.080298 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:23.080252 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:23.084866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:23.084832 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/700a8d0c-f2b6-422e-a756-ae3c07ab68f5-original-pull-secret\") pod \"global-pull-secret-syncer-nx5w4\" (UID: \"700a8d0c-f2b6-422e-a756-ae3c07ab68f5\") " pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:23.253358 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:23.253303 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nx5w4" May 20 13:50:24.152441 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.152410 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nx5w4"] May 20 13:50:24.155651 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:24.155619 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700a8d0c_f2b6_422e_a756_ae3c07ab68f5.slice/crio-9b21e167015405989ab0308244fe1a8bb0cf3b71ee093c2a9eaf94582483eccf WatchSource:0}: Error finding container 9b21e167015405989ab0308244fe1a8bb0cf3b71ee093c2a9eaf94582483eccf: Status 404 returned error can't find the container with id 9b21e167015405989ab0308244fe1a8bb0cf3b71ee093c2a9eaf94582483eccf May 20 13:50:24.759599 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.759558 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" event={"ID":"e02b31d4-23b0-4e4e-a9ac-5dfeb5942fc6","Type":"ContainerStarted","Data":"cc8511909011448a6cfc6772eb816c1ec907479a178eff0fa421e8fb46a56629"} May 20 13:50:24.760020 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.759999 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:24.761567 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.761438 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nx5w4" event={"ID":"700a8d0c-f2b6-422e-a756-ae3c07ab68f5","Type":"ContainerStarted","Data":"9b21e167015405989ab0308244fe1a8bb0cf3b71ee093c2a9eaf94582483eccf"} May 20 13:50:24.761714 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.761696 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" May 20 13:50:24.763026 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.762992 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" event={"ID":"035e940a-2d43-4712-987c-89caa8e59db1","Type":"ContainerStarted","Data":"846aa53e23dbc349c3b3035debf20eaa0a7a2537a97aacbdb971f2e51c80318a"} May 20 13:50:24.764743 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.764711 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" event={"ID":"dd6fc199-a5bb-40b6-b61f-b1c8b648ebab","Type":"ContainerStarted","Data":"fc47e3aa21747b139d26b3068f5d3a0ee92cfa58d645376f07d4011cb66b4568"} May 20 13:50:24.780167 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.780100 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bcbddb755-rh565" podStartSLOduration=12.969719143 podStartE2EDuration="20.780080538s" podCreationTimestamp="2026-05-20 13:50:04 +0000 UTC" firstStartedPulling="2026-05-20 13:50:16.194871884 +0000 UTC m=+36.280285150" lastFinishedPulling="2026-05-20 13:50:24.005233274 +0000 UTC m=+44.090646545" observedRunningTime="2026-05-20 13:50:24.779524295 +0000 UTC m=+44.864937601" watchObservedRunningTime="2026-05-20 13:50:24.780080538 +0000 UTC m=+44.865493823" May 20 13:50:24.816550 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:24.816495 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87d78d4b8-lclxm" podStartSLOduration=13.006259066 podStartE2EDuration="20.816475192s" podCreationTimestamp="2026-05-20 13:50:04 +0000 UTC" firstStartedPulling="2026-05-20 13:50:16.195012416 +0000 UTC m=+36.280425681" lastFinishedPulling="2026-05-20 13:50:24.005228531 +0000 UTC m=+44.090641807" observedRunningTime="2026-05-20 13:50:24.815329923 +0000 UTC m=+44.900743196" watchObservedRunningTime="2026-05-20 13:50:24.816475192 +0000 UTC m=+44.901888475" May 20 13:50:28.775356 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:28.775303 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nx5w4" event={"ID":"700a8d0c-f2b6-422e-a756-ae3c07ab68f5","Type":"ContainerStarted","Data":"f579f59f5cdfd78ea9318171b5add4eae88d742cc087a96decfd9c8bb6f14201"} May 20 13:50:28.777171 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:28.777140 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" event={"ID":"035e940a-2d43-4712-987c-89caa8e59db1","Type":"ContainerStarted","Data":"745758fc5f01bb400d3e91aae4d85a2b644b1044163444fc963e0e8959c083ba"} May 20 13:50:28.777337 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:28.777178 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" event={"ID":"035e940a-2d43-4712-987c-89caa8e59db1","Type":"ContainerStarted","Data":"fcc214ae9acb6b7a61ad19686386f3f543afe818a6de54fb91c95ae805458f7c"} May 20 13:50:28.792431 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:28.792383 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nx5w4" podStartSLOduration=33.691521614 podStartE2EDuration="37.792366348s" podCreationTimestamp="2026-05-20 13:49:51 +0000 UTC" firstStartedPulling="2026-05-20 13:50:24.157675819 +0000 UTC m=+44.243089105" lastFinishedPulling="2026-05-20 13:50:28.258520571 +0000 UTC m=+48.343933839" observedRunningTime="2026-05-20 13:50:28.792298776 +0000 UTC m=+48.877712059" watchObservedRunningTime="2026-05-20 13:50:28.792366348 +0000 UTC m=+48.877779609" May 20 13:50:28.814840 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:28.814768 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" podStartSLOduration=13.107453625 podStartE2EDuration="24.814747971s" podCreationTimestamp="2026-05-20 13:50:04 +0000 UTC" firstStartedPulling="2026-05-20 13:50:16.194876123 +0000 UTC m=+36.280289387" lastFinishedPulling="2026-05-20 13:50:27.902170457 +0000 UTC m=+47.987583733" observedRunningTime="2026-05-20 13:50:28.813837865 +0000 UTC m=+48.899251144" watchObservedRunningTime="2026-05-20 13:50:28.814747971 +0000 UTC m=+48.900161257" May 20 13:50:30.136899 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:30.136843 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:30.136899 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:30.136916 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:30.137438 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:30.136999 2552 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 13:50:30.137438 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:30.137004 2552 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 13:50:30.137438 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:30.137024 2552 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66fd4ff844-qd7qh: secret "image-registry-tls" not found May 20 13:50:30.137438 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:30.137057 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert podName:0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:46.137042865 +0000 UTC m=+66.222456126 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert") pod "ingress-canary-7v6cc" (UID: "0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0") : secret "canary-serving-cert" not found May 20 13:50:30.137438 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:30.137071 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls podName:2ec236ec-a948-4d65-b0a4-da8f4dec0f4b nodeName:}" failed. No retries permitted until 2026-05-20 13:50:46.137064611 +0000 UTC m=+66.222477872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls") pod "image-registry-66fd4ff844-qd7qh" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b") : secret "image-registry-tls" not found May 20 13:50:30.237527 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:30.237479 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:30.237725 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:30.237604 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 13:50:30.237725 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:30.237658 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls podName:96404fef-e012-444e-98dd-893bcb9fa535 nodeName:}" failed. No retries permitted until 2026-05-20 13:50:46.23764317 +0000 UTC m=+66.323056431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls") pod "dns-default-t4gw4" (UID: "96404fef-e012-444e-98dd-893bcb9fa535") : secret "dns-default-metrics-tls" not found May 20 13:50:35.695773 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:35.695745 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ttn2r_ac4906fa-5821-4932-a5fe-965573d8f96e/dns-node-resolver/0.log" May 20 13:50:36.494912 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:36.494884 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dzcdv_2683c424-59e2-4ac8-85c6-adb67def8d4f/node-ca/0.log" May 20 13:50:40.716264 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:40.716233 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h5w7v" May 20 13:50:46.161378 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.161331 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:46.161782 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.161406 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:46.163857 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.163825 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"image-registry-66fd4ff844-qd7qh\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:46.163975 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.163833 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0-cert\") pod \"ingress-canary-7v6cc\" (UID: \"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0\") " pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:46.262229 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.262183 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:50:46.262453 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.262240 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:46.262453 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.262283 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:46.264583 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.264553 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96404fef-e012-444e-98dd-893bcb9fa535-metrics-tls\") pod \"dns-default-t4gw4\" (UID: \"96404fef-e012-444e-98dd-893bcb9fa535\") " pod="openshift-dns/dns-default-t4gw4" May 20 13:50:46.264791 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.264776 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 13:50:46.264881 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.264864 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 13:50:46.272938 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:46.272915 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 13:50:46.273058 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:50:46.272991 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs podName:36452282-6303-4873-8e65-3dbf6166bb05 nodeName:}" failed. No retries permitted until 2026-05-20 13:51:50.272974318 +0000 UTC m=+130.358387584 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs") pod "network-metrics-daemon-p2jmv" (UID: "36452282-6303-4873-8e65-3dbf6166bb05") : secret "metrics-daemon-secret" not found May 20 13:50:46.275083 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.275068 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 13:50:46.285502 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.285469 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpjqm\" (UniqueName: \"kubernetes.io/projected/250bd337-fccf-462c-a9f7-d6df8b909ac6-kube-api-access-wpjqm\") pod \"network-check-target-9dmw9\" (UID: \"250bd337-fccf-462c-a9f7-d6df8b909ac6\") " pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:46.341329 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.341276 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rh8zp\"" May 20 13:50:46.349279 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.349256 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:46.379614 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.379587 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lmnhj\"" May 20 13:50:46.387847 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.387804 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:46.400882 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.400858 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lgp7k\"" May 20 13:50:46.408385 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.408355 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7v6cc" May 20 13:50:46.470815 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.470747 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qrdp6\"" May 20 13:50:46.479096 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.479060 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t4gw4" May 20 13:50:46.493033 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.492947 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dmw9"] May 20 13:50:46.496043 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:46.496006 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250bd337_fccf_462c_a9f7_d6df8b909ac6.slice/crio-f48f7d9cafb6b772ebabb92df1872724214e2f28fda23c8f1c01751526d3b4ef WatchSource:0}: Error finding container f48f7d9cafb6b772ebabb92df1872724214e2f28fda23c8f1c01751526d3b4ef: Status 404 returned error can't find the container with id f48f7d9cafb6b772ebabb92df1872724214e2f28fda23c8f1c01751526d3b4ef May 20 13:50:46.548182 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.548146 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66fd4ff844-qd7qh"] May 20 13:50:46.553375 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:46.553340 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec236ec_a948_4d65_b0a4_da8f4dec0f4b.slice/crio-017cb6addbe98a64098d45a2b1492e7f7746e433231c4a6aaa21471761ae6be5 WatchSource:0}: Error finding container 017cb6addbe98a64098d45a2b1492e7f7746e433231c4a6aaa21471761ae6be5: Status 404 returned error can't find the container with id 017cb6addbe98a64098d45a2b1492e7f7746e433231c4a6aaa21471761ae6be5 May 20 13:50:46.566734 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.566702 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7v6cc"] May 20 13:50:46.570026 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:46.569996 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fec27ae_de4b_47f4_9cf1_0adbcd9d94c0.slice/crio-d5fe91ea0380980c91282e65e9cabfec70ab00abc661362e884327bd1f2f5e53 WatchSource:0}: Error finding container d5fe91ea0380980c91282e65e9cabfec70ab00abc661362e884327bd1f2f5e53: Status 404 returned error can't find the container with id d5fe91ea0380980c91282e65e9cabfec70ab00abc661362e884327bd1f2f5e53 May 20 13:50:46.625728 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.625694 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t4gw4"] May 20 13:50:46.628619 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:46.628591 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96404fef_e012_444e_98dd_893bcb9fa535.slice/crio-ada1dd1662337f7d40dd4fee7355394005ffd723165c4fb81863d0a952118c6a WatchSource:0}: Error finding container ada1dd1662337f7d40dd4fee7355394005ffd723165c4fb81863d0a952118c6a: Status 404 returned error can't find the container with id ada1dd1662337f7d40dd4fee7355394005ffd723165c4fb81863d0a952118c6a May 20 13:50:46.821229 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.821191 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dmw9" event={"ID":"250bd337-fccf-462c-a9f7-d6df8b909ac6","Type":"ContainerStarted","Data":"f48f7d9cafb6b772ebabb92df1872724214e2f28fda23c8f1c01751526d3b4ef"} May 20 13:50:46.822288 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.822259 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4gw4" event={"ID":"96404fef-e012-444e-98dd-893bcb9fa535","Type":"ContainerStarted","Data":"ada1dd1662337f7d40dd4fee7355394005ffd723165c4fb81863d0a952118c6a"} May 20 13:50:46.823398 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.823374 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7v6cc" event={"ID":"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0","Type":"ContainerStarted","Data":"d5fe91ea0380980c91282e65e9cabfec70ab00abc661362e884327bd1f2f5e53"} May 20 13:50:46.824709 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.824680 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" event={"ID":"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b","Type":"ContainerStarted","Data":"966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55"} May 20 13:50:46.824808 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.824713 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" event={"ID":"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b","Type":"ContainerStarted","Data":"017cb6addbe98a64098d45a2b1492e7f7746e433231c4a6aaa21471761ae6be5"} May 20 13:50:46.824865 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.824815 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:50:46.846332 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:46.846268 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" podStartSLOduration=66.846253968 podStartE2EDuration="1m6.846253968s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 13:50:46.845403111 +0000 UTC m=+66.930816388" watchObservedRunningTime="2026-05-20 13:50:46.846253968 +0000 UTC m=+66.931667250" May 20 13:50:50.837033 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.836994 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dmw9" event={"ID":"250bd337-fccf-462c-a9f7-d6df8b909ac6","Type":"ContainerStarted","Data":"83806db2938b0f826701f5b30d20526a3f6c95f1df663132b86c7a6f2c782323"} May 20 13:50:50.837501 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.837122 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:50:50.838662 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.838640 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4gw4" event={"ID":"96404fef-e012-444e-98dd-893bcb9fa535","Type":"ContainerStarted","Data":"5910a6002e58b696195f29efa4b376247c7f0573a04e6a592e2dfef0457d1d1d"} May 20 13:50:50.838755 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.838691 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4gw4" event={"ID":"96404fef-e012-444e-98dd-893bcb9fa535","Type":"ContainerStarted","Data":"8b475028814e93e52ec1bed1e8f02b7bd8b30714d4d8543f3abda815d415afce"} May 20 13:50:50.838807 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.838778 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t4gw4" May 20 13:50:50.839851 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.839834 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7v6cc" event={"ID":"0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0","Type":"ContainerStarted","Data":"f0eff39ab2b237ceda77db9a04828c124300b6968a2b086ce1027b4323290dfb"} May 20 13:50:50.854515 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.854467 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9dmw9" podStartSLOduration=67.296899105 podStartE2EDuration="1m10.854451524s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:50:46.498377583 +0000 UTC m=+66.583790858" lastFinishedPulling="2026-05-20 13:50:50.055930016 +0000 UTC m=+70.141343277" observedRunningTime="2026-05-20 13:50:50.85401922 +0000 UTC m=+70.939432498" watchObservedRunningTime="2026-05-20 13:50:50.854451524 +0000 UTC m=+70.939864806" May 20 13:50:50.871519 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.871475 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-t4gw4" podStartSLOduration=33.457715394 podStartE2EDuration="36.871459354s" podCreationTimestamp="2026-05-20 13:50:14 +0000 UTC" firstStartedPulling="2026-05-20 13:50:46.630526805 +0000 UTC m=+66.715940069" lastFinishedPulling="2026-05-20 13:50:50.044270753 +0000 UTC m=+70.129684029" observedRunningTime="2026-05-20 13:50:50.870967878 +0000 UTC m=+70.956381158" watchObservedRunningTime="2026-05-20 13:50:50.871459354 +0000 UTC m=+70.956872636" May 20 13:50:50.887451 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:50.887406 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7v6cc" podStartSLOduration=33.413000505 podStartE2EDuration="36.88739s" podCreationTimestamp="2026-05-20 13:50:14 +0000 UTC" firstStartedPulling="2026-05-20 13:50:46.572166922 +0000 UTC m=+66.657580183" lastFinishedPulling="2026-05-20 13:50:50.046556412 +0000 UTC m=+70.131969678" observedRunningTime="2026-05-20 13:50:50.887017304 +0000 UTC m=+70.972430588" watchObservedRunningTime="2026-05-20 13:50:50.88739 +0000 UTC m=+70.972803283" May 20 13:50:55.837867 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.837831 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dvkpc"] May 20 13:50:55.849342 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.849275 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:55.851592 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.851560 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dvkpc"] May 20 13:50:55.852435 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.852411 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 13:50:55.853490 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.853471 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 13:50:55.853596 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.853490 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x54bb\"" May 20 13:50:55.853596 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.853507 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 13:50:55.853596 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.853490 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 13:50:55.937445 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.937406 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5680705-ff28-4d53-9cac-cdcc12305084-crio-socket\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:55.937625 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.937483 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzzvl\" (UniqueName: \"kubernetes.io/projected/e5680705-ff28-4d53-9cac-cdcc12305084-kube-api-access-xzzvl\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:55.937625 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.937516 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5680705-ff28-4d53-9cac-cdcc12305084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:55.937625 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.937539 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5680705-ff28-4d53-9cac-cdcc12305084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:55.937625 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:55.937562 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5680705-ff28-4d53-9cac-cdcc12305084-data-volume\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.038710 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.038667 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzzvl\" (UniqueName: \"kubernetes.io/projected/e5680705-ff28-4d53-9cac-cdcc12305084-kube-api-access-xzzvl\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.038710 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.038713 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5680705-ff28-4d53-9cac-cdcc12305084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.038926 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.038905 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5680705-ff28-4d53-9cac-cdcc12305084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.038964 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.038948 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5680705-ff28-4d53-9cac-cdcc12305084-data-volume\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.039006 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.038996 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5680705-ff28-4d53-9cac-cdcc12305084-crio-socket\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.039133 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.039119 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e5680705-ff28-4d53-9cac-cdcc12305084-crio-socket\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.045741 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.045698 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e5680705-ff28-4d53-9cac-cdcc12305084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.046075 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.046055 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5680705-ff28-4d53-9cac-cdcc12305084-data-volume\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.050253 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.050233 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e5680705-ff28-4d53-9cac-cdcc12305084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.054611 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.054585 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzzvl\" (UniqueName: \"kubernetes.io/projected/e5680705-ff28-4d53-9cac-cdcc12305084-kube-api-access-xzzvl\") pod \"insights-runtime-extractor-dvkpc\" (UID: \"e5680705-ff28-4d53-9cac-cdcc12305084\") " pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.160281 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.160183 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dvkpc" May 20 13:50:56.290240 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.290210 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dvkpc"] May 20 13:50:56.294778 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:50:56.294748 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5680705_ff28_4d53_9cac_cdcc12305084.slice/crio-cba443481013e10392dad9300d58667b3006da8930d0a88efe64730dc1028209 WatchSource:0}: Error finding container cba443481013e10392dad9300d58667b3006da8930d0a88efe64730dc1028209: Status 404 returned error can't find the container with id cba443481013e10392dad9300d58667b3006da8930d0a88efe64730dc1028209 May 20 13:50:56.855966 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.855930 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvkpc" event={"ID":"e5680705-ff28-4d53-9cac-cdcc12305084","Type":"ContainerStarted","Data":"fdad802ba59fd640c6c9f893641e4dcced5264b9990a9838c43e95fdaaa8cc91"} May 20 13:50:56.855966 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:56.855969 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvkpc" event={"ID":"e5680705-ff28-4d53-9cac-cdcc12305084","Type":"ContainerStarted","Data":"cba443481013e10392dad9300d58667b3006da8930d0a88efe64730dc1028209"} May 20 13:50:57.860291 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:57.860197 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvkpc" event={"ID":"e5680705-ff28-4d53-9cac-cdcc12305084","Type":"ContainerStarted","Data":"1bcf0b995e666719282b7aaa5d59c13f0259026d32b64ce3ecabaf0ee8787a96"} May 20 13:50:59.866665 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:59.866629 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dvkpc" event={"ID":"e5680705-ff28-4d53-9cac-cdcc12305084","Type":"ContainerStarted","Data":"22b2fe9431bc5557a0adabbd1c1f4c8476a20f89b8dceb1dc2c30cd40b066c48"} May 20 13:50:59.884306 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:50:59.884242 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dvkpc" podStartSLOduration=1.851779303 podStartE2EDuration="4.884221325s" podCreationTimestamp="2026-05-20 13:50:55 +0000 UTC" firstStartedPulling="2026-05-20 13:50:56.403675845 +0000 UTC m=+76.489089110" lastFinishedPulling="2026-05-20 13:50:59.436117858 +0000 UTC m=+79.521531132" observedRunningTime="2026-05-20 13:50:59.884135654 +0000 UTC m=+79.969548941" watchObservedRunningTime="2026-05-20 13:50:59.884221325 +0000 UTC m=+79.969634608" May 20 13:51:00.844940 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:00.844899 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t4gw4" May 20 13:51:06.391833 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:06.391792 2552 patch_prober.go:28] interesting pod/image-registry-66fd4ff844-qd7qh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 13:51:06.392300 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:06.391848 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" podUID="2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 13:51:07.831970 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:07.831937 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:51:09.676053 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.676016 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xzldr"] May 20 13:51:09.680739 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.680715 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.684020 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.683993 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 13:51:09.684151 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.684024 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 13:51:09.684348 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.684306 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 13:51:09.684464 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.684432 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 13:51:09.684994 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.684975 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5wkpl\"" May 20 13:51:09.685168 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.685156 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 13:51:09.685217 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.685201 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 13:51:09.744847 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.744806 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-root\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745031 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.744853 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745031 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.744886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-wtmp\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745031 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.744924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-metrics-client-ca\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745031 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.744988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmdr9\" (UniqueName: \"kubernetes.io/projected/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-kube-api-access-nmdr9\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745031 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.745025 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-sys\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745196 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.745063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745196 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.745103 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-tls\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.745196 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.745126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-textfile\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846134 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846095 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmdr9\" (UniqueName: \"kubernetes.io/projected/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-kube-api-access-nmdr9\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846134 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846135 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-sys\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846168 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846189 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-tls\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846207 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-textfile\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846231 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-root\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846259 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846303 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-sys\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:51:09.846344 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846355 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-wtmp\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846357 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-root\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:51:09.846407 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-tls podName:f1b69a5d-9432-4baf-81dc-d3f189da0e7b nodeName:}" failed. No retries permitted until 2026-05-20 13:51:10.346389917 +0000 UTC m=+90.431803178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-tls") pod "node-exporter-xzldr" (UID: "f1b69a5d-9432-4baf-81dc-d3f189da0e7b") : secret "node-exporter-tls" not found May 20 13:51:09.846433 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846426 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-metrics-client-ca\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846924 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846502 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-wtmp\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846924 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846733 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-textfile\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846924 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846858 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.846924 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.846916 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-metrics-client-ca\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.848678 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.848659 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:09.855389 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:09.855358 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmdr9\" (UniqueName: \"kubernetes.io/projected/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-kube-api-access-nmdr9\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:10.350130 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:10.350085 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-tls\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:10.352453 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:10.352430 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f1b69a5d-9432-4baf-81dc-d3f189da0e7b-node-exporter-tls\") pod \"node-exporter-xzldr\" (UID: \"f1b69a5d-9432-4baf-81dc-d3f189da0e7b\") " pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:10.589967 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:10.589929 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xzldr" May 20 13:51:10.599136 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:51:10.599094 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b69a5d_9432_4baf_81dc_d3f189da0e7b.slice/crio-2314bf2508b4002b5d79426660f330bc82c78e90e18918352019273785ecfb05 WatchSource:0}: Error finding container 2314bf2508b4002b5d79426660f330bc82c78e90e18918352019273785ecfb05: Status 404 returned error can't find the container with id 2314bf2508b4002b5d79426660f330bc82c78e90e18918352019273785ecfb05 May 20 13:51:10.895078 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:10.894986 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xzldr" event={"ID":"f1b69a5d-9432-4baf-81dc-d3f189da0e7b","Type":"ContainerStarted","Data":"2314bf2508b4002b5d79426660f330bc82c78e90e18918352019273785ecfb05"} May 20 13:51:11.899357 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:11.899240 2552 generic.go:358] "Generic (PLEG): container finished" podID="f1b69a5d-9432-4baf-81dc-d3f189da0e7b" containerID="4244c4197b251277722730972fadc73d5c38fc133b8f128bbdb361ffff7ba96d" exitCode=0 May 20 13:51:11.899357 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:11.899286 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xzldr" event={"ID":"f1b69a5d-9432-4baf-81dc-d3f189da0e7b","Type":"ContainerDied","Data":"4244c4197b251277722730972fadc73d5c38fc133b8f128bbdb361ffff7ba96d"} May 20 13:51:12.903662 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:12.903624 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xzldr" event={"ID":"f1b69a5d-9432-4baf-81dc-d3f189da0e7b","Type":"ContainerStarted","Data":"929459cb39e63c2af45a6398b08bfe248af6edf9dfd47ab9512c940df8884502"} May 20 13:51:12.903662 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:12.903662 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xzldr" event={"ID":"f1b69a5d-9432-4baf-81dc-d3f189da0e7b","Type":"ContainerStarted","Data":"c90f89d34730624bdd8096774aa45532aea07611822fea5b0a02957d4e90650a"} May 20 13:51:12.928815 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:12.928764 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xzldr" podStartSLOduration=3.051003885 podStartE2EDuration="3.928749297s" podCreationTimestamp="2026-05-20 13:51:09 +0000 UTC" firstStartedPulling="2026-05-20 13:51:10.600968402 +0000 UTC m=+90.686381665" lastFinishedPulling="2026-05-20 13:51:11.478713814 +0000 UTC m=+91.564127077" observedRunningTime="2026-05-20 13:51:12.927587051 +0000 UTC m=+93.013000348" watchObservedRunningTime="2026-05-20 13:51:12.928749297 +0000 UTC m=+93.014162581" May 20 13:51:19.327687 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:19.327649 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66fd4ff844-qd7qh"] May 20 13:51:21.844989 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:21.844958 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9dmw9" May 20 13:51:44.347002 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.346932 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" podUID="2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" containerName="registry" containerID="cri-o://966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55" gracePeriod=30 May 20 13:51:44.599953 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.599881 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:51:44.611428 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611400 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-bound-sa-token\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.611587 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611436 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-ca-trust-extracted\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.611587 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611471 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-installation-pull-secrets\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.611587 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611495 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.611587 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611514 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndt97\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-kube-api-access-ndt97\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.611587 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611542 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-image-registry-private-configuration\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.611839 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611605 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-certificates\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.611839 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.611640 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-trusted-ca\") pod \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\" (UID: \"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b\") " May 20 13:51:44.612689 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.612573 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 13:51:44.613100 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.613075 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 13:51:44.614164 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.614122 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 13:51:44.614265 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.614244 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 13:51:44.614405 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.614378 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 13:51:44.614541 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.614515 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-kube-api-access-ndt97" (OuterVolumeSpecName: "kube-api-access-ndt97") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "kube-api-access-ndt97". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 13:51:44.614642 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.614600 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 13:51:44.620854 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.620826 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" (UID: "2ec236ec-a948-4d65-b0a4-da8f4dec0f4b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 13:51:44.712916 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712867 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-certificates\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.712916 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712901 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-trusted-ca\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.712916 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712911 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-bound-sa-token\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.712916 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712920 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-ca-trust-extracted\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.712916 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712929 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-installation-pull-secrets\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.713360 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712938 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-registry-tls\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.713360 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712947 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndt97\" (UniqueName: \"kubernetes.io/projected/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-kube-api-access-ndt97\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.713360 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.712956 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b-image-registry-private-configuration\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:51:44.989877 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.989839 2552 generic.go:358] "Generic (PLEG): container finished" podID="2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" containerID="966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55" exitCode=0 May 20 13:51:44.990059 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.989887 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" event={"ID":"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b","Type":"ContainerDied","Data":"966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55"} May 20 13:51:44.990059 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.989909 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" event={"ID":"2ec236ec-a948-4d65-b0a4-da8f4dec0f4b","Type":"ContainerDied","Data":"017cb6addbe98a64098d45a2b1492e7f7746e433231c4a6aaa21471761ae6be5"} May 20 13:51:44.990059 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.989924 2552 scope.go:117] "RemoveContainer" containerID="966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55" May 20 13:51:44.990059 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.989925 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66fd4ff844-qd7qh" May 20 13:51:44.999481 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.999460 2552 scope.go:117] "RemoveContainer" containerID="966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55" May 20 13:51:44.999770 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:51:44.999749 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55\": container with ID starting with 966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55 not found: ID does not exist" containerID="966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55" May 20 13:51:44.999820 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:44.999778 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55"} err="failed to get container status \"966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55\": rpc error: code = NotFound desc = could not find container \"966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55\": container with ID starting with 966282a046bd4442af65bc44659f7234443f9aa3c812bbad2f712c59e427bf55 not found: ID does not exist" May 20 13:51:45.013068 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:45.013036 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66fd4ff844-qd7qh"] May 20 13:51:45.017244 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:45.017218 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66fd4ff844-qd7qh"] May 20 13:51:46.526629 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:46.526591 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" path="/var/lib/kubelet/pods/2ec236ec-a948-4d65-b0a4-da8f4dec0f4b/volumes" May 20 13:51:50.354750 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:50.354706 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:51:50.357072 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:50.357047 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36452282-6303-4873-8e65-3dbf6166bb05-metrics-certs\") pod \"network-metrics-daemon-p2jmv\" (UID: \"36452282-6303-4873-8e65-3dbf6166bb05\") " pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:51:50.549631 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:50.549596 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6nbf\"" May 20 13:51:50.557909 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:50.557879 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p2jmv" May 20 13:51:50.683666 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:50.683644 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p2jmv"] May 20 13:51:50.686104 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:51:50.686070 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36452282_6303_4873_8e65_3dbf6166bb05.slice/crio-eca85087563d8d2478a02aabff29eda5fcb8277e2e9e0bf8b31c12ddbbe418fe WatchSource:0}: Error finding container eca85087563d8d2478a02aabff29eda5fcb8277e2e9e0bf8b31c12ddbbe418fe: Status 404 returned error can't find the container with id eca85087563d8d2478a02aabff29eda5fcb8277e2e9e0bf8b31c12ddbbe418fe May 20 13:51:51.005146 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:51.005103 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2jmv" event={"ID":"36452282-6303-4873-8e65-3dbf6166bb05","Type":"ContainerStarted","Data":"eca85087563d8d2478a02aabff29eda5fcb8277e2e9e0bf8b31c12ddbbe418fe"} May 20 13:51:52.009605 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:52.009563 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2jmv" event={"ID":"36452282-6303-4873-8e65-3dbf6166bb05","Type":"ContainerStarted","Data":"6116cd14f7579157faf91da1577577626e47b973a9206d29c89fa5561efcf618"} May 20 13:51:53.013367 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:53.013323 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p2jmv" event={"ID":"36452282-6303-4873-8e65-3dbf6166bb05","Type":"ContainerStarted","Data":"a2c0965794bd55a8586a6331e125635f581b3c5892228393d9d5e28fae62c3e2"} May 20 13:51:53.032702 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:53.032645 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p2jmv" podStartSLOduration=131.873364503 podStartE2EDuration="2m13.032627054s" podCreationTimestamp="2026-05-20 13:49:40 +0000 UTC" firstStartedPulling="2026-05-20 13:51:50.687863516 +0000 UTC m=+130.773276776" lastFinishedPulling="2026-05-20 13:51:51.847126055 +0000 UTC m=+131.932539327" observedRunningTime="2026-05-20 13:51:53.03116256 +0000 UTC m=+133.116575843" watchObservedRunningTime="2026-05-20 13:51:53.032627054 +0000 UTC m=+133.118040336" May 20 13:51:53.881217 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:53.881184 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xzldr_f1b69a5d-9432-4baf-81dc-d3f189da0e7b/init-textfile/0.log" May 20 13:51:54.082939 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:54.082905 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xzldr_f1b69a5d-9432-4baf-81dc-d3f189da0e7b/node-exporter/0.log" May 20 13:51:54.281583 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:51:54.281549 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xzldr_f1b69a5d-9432-4baf-81dc-d3f189da0e7b/kube-rbac-proxy/0.log" May 20 13:52:04.586163 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:04.586118 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" podUID="035e940a-2d43-4712-987c-89caa8e59db1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 20 13:52:14.586639 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:14.586596 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" podUID="035e940a-2d43-4712-987c-89caa8e59db1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 20 13:52:24.586902 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:24.586857 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" podUID="035e940a-2d43-4712-987c-89caa8e59db1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 20 13:52:24.587385 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:24.586938 2552 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" May 20 13:52:24.587438 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:24.587419 2552 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"745758fc5f01bb400d3e91aae4d85a2b644b1044163444fc963e0e8959c083ba"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 20 13:52:24.587478 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:24.587458 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" podUID="035e940a-2d43-4712-987c-89caa8e59db1" containerName="service-proxy" containerID="cri-o://745758fc5f01bb400d3e91aae4d85a2b644b1044163444fc963e0e8959c083ba" gracePeriod=30 May 20 13:52:25.099581 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:25.099548 2552 generic.go:358] "Generic (PLEG): container finished" podID="035e940a-2d43-4712-987c-89caa8e59db1" containerID="745758fc5f01bb400d3e91aae4d85a2b644b1044163444fc963e0e8959c083ba" exitCode=2 May 20 13:52:25.099764 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:25.099619 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" event={"ID":"035e940a-2d43-4712-987c-89caa8e59db1","Type":"ContainerDied","Data":"745758fc5f01bb400d3e91aae4d85a2b644b1044163444fc963e0e8959c083ba"} May 20 13:52:25.099764 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:52:25.099659 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84d49c476c-wfng5" event={"ID":"035e940a-2d43-4712-987c-89caa8e59db1","Type":"ContainerStarted","Data":"8a27e4c546ac23f3719b993471f9f573a8007f2407a35a5adfc359f0881d12db"} May 20 13:53:26.287983 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.287939 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf"] May 20 13:53:26.288478 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.288183 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" containerName="registry" May 20 13:53:26.288478 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.288195 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" containerName="registry" May 20 13:53:26.288478 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.288255 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="2ec236ec-a948-4d65-b0a4-da8f4dec0f4b" containerName="registry" May 20 13:53:26.291260 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.291241 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.294029 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.294003 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" May 20 13:53:26.295066 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.295042 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" May 20 13:53:26.295066 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.295057 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qkzsx\"" May 20 13:53:26.301234 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.301203 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf"] May 20 13:53:26.343539 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.343501 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f8vr\" (UniqueName: \"kubernetes.io/projected/0e587b8f-37d4-41f8-8e4f-d2b61a536738-kube-api-access-6f8vr\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.343719 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.343558 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.343719 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.343591 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.444629 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.444574 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.444826 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.444700 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6f8vr\" (UniqueName: \"kubernetes.io/projected/0e587b8f-37d4-41f8-8e4f-d2b61a536738-kube-api-access-6f8vr\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.444826 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.444751 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.445043 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.445020 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-util\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.445107 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.445057 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-bundle\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.453832 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.453797 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f8vr\" (UniqueName: \"kubernetes.io/projected/0e587b8f-37d4-41f8-8e4f-d2b61a536738-kube-api-access-6f8vr\") pod \"59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.600890 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.600799 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:26.728606 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:26.728568 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf"] May 20 13:53:26.731876 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:53:26.731847 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e587b8f_37d4_41f8_8e4f_d2b61a536738.slice/crio-50f4e6534648c54c294d5932871ab396b69ae96d5fae6e912b1050dfcd43c225 WatchSource:0}: Error finding container 50f4e6534648c54c294d5932871ab396b69ae96d5fae6e912b1050dfcd43c225: Status 404 returned error can't find the container with id 50f4e6534648c54c294d5932871ab396b69ae96d5fae6e912b1050dfcd43c225 May 20 13:53:27.265756 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:27.265710 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" event={"ID":"0e587b8f-37d4-41f8-8e4f-d2b61a536738","Type":"ContainerStarted","Data":"50f4e6534648c54c294d5932871ab396b69ae96d5fae6e912b1050dfcd43c225"} May 20 13:53:33.285973 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:33.285929 2552 generic.go:358] "Generic (PLEG): container finished" podID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerID="2f32fef794915958e808cc954e80ae26a171e933af87886ed7cd903fde03f4e0" exitCode=0 May 20 13:53:33.286376 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:33.286021 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" event={"ID":"0e587b8f-37d4-41f8-8e4f-d2b61a536738","Type":"ContainerDied","Data":"2f32fef794915958e808cc954e80ae26a171e933af87886ed7cd903fde03f4e0"} May 20 13:53:36.295234 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:36.295141 2552 generic.go:358] "Generic (PLEG): container finished" podID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerID="0ed39a611b8cbce004d171748b67d2257cffd0abf36bf3c44acda372219562ee" exitCode=0 May 20 13:53:36.295608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:36.295234 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" event={"ID":"0e587b8f-37d4-41f8-8e4f-d2b61a536738","Type":"ContainerDied","Data":"0ed39a611b8cbce004d171748b67d2257cffd0abf36bf3c44acda372219562ee"} May 20 13:53:43.316388 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:43.316349 2552 generic.go:358] "Generic (PLEG): container finished" podID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerID="0bcabe68bb60c93b734fa35cd17475c2e1717569d50f5132212fc86e708bce09" exitCode=0 May 20 13:53:43.316767 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:43.316436 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" event={"ID":"0e587b8f-37d4-41f8-8e4f-d2b61a536738","Type":"ContainerDied","Data":"0bcabe68bb60c93b734fa35cd17475c2e1717569d50f5132212fc86e708bce09"} May 20 13:53:44.440408 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.440375 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:44.603021 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.602927 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-bundle\") pod \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " May 20 13:53:44.603021 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.602986 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-util\") pod \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " May 20 13:53:44.603219 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.603036 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f8vr\" (UniqueName: \"kubernetes.io/projected/0e587b8f-37d4-41f8-8e4f-d2b61a536738-kube-api-access-6f8vr\") pod \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\" (UID: \"0e587b8f-37d4-41f8-8e4f-d2b61a536738\") " May 20 13:53:44.603682 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.603655 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-bundle" (OuterVolumeSpecName: "bundle") pod "0e587b8f-37d4-41f8-8e4f-d2b61a536738" (UID: "0e587b8f-37d4-41f8-8e4f-d2b61a536738"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 13:53:44.605356 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.605325 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e587b8f-37d4-41f8-8e4f-d2b61a536738-kube-api-access-6f8vr" (OuterVolumeSpecName: "kube-api-access-6f8vr") pod "0e587b8f-37d4-41f8-8e4f-d2b61a536738" (UID: "0e587b8f-37d4-41f8-8e4f-d2b61a536738"). InnerVolumeSpecName "kube-api-access-6f8vr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 13:53:44.607224 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.607196 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-util" (OuterVolumeSpecName: "util") pod "0e587b8f-37d4-41f8-8e4f-d2b61a536738" (UID: "0e587b8f-37d4-41f8-8e4f-d2b61a536738"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 13:53:44.703975 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.703924 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f8vr\" (UniqueName: \"kubernetes.io/projected/0e587b8f-37d4-41f8-8e4f-d2b61a536738-kube-api-access-6f8vr\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:53:44.703975 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.703972 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-bundle\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:53:44.703975 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:44.703984 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e587b8f-37d4-41f8-8e4f-d2b61a536738-util\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:53:45.323899 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:45.323857 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" event={"ID":"0e587b8f-37d4-41f8-8e4f-d2b61a536738","Type":"ContainerDied","Data":"50f4e6534648c54c294d5932871ab396b69ae96d5fae6e912b1050dfcd43c225"} May 20 13:53:45.323899 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:45.323895 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50f4e6534648c54c294d5932871ab396b69ae96d5fae6e912b1050dfcd43c225" May 20 13:53:45.324173 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:45.323916 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/59039e319e11338a40c6b6f1054d265f40bb50ceac6068d5c59955d29c4ffhf" May 20 13:53:52.949044 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949000 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-xtx8b"] May 20 13:53:52.949549 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949235 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerName="extract" May 20 13:53:52.949549 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949245 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerName="extract" May 20 13:53:52.949549 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949265 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerName="util" May 20 13:53:52.949549 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949270 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerName="util" May 20 13:53:52.949549 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949278 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerName="pull" May 20 13:53:52.949549 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949283 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerName="pull" May 20 13:53:52.949549 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:52.949336 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e587b8f-37d4-41f8-8e4f-d2b61a536738" containerName="extract" May 20 13:53:53.003667 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.003626 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-xtx8b"] May 20 13:53:53.003845 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.003752 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.006637 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.006610 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" May 20 13:53:53.006779 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.006636 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" May 20 13:53:53.006779 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.006676 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-2nvxj\"" May 20 13:53:53.006779 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.006610 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" May 20 13:53:53.007627 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.007599 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" May 20 13:53:53.007748 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.007675 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" May 20 13:53:53.167905 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.167871 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c1f1cf1b-c3cc-4db0-8908-ecec964df730-cabundle0\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.168082 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.167917 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.168082 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.167951 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnpwt\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-kube-api-access-qnpwt\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.253060 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.253026 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx"] May 20 13:53:53.269446 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.269403 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c1f1cf1b-c3cc-4db0-8908-ecec964df730-cabundle0\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.269605 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.269461 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.269605 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.269499 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnpwt\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-kube-api-access-qnpwt\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.269678 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.269628 2552 projected.go:264] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found May 20 13:53:53.269678 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.269650 2552 secret.go:281] references non-existent secret key: ca.crt May 20 13:53:53.269678 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.269657 2552 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt May 20 13:53:53.269678 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.269669 2552 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-xtx8b: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] May 20 13:53:53.269797 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.269733 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates podName:c1f1cf1b-c3cc-4db0-8908-ecec964df730 nodeName:}" failed. No retries permitted until 2026-05-20 13:53:53.769717155 +0000 UTC m=+253.855130426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates") pod "keda-operator-ffbb595cb-xtx8b" (UID: "c1f1cf1b-c3cc-4db0-8908-ecec964df730") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] May 20 13:53:53.270070 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.270052 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/c1f1cf1b-c3cc-4db0-8908-ecec964df730-cabundle0\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.274418 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.274398 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx"] May 20 13:53:53.274511 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.274501 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.277185 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.277163 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" May 20 13:53:53.284630 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.282237 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnpwt\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-kube-api-access-qnpwt\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.370126 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.370074 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.370126 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.370126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.370409 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.370156 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xccv\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-kube-api-access-6xccv\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.471178 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.471139 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.471178 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.471180 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.471435 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.471202 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xccv\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-kube-api-access-6xccv\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.471435 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.471300 2552 secret.go:281] references non-existent secret key: tls.crt May 20 13:53:53.471435 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.471344 2552 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt May 20 13:53:53.471435 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.471366 2552 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx: references non-existent secret key: tls.crt May 20 13:53:53.471435 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.471428 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates podName:0f67e6c4-e4be-4136-84ff-cc1a3bd16711 nodeName:}" failed. No retries permitted until 2026-05-20 13:53:53.971412896 +0000 UTC m=+254.056826157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates") pod "keda-metrics-apiserver-7c9f485588-cf5rx" (UID: "0f67e6c4-e4be-4136-84ff-cc1a3bd16711") : references non-existent secret key: tls.crt May 20 13:53:53.471701 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.471535 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-temp-vol\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.499467 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.499433 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xccv\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-kube-api-access-6xccv\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.773023 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.772982 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:53.773215 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.773127 2552 secret.go:281] references non-existent secret key: ca.crt May 20 13:53:53.773215 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.773151 2552 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt May 20 13:53:53.773215 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.773162 2552 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-xtx8b: references non-existent secret key: ca.crt May 20 13:53:53.773215 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.773212 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates podName:c1f1cf1b-c3cc-4db0-8908-ecec964df730 nodeName:}" failed. No retries permitted until 2026-05-20 13:53:54.773198369 +0000 UTC m=+254.858611629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates") pod "keda-operator-ffbb595cb-xtx8b" (UID: "c1f1cf1b-c3cc-4db0-8908-ecec964df730") : references non-existent secret key: ca.crt May 20 13:53:53.974494 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:53.974457 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:53.974907 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.974602 2552 secret.go:281] references non-existent secret key: tls.crt May 20 13:53:53.974907 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.974620 2552 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt May 20 13:53:53.974907 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.974638 2552 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx: references non-existent secret key: tls.crt May 20 13:53:53.974907 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:53.974721 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates podName:0f67e6c4-e4be-4136-84ff-cc1a3bd16711 nodeName:}" failed. No retries permitted until 2026-05-20 13:53:54.974704087 +0000 UTC m=+255.060117351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates") pod "keda-metrics-apiserver-7c9f485588-cf5rx" (UID: "0f67e6c4-e4be-4136-84ff-cc1a3bd16711") : references non-existent secret key: tls.crt May 20 13:53:54.780530 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:54.780483 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:54.780719 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.780635 2552 secret.go:281] references non-existent secret key: ca.crt May 20 13:53:54.780719 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.780656 2552 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt May 20 13:53:54.780719 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.780666 2552 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-ffbb595cb-xtx8b: references non-existent secret key: ca.crt May 20 13:53:54.780719 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.780719 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates podName:c1f1cf1b-c3cc-4db0-8908-ecec964df730 nodeName:}" failed. No retries permitted until 2026-05-20 13:53:56.780702694 +0000 UTC m=+256.866115955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates") pod "keda-operator-ffbb595cb-xtx8b" (UID: "c1f1cf1b-c3cc-4db0-8908-ecec964df730") : references non-existent secret key: ca.crt May 20 13:53:54.981608 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:54.981562 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:54.982005 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.981709 2552 secret.go:281] references non-existent secret key: tls.crt May 20 13:53:54.982005 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.981725 2552 projected.go:277] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt May 20 13:53:54.982005 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.981744 2552 projected.go:194] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx: references non-existent secret key: tls.crt May 20 13:53:54.982005 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:53:54.981807 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates podName:0f67e6c4-e4be-4136-84ff-cc1a3bd16711 nodeName:}" failed. No retries permitted until 2026-05-20 13:53:56.981791566 +0000 UTC m=+257.067204832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates") pod "keda-metrics-apiserver-7c9f485588-cf5rx" (UID: "0f67e6c4-e4be-4136-84ff-cc1a3bd16711") : references non-existent secret key: tls.crt May 20 13:53:56.796167 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:56.796125 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:56.798669 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:56.798638 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c1f1cf1b-c3cc-4db0-8908-ecec964df730-certificates\") pod \"keda-operator-ffbb595cb-xtx8b\" (UID: \"c1f1cf1b-c3cc-4db0-8908-ecec964df730\") " pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:56.914273 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:56.914227 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:53:56.997798 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:56.997765 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:57.000333 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:57.000281 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0f67e6c4-e4be-4136-84ff-cc1a3bd16711-certificates\") pod \"keda-metrics-apiserver-7c9f485588-cf5rx\" (UID: \"0f67e6c4-e4be-4136-84ff-cc1a3bd16711\") " pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:57.037979 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:57.037943 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-ffbb595cb-xtx8b"] May 20 13:53:57.041187 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:53:57.041152 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f1cf1b_c3cc_4db0_8908_ecec964df730.slice/crio-03318f5ef96aee2e95da62215bf7507beea85d61e4fd064e2ec97de9581602d7 WatchSource:0}: Error finding container 03318f5ef96aee2e95da62215bf7507beea85d61e4fd064e2ec97de9581602d7: Status 404 returned error can't find the container with id 03318f5ef96aee2e95da62215bf7507beea85d61e4fd064e2ec97de9581602d7 May 20 13:53:57.191231 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:57.191144 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:53:57.316715 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:57.316627 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx"] May 20 13:53:57.319135 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:53:57.319101 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f67e6c4_e4be_4136_84ff_cc1a3bd16711.slice/crio-50b04ad6a076c81b178c637fab5444eb01cf8d8312db0c4536b4cb7040d46986 WatchSource:0}: Error finding container 50b04ad6a076c81b178c637fab5444eb01cf8d8312db0c4536b4cb7040d46986: Status 404 returned error can't find the container with id 50b04ad6a076c81b178c637fab5444eb01cf8d8312db0c4536b4cb7040d46986 May 20 13:53:57.356220 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:57.356184 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" event={"ID":"c1f1cf1b-c3cc-4db0-8908-ecec964df730","Type":"ContainerStarted","Data":"03318f5ef96aee2e95da62215bf7507beea85d61e4fd064e2ec97de9581602d7"} May 20 13:53:57.357174 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:53:57.357146 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" event={"ID":"0f67e6c4-e4be-4136-84ff-cc1a3bd16711","Type":"ContainerStarted","Data":"50b04ad6a076c81b178c637fab5444eb01cf8d8312db0c4536b4cb7040d46986"} May 20 13:54:02.372709 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:02.372670 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" event={"ID":"c1f1cf1b-c3cc-4db0-8908-ecec964df730","Type":"ContainerStarted","Data":"621f01d32b902e44ab512aec4d9033731fec2743ddfd9a4a9fd96368b957448a"} May 20 13:54:02.373178 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:02.372742 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:54:02.374044 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:02.374015 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" event={"ID":"0f67e6c4-e4be-4136-84ff-cc1a3bd16711","Type":"ContainerStarted","Data":"1bbace1c7779aa55716aa20077c3529e59d02d5b6d7d4aa6896076daea23d23c"} May 20 13:54:02.374162 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:02.374147 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:54:02.390718 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:02.390654 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" podStartSLOduration=6.085002574 podStartE2EDuration="10.390635214s" podCreationTimestamp="2026-05-20 13:53:52 +0000 UTC" firstStartedPulling="2026-05-20 13:53:57.042586242 +0000 UTC m=+257.127999503" lastFinishedPulling="2026-05-20 13:54:01.348218867 +0000 UTC m=+261.433632143" observedRunningTime="2026-05-20 13:54:02.389387496 +0000 UTC m=+262.474800791" watchObservedRunningTime="2026-05-20 13:54:02.390635214 +0000 UTC m=+262.476048498" May 20 13:54:02.406805 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:02.406741 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" podStartSLOduration=5.384261672 podStartE2EDuration="9.406722493s" podCreationTimestamp="2026-05-20 13:53:53 +0000 UTC" firstStartedPulling="2026-05-20 13:53:57.320509812 +0000 UTC m=+257.405923077" lastFinishedPulling="2026-05-20 13:54:01.342970624 +0000 UTC m=+261.428383898" observedRunningTime="2026-05-20 13:54:02.406523472 +0000 UTC m=+262.491936771" watchObservedRunningTime="2026-05-20 13:54:02.406722493 +0000 UTC m=+262.492135777" May 20 13:54:13.381096 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:13.381064 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-7c9f485588-cf5rx" May 20 13:54:23.378660 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:23.378619 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-ffbb595cb-xtx8b" May 20 13:54:40.444203 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:40.444172 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:54:40.445492 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:40.445468 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:54:40.449287 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:54:40.449266 2552 kubelet.go:1628] "Image garbage collection succeeded" May 20 13:55:00.540036 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.540005 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-867cffc775-lvkwl"] May 20 13:55:00.543513 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.543488 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:00.547767 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.547739 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" May 20 13:55:00.547767 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.547755 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-8rbng\"" May 20 13:55:00.548781 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.548760 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 20 13:55:00.548901 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.548766 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 20 13:55:00.554716 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.554690 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-lvkwl"] May 20 13:55:00.592027 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.591994 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-79f457656b-x4j78"] May 20 13:55:00.594991 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.594973 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:00.598241 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.598220 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-cb4f8\"" May 20 13:55:00.598827 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.598812 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" May 20 13:55:00.609740 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.609710 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-x4j78"] May 20 13:55:00.648766 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.648715 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmzgw\" (UniqueName: \"kubernetes.io/projected/6ee467ff-edae-4e85-919a-ef416c467c42-kube-api-access-qmzgw\") pod \"kserve-controller-manager-867cffc775-lvkwl\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:00.648766 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.648768 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee-data\") pod \"seaweedfs-79f457656b-x4j78\" (UID: \"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee\") " pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:00.649009 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.648787 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rxx\" (UniqueName: \"kubernetes.io/projected/c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee-kube-api-access-c5rxx\") pod \"seaweedfs-79f457656b-x4j78\" (UID: \"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee\") " pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:00.649009 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.648869 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert\") pod \"kserve-controller-manager-867cffc775-lvkwl\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:00.750243 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.750196 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzgw\" (UniqueName: \"kubernetes.io/projected/6ee467ff-edae-4e85-919a-ef416c467c42-kube-api-access-qmzgw\") pod \"kserve-controller-manager-867cffc775-lvkwl\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:00.750243 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.750248 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee-data\") pod \"seaweedfs-79f457656b-x4j78\" (UID: \"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee\") " pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:00.750530 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.750267 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rxx\" (UniqueName: \"kubernetes.io/projected/c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee-kube-api-access-c5rxx\") pod \"seaweedfs-79f457656b-x4j78\" (UID: \"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee\") " pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:00.750530 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.750288 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert\") pod \"kserve-controller-manager-867cffc775-lvkwl\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:00.750530 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:55:00.750435 2552 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 20 13:55:00.750530 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:55:00.750503 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert podName:6ee467ff-edae-4e85-919a-ef416c467c42 nodeName:}" failed. No retries permitted until 2026-05-20 13:55:01.250487008 +0000 UTC m=+321.335900282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert") pod "kserve-controller-manager-867cffc775-lvkwl" (UID: "6ee467ff-edae-4e85-919a-ef416c467c42") : secret "kserve-webhook-server-cert" not found May 20 13:55:00.750680 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.750627 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee-data\") pod \"seaweedfs-79f457656b-x4j78\" (UID: \"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee\") " pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:00.760166 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.760136 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmzgw\" (UniqueName: \"kubernetes.io/projected/6ee467ff-edae-4e85-919a-ef416c467c42-kube-api-access-qmzgw\") pod \"kserve-controller-manager-867cffc775-lvkwl\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:00.763444 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.763424 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rxx\" (UniqueName: \"kubernetes.io/projected/c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee-kube-api-access-c5rxx\") pod \"seaweedfs-79f457656b-x4j78\" (UID: \"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee\") " pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:00.904176 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:00.904079 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:01.036534 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:01.036487 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-x4j78"] May 20 13:55:01.039214 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:55:01.039183 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b66b05_82ae_4cb5_8cad_1fbb2b5ee2ee.slice/crio-9f5c8e8d289df1c96d3d45fc1ee35f34ea113de650680f7fc51ca5d8778a006e WatchSource:0}: Error finding container 9f5c8e8d289df1c96d3d45fc1ee35f34ea113de650680f7fc51ca5d8778a006e: Status 404 returned error can't find the container with id 9f5c8e8d289df1c96d3d45fc1ee35f34ea113de650680f7fc51ca5d8778a006e May 20 13:55:01.040897 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:01.040876 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 13:55:01.255249 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:01.255194 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert\") pod \"kserve-controller-manager-867cffc775-lvkwl\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:01.257670 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:01.257649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert\") pod \"kserve-controller-manager-867cffc775-lvkwl\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:01.457366 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:01.457334 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:01.534897 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:01.534855 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-x4j78" event={"ID":"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee","Type":"ContainerStarted","Data":"9f5c8e8d289df1c96d3d45fc1ee35f34ea113de650680f7fc51ca5d8778a006e"} May 20 13:55:01.613090 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:01.613036 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-lvkwl"] May 20 13:55:01.615963 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:55:01.615927 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee467ff_edae_4e85_919a_ef416c467c42.slice/crio-a5623e15374ed0b4bdfe1796471c394bb41c01e7703dff2e16f80f55262332bb WatchSource:0}: Error finding container a5623e15374ed0b4bdfe1796471c394bb41c01e7703dff2e16f80f55262332bb: Status 404 returned error can't find the container with id a5623e15374ed0b4bdfe1796471c394bb41c01e7703dff2e16f80f55262332bb May 20 13:55:02.539992 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:02.539947 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" event={"ID":"6ee467ff-edae-4e85-919a-ef416c467c42","Type":"ContainerStarted","Data":"a5623e15374ed0b4bdfe1796471c394bb41c01e7703dff2e16f80f55262332bb"} May 20 13:55:05.549294 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:05.549251 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" event={"ID":"6ee467ff-edae-4e85-919a-ef416c467c42","Type":"ContainerStarted","Data":"265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a"} May 20 13:55:05.549785 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:05.549365 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:05.550622 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:05.550593 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-x4j78" event={"ID":"c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee","Type":"ContainerStarted","Data":"817f3b62062f0f9f1993faff5e928991e6478996b167c97737ac6e9279bd1de4"} May 20 13:55:05.550732 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:05.550684 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:05.567942 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:05.567876 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" podStartSLOduration=1.943390302 podStartE2EDuration="5.567857402s" podCreationTimestamp="2026-05-20 13:55:00 +0000 UTC" firstStartedPulling="2026-05-20 13:55:01.617516297 +0000 UTC m=+321.702929560" lastFinishedPulling="2026-05-20 13:55:05.241983395 +0000 UTC m=+325.327396660" observedRunningTime="2026-05-20 13:55:05.56589407 +0000 UTC m=+325.651307354" watchObservedRunningTime="2026-05-20 13:55:05.567857402 +0000 UTC m=+325.653270686" May 20 13:55:05.583674 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:05.583544 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-79f457656b-x4j78" podStartSLOduration=1.29001012 podStartE2EDuration="5.583528935s" podCreationTimestamp="2026-05-20 13:55:00 +0000 UTC" firstStartedPulling="2026-05-20 13:55:01.040999616 +0000 UTC m=+321.126412877" lastFinishedPulling="2026-05-20 13:55:05.334518413 +0000 UTC m=+325.419931692" observedRunningTime="2026-05-20 13:55:05.582285539 +0000 UTC m=+325.667698824" watchObservedRunningTime="2026-05-20 13:55:05.583528935 +0000 UTC m=+325.668942246" May 20 13:55:11.555356 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:11.555303 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-79f457656b-x4j78" May 20 13:55:36.244927 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.244833 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-lvkwl"] May 20 13:55:36.245402 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.245112 2552 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" podUID="6ee467ff-edae-4e85-919a-ef416c467c42" containerName="manager" containerID="cri-o://265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a" gracePeriod=10 May 20 13:55:36.250188 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.250156 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:36.265903 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.265875 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-867cffc775-zncjg"] May 20 13:55:36.269006 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.268987 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.277709 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.277678 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-zncjg"] May 20 13:55:36.421851 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.421816 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2g98\" (UniqueName: \"kubernetes.io/projected/38413193-bdaa-4299-b240-b90b0c4cead1-kube-api-access-g2g98\") pod \"kserve-controller-manager-867cffc775-zncjg\" (UID: \"38413193-bdaa-4299-b240-b90b0c4cead1\") " pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.421982 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.421890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38413193-bdaa-4299-b240-b90b0c4cead1-cert\") pod \"kserve-controller-manager-867cffc775-zncjg\" (UID: \"38413193-bdaa-4299-b240-b90b0c4cead1\") " pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.488529 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.488501 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:36.522900 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.522796 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2g98\" (UniqueName: \"kubernetes.io/projected/38413193-bdaa-4299-b240-b90b0c4cead1-kube-api-access-g2g98\") pod \"kserve-controller-manager-867cffc775-zncjg\" (UID: \"38413193-bdaa-4299-b240-b90b0c4cead1\") " pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.522900 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.522883 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38413193-bdaa-4299-b240-b90b0c4cead1-cert\") pod \"kserve-controller-manager-867cffc775-zncjg\" (UID: \"38413193-bdaa-4299-b240-b90b0c4cead1\") " pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.525632 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.525600 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38413193-bdaa-4299-b240-b90b0c4cead1-cert\") pod \"kserve-controller-manager-867cffc775-zncjg\" (UID: \"38413193-bdaa-4299-b240-b90b0c4cead1\") " pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.532162 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.532133 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2g98\" (UniqueName: \"kubernetes.io/projected/38413193-bdaa-4299-b240-b90b0c4cead1-kube-api-access-g2g98\") pod \"kserve-controller-manager-867cffc775-zncjg\" (UID: \"38413193-bdaa-4299-b240-b90b0c4cead1\") " pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.624062 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.624008 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert\") pod \"6ee467ff-edae-4e85-919a-ef416c467c42\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " May 20 13:55:36.624271 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.624084 2552 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmzgw\" (UniqueName: \"kubernetes.io/projected/6ee467ff-edae-4e85-919a-ef416c467c42-kube-api-access-qmzgw\") pod \"6ee467ff-edae-4e85-919a-ef416c467c42\" (UID: \"6ee467ff-edae-4e85-919a-ef416c467c42\") " May 20 13:55:36.626275 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.626240 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert" (OuterVolumeSpecName: "cert") pod "6ee467ff-edae-4e85-919a-ef416c467c42" (UID: "6ee467ff-edae-4e85-919a-ef416c467c42"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 13:55:36.626398 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.626240 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee467ff-edae-4e85-919a-ef416c467c42-kube-api-access-qmzgw" (OuterVolumeSpecName: "kube-api-access-qmzgw") pod "6ee467ff-edae-4e85-919a-ef416c467c42" (UID: "6ee467ff-edae-4e85-919a-ef416c467c42"). InnerVolumeSpecName "kube-api-access-qmzgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 13:55:36.631442 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.631420 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:36.638993 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.638954 2552 generic.go:358] "Generic (PLEG): container finished" podID="6ee467ff-edae-4e85-919a-ef416c467c42" containerID="265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a" exitCode=0 May 20 13:55:36.638993 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.639010 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" event={"ID":"6ee467ff-edae-4e85-919a-ef416c467c42","Type":"ContainerDied","Data":"265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a"} May 20 13:55:36.639202 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.639044 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" event={"ID":"6ee467ff-edae-4e85-919a-ef416c467c42","Type":"ContainerDied","Data":"a5623e15374ed0b4bdfe1796471c394bb41c01e7703dff2e16f80f55262332bb"} May 20 13:55:36.639202 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.639051 2552 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-867cffc775-lvkwl" May 20 13:55:36.639202 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.639061 2552 scope.go:117] "RemoveContainer" containerID="265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a" May 20 13:55:36.648126 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.648102 2552 scope.go:117] "RemoveContainer" containerID="265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a" May 20 13:55:36.648502 ip-10-0-128-199 kubenswrapper[2552]: E0520 13:55:36.648476 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a\": container with ID starting with 265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a not found: ID does not exist" containerID="265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a" May 20 13:55:36.648612 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.648510 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a"} err="failed to get container status \"265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a\": rpc error: code = NotFound desc = could not find container \"265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a\": container with ID starting with 265deb61d023bcb66fbf92ac33b3f73668c8733e2812f6797f68e3ef3cfb928a not found: ID does not exist" May 20 13:55:36.659797 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.659759 2552 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-lvkwl"] May 20 13:55:36.662895 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.662861 2552 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-lvkwl"] May 20 13:55:36.725494 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.725465 2552 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ee467ff-edae-4e85-919a-ef416c467c42-cert\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:55:36.725494 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.725493 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmzgw\" (UniqueName: \"kubernetes.io/projected/6ee467ff-edae-4e85-919a-ef416c467c42-kube-api-access-qmzgw\") on node \"ip-10-0-128-199.ec2.internal\" DevicePath \"\"" May 20 13:55:36.763202 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:36.763164 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-867cffc775-zncjg"] May 20 13:55:36.766088 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:55:36.766059 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38413193_bdaa_4299_b240_b90b0c4cead1.slice/crio-52bd22896f45541e89c83fc7a824e68e9eff7b13d9a02fdee09048df10b6e550 WatchSource:0}: Error finding container 52bd22896f45541e89c83fc7a824e68e9eff7b13d9a02fdee09048df10b6e550: Status 404 returned error can't find the container with id 52bd22896f45541e89c83fc7a824e68e9eff7b13d9a02fdee09048df10b6e550 May 20 13:55:37.643650 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:37.643610 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-zncjg" event={"ID":"38413193-bdaa-4299-b240-b90b0c4cead1","Type":"ContainerStarted","Data":"e9d04750fbac34564f5ebf5156f8ddc8641952e8c906a8aea870fd14b8b71f4c"} May 20 13:55:37.643650 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:37.643653 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-867cffc775-zncjg" event={"ID":"38413193-bdaa-4299-b240-b90b0c4cead1","Type":"ContainerStarted","Data":"52bd22896f45541e89c83fc7a824e68e9eff7b13d9a02fdee09048df10b6e550"} May 20 13:55:37.644067 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:37.643739 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:55:37.659720 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:37.659643 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-867cffc775-zncjg" podStartSLOduration=1.306440966 podStartE2EDuration="1.659627724s" podCreationTimestamp="2026-05-20 13:55:36 +0000 UTC" firstStartedPulling="2026-05-20 13:55:36.767411435 +0000 UTC m=+356.852824696" lastFinishedPulling="2026-05-20 13:55:37.12059819 +0000 UTC m=+357.206011454" observedRunningTime="2026-05-20 13:55:37.658866513 +0000 UTC m=+357.744279798" watchObservedRunningTime="2026-05-20 13:55:37.659627724 +0000 UTC m=+357.745041006" May 20 13:55:38.526255 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:55:38.526216 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee467ff-edae-4e85-919a-ef416c467c42" path="/var/lib/kubelet/pods/6ee467ff-edae-4e85-919a-ef416c467c42/volumes" May 20 13:56:08.651353 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:08.651306 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-867cffc775-zncjg" May 20 13:56:09.571937 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.571897 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-86f7b4b499-6l2lb"] May 20 13:56:09.572166 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.572154 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee467ff-edae-4e85-919a-ef416c467c42" containerName="manager" May 20 13:56:09.572210 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.572168 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee467ff-edae-4e85-919a-ef416c467c42" containerName="manager" May 20 13:56:09.572243 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.572214 2552 memory_manager.go:356] "RemoveStaleState removing state" podUID="6ee467ff-edae-4e85-919a-ef416c467c42" containerName="manager" May 20 13:56:09.575024 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.574998 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.577746 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.577725 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-s266x\"" May 20 13:56:09.577877 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.577725 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" May 20 13:56:09.585866 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.585839 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-6l2lb"] May 20 13:56:09.588636 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.588612 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-696fc77849-2gs4b"] May 20 13:56:09.591725 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.591704 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:09.594569 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.594547 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" May 20 13:56:09.594680 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.594566 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-7x986\"" May 20 13:56:09.601896 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.601873 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-2gs4b"] May 20 13:56:09.665191 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.665155 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sh5m\" (UniqueName: \"kubernetes.io/projected/c76cf687-c4ed-4512-83ff-62be2a3ccb17-kube-api-access-9sh5m\") pod \"odh-model-controller-696fc77849-2gs4b\" (UID: \"c76cf687-c4ed-4512-83ff-62be2a3ccb17\") " pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:09.665611 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.665214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f00de07d-3cee-48e6-a9d9-848ee91e3775-tls-certs\") pod \"model-serving-api-86f7b4b499-6l2lb\" (UID: \"f00de07d-3cee-48e6-a9d9-848ee91e3775\") " pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.665611 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.665305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c76cf687-c4ed-4512-83ff-62be2a3ccb17-cert\") pod \"odh-model-controller-696fc77849-2gs4b\" (UID: \"c76cf687-c4ed-4512-83ff-62be2a3ccb17\") " pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:09.665611 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.665361 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74jsx\" (UniqueName: \"kubernetes.io/projected/f00de07d-3cee-48e6-a9d9-848ee91e3775-kube-api-access-74jsx\") pod \"model-serving-api-86f7b4b499-6l2lb\" (UID: \"f00de07d-3cee-48e6-a9d9-848ee91e3775\") " pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.766426 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.766387 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f00de07d-3cee-48e6-a9d9-848ee91e3775-tls-certs\") pod \"model-serving-api-86f7b4b499-6l2lb\" (UID: \"f00de07d-3cee-48e6-a9d9-848ee91e3775\") " pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.766607 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.766441 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c76cf687-c4ed-4512-83ff-62be2a3ccb17-cert\") pod \"odh-model-controller-696fc77849-2gs4b\" (UID: \"c76cf687-c4ed-4512-83ff-62be2a3ccb17\") " pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:09.766607 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.766463 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74jsx\" (UniqueName: \"kubernetes.io/projected/f00de07d-3cee-48e6-a9d9-848ee91e3775-kube-api-access-74jsx\") pod \"model-serving-api-86f7b4b499-6l2lb\" (UID: \"f00de07d-3cee-48e6-a9d9-848ee91e3775\") " pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.766607 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.766485 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9sh5m\" (UniqueName: \"kubernetes.io/projected/c76cf687-c4ed-4512-83ff-62be2a3ccb17-kube-api-access-9sh5m\") pod \"odh-model-controller-696fc77849-2gs4b\" (UID: \"c76cf687-c4ed-4512-83ff-62be2a3ccb17\") " pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:09.768942 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.768915 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c76cf687-c4ed-4512-83ff-62be2a3ccb17-cert\") pod \"odh-model-controller-696fc77849-2gs4b\" (UID: \"c76cf687-c4ed-4512-83ff-62be2a3ccb17\") " pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:09.769065 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.769014 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f00de07d-3cee-48e6-a9d9-848ee91e3775-tls-certs\") pod \"model-serving-api-86f7b4b499-6l2lb\" (UID: \"f00de07d-3cee-48e6-a9d9-848ee91e3775\") " pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.775367 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.775342 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74jsx\" (UniqueName: \"kubernetes.io/projected/f00de07d-3cee-48e6-a9d9-848ee91e3775-kube-api-access-74jsx\") pod \"model-serving-api-86f7b4b499-6l2lb\" (UID: \"f00de07d-3cee-48e6-a9d9-848ee91e3775\") " pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.775509 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.775408 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sh5m\" (UniqueName: \"kubernetes.io/projected/c76cf687-c4ed-4512-83ff-62be2a3ccb17-kube-api-access-9sh5m\") pod \"odh-model-controller-696fc77849-2gs4b\" (UID: \"c76cf687-c4ed-4512-83ff-62be2a3ccb17\") " pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:09.886274 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.886179 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:09.903182 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:09.903146 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:10.027011 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:10.026967 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-86f7b4b499-6l2lb"] May 20 13:56:10.030238 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:56:10.030209 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00de07d_3cee_48e6_a9d9_848ee91e3775.slice/crio-494f64341d9c47ad8da69674abb20762886580da8a46166cecba6e2c9554e2fd WatchSource:0}: Error finding container 494f64341d9c47ad8da69674abb20762886580da8a46166cecba6e2c9554e2fd: Status 404 returned error can't find the container with id 494f64341d9c47ad8da69674abb20762886580da8a46166cecba6e2c9554e2fd May 20 13:56:10.048540 ip-10-0-128-199 kubenswrapper[2552]: W0520 13:56:10.048506 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76cf687_c4ed_4512_83ff_62be2a3ccb17.slice/crio-9aa49b83c0c8e99548f1f0abb2b35c57d660e95eae63bc8cf96b2285cc09a38c WatchSource:0}: Error finding container 9aa49b83c0c8e99548f1f0abb2b35c57d660e95eae63bc8cf96b2285cc09a38c: Status 404 returned error can't find the container with id 9aa49b83c0c8e99548f1f0abb2b35c57d660e95eae63bc8cf96b2285cc09a38c May 20 13:56:10.051247 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:10.051210 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-696fc77849-2gs4b"] May 20 13:56:10.735969 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:10.735921 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-6l2lb" event={"ID":"f00de07d-3cee-48e6-a9d9-848ee91e3775","Type":"ContainerStarted","Data":"494f64341d9c47ad8da69674abb20762886580da8a46166cecba6e2c9554e2fd"} May 20 13:56:10.738179 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:10.738145 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-2gs4b" event={"ID":"c76cf687-c4ed-4512-83ff-62be2a3ccb17","Type":"ContainerStarted","Data":"9aa49b83c0c8e99548f1f0abb2b35c57d660e95eae63bc8cf96b2285cc09a38c"} May 20 13:56:14.750713 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:14.750673 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-86f7b4b499-6l2lb" event={"ID":"f00de07d-3cee-48e6-a9d9-848ee91e3775","Type":"ContainerStarted","Data":"e1708435274df9a7c319f3aba9caa377fb1c4b3eb982494b05ce3b5e628c9622"} May 20 13:56:14.751168 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:14.750791 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:56:14.752032 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:14.752007 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-696fc77849-2gs4b" event={"ID":"c76cf687-c4ed-4512-83ff-62be2a3ccb17","Type":"ContainerStarted","Data":"b51ca7b9f108916475abb7302e2d210e4ed29a208fe7a4c60d8548eafa5b569c"} May 20 13:56:14.752142 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:14.752125 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:14.766542 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:14.766490 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/model-serving-api-86f7b4b499-6l2lb" podStartSLOduration=1.94740501 podStartE2EDuration="5.766476048s" podCreationTimestamp="2026-05-20 13:56:09 +0000 UTC" firstStartedPulling="2026-05-20 13:56:10.032126519 +0000 UTC m=+390.117539780" lastFinishedPulling="2026-05-20 13:56:13.851197541 +0000 UTC m=+393.936610818" observedRunningTime="2026-05-20 13:56:14.76538429 +0000 UTC m=+394.850797576" watchObservedRunningTime="2026-05-20 13:56:14.766476048 +0000 UTC m=+394.851889331" May 20 13:56:14.781024 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:14.780963 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/odh-model-controller-696fc77849-2gs4b" podStartSLOduration=1.9796997410000001 podStartE2EDuration="5.780948024s" podCreationTimestamp="2026-05-20 13:56:09 +0000 UTC" firstStartedPulling="2026-05-20 13:56:10.049657116 +0000 UTC m=+390.135070377" lastFinishedPulling="2026-05-20 13:56:13.850905394 +0000 UTC m=+393.936318660" observedRunningTime="2026-05-20 13:56:14.779366576 +0000 UTC m=+394.864779860" watchObservedRunningTime="2026-05-20 13:56:14.780948024 +0000 UTC m=+394.866361307" May 20 13:56:25.757343 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:25.757295 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-696fc77849-2gs4b" May 20 13:56:25.759466 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:56:25.759438 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-86f7b4b499-6l2lb" May 20 13:59:40.464127 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:59:40.464093 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 13:59:40.464628 ip-10-0-128-199 kubenswrapper[2552]: I0520 13:59:40.464477 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 14:04:40.483170 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:04:40.483076 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 14:04:40.483821 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:04:40.483803 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 14:09:40.502049 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:09:40.501957 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 14:09:40.504050 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:09:40.504027 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 14:12:12.176263 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:12.176178 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nx5w4_700a8d0c-f2b6-422e-a756-ae3c07ab68f5/global-pull-secret-syncer/0.log" May 20 14:12:12.184392 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:12.184368 2552 ???:1] "http: TLS handshake error from 10.0.130.134:47774: EOF" May 20 14:12:12.312553 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:12.312518 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sdw7x_6f4deeff-cbf5-43e0-b2c0-06b1f91f06c4/konnectivity-agent/0.log" May 20 14:12:12.333773 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:12.333742 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-199.ec2.internal_95a443e8c9080bfbbf1a963ab72a458b/haproxy/0.log" May 20 14:12:16.472513 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:16.472483 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xzldr_f1b69a5d-9432-4baf-81dc-d3f189da0e7b/node-exporter/0.log" May 20 14:12:16.495657 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:16.495621 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xzldr_f1b69a5d-9432-4baf-81dc-d3f189da0e7b/kube-rbac-proxy/0.log" May 20 14:12:16.516277 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:16.516254 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xzldr_f1b69a5d-9432-4baf-81dc-d3f189da0e7b/init-textfile/0.log" May 20 14:12:19.431248 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.431208 2552 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn"] May 20 14:12:19.434517 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.434498 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.437435 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.437408 2552 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kzhb4\"/\"default-dockercfg-spk4j\"" May 20 14:12:19.437568 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.437472 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzhb4\"/\"kube-root-ca.crt\"" May 20 14:12:19.438350 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.438306 2552 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzhb4\"/\"openshift-service-ca.crt\"" May 20 14:12:19.441970 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.441946 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn"] May 20 14:12:19.480816 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.480767 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-lib-modules\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.481016 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.480884 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-sys\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.481016 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.480925 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-podres\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.481016 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.480948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-proc\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.481016 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.480987 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vqdg\" (UniqueName: \"kubernetes.io/projected/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-kube-api-access-7vqdg\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581342 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581267 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-sys\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581535 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581339 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-podres\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581535 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581385 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-proc\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581535 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581405 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-sys\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581535 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581489 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-proc\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581535 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581490 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-podres\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581535 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581523 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vqdg\" (UniqueName: \"kubernetes.io/projected/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-kube-api-access-7vqdg\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581863 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581560 2552 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-lib-modules\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.581863 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.581665 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-lib-modules\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.590038 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.590006 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vqdg\" (UniqueName: \"kubernetes.io/projected/c16b0580-b3b0-44fd-b6a2-87f38b9f777c-kube-api-access-7vqdg\") pod \"perf-node-gather-daemonset-qrmvn\" (UID: \"c16b0580-b3b0-44fd-b6a2-87f38b9f777c\") " pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.745434 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.745393 2552 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:19.873925 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.873897 2552 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn"] May 20 14:12:19.876466 ip-10-0-128-199 kubenswrapper[2552]: W0520 14:12:19.876434 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc16b0580_b3b0_44fd_b6a2_87f38b9f777c.slice/crio-8a66389a1f5370a91a26121a6fbc7467740ad48694467a9626d23f2647501c41 WatchSource:0}: Error finding container 8a66389a1f5370a91a26121a6fbc7467740ad48694467a9626d23f2647501c41: Status 404 returned error can't find the container with id 8a66389a1f5370a91a26121a6fbc7467740ad48694467a9626d23f2647501c41 May 20 14:12:19.878122 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:19.878105 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 14:12:20.301877 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.301793 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t4gw4_96404fef-e012-444e-98dd-893bcb9fa535/dns/0.log" May 20 14:12:20.323291 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.323263 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t4gw4_96404fef-e012-444e-98dd-893bcb9fa535/kube-rbac-proxy/0.log" May 20 14:12:20.391416 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.391388 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ttn2r_ac4906fa-5821-4932-a5fe-965573d8f96e/dns-node-resolver/0.log" May 20 14:12:20.427705 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.427670 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" event={"ID":"c16b0580-b3b0-44fd-b6a2-87f38b9f777c","Type":"ContainerStarted","Data":"c183f8056f89fbcc55a43e526785d5efb3e6f7c5c7262957cf4b659fd314b3ca"} May 20 14:12:20.427705 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.427705 2552 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" event={"ID":"c16b0580-b3b0-44fd-b6a2-87f38b9f777c","Type":"ContainerStarted","Data":"8a66389a1f5370a91a26121a6fbc7467740ad48694467a9626d23f2647501c41"} May 20 14:12:20.427922 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.427784 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:20.443743 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.443694 2552 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" podStartSLOduration=1.443676664 podStartE2EDuration="1.443676664s" podCreationTimestamp="2026-05-20 14:12:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 14:12:20.442811184 +0000 UTC m=+1360.528224481" watchObservedRunningTime="2026-05-20 14:12:20.443676664 +0000 UTC m=+1360.529089949" May 20 14:12:20.852636 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:20.852603 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dzcdv_2683c424-59e2-4ac8-85c6-adb67def8d4f/node-ca/0.log" May 20 14:12:21.907308 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:21.907276 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7v6cc_0fec27ae-de4b-47f4-9cf1-0adbcd9d94c0/serve-healthcheck-canary/0.log" May 20 14:12:22.341555 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:22.341526 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dvkpc_e5680705-ff28-4d53-9cac-cdcc12305084/kube-rbac-proxy/0.log" May 20 14:12:22.363238 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:22.363211 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dvkpc_e5680705-ff28-4d53-9cac-cdcc12305084/exporter/0.log" May 20 14:12:22.387396 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:22.387361 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dvkpc_e5680705-ff28-4d53-9cac-cdcc12305084/extractor/0.log" May 20 14:12:24.493281 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:24.493243 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-867cffc775-zncjg_38413193-bdaa-4299-b240-b90b0c4cead1/manager/0.log" May 20 14:12:24.537057 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:24.537024 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-86f7b4b499-6l2lb_f00de07d-3cee-48e6-a9d9-848ee91e3775/server/0.log" May 20 14:12:24.677994 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:24.677958 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-696fc77849-2gs4b_c76cf687-c4ed-4512-83ff-62be2a3ccb17/manager/0.log" May 20 14:12:24.754235 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:24.754154 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-79f457656b-x4j78_c1b66b05-82ae-4cb5-8cad-1fbb2b5ee2ee/seaweedfs/0.log" May 20 14:12:26.439952 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:26.439922 2552 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kzhb4/perf-node-gather-daemonset-qrmvn" May 20 14:12:29.939490 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:29.939397 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2cnhf_d0c21dba-b43a-4d9b-8191-ec788fa761e0/kube-multus/0.log" May 20 14:12:29.962707 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:29.962673 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4n8gm_0968bab8-1e4f-4bee-974b-7245aac58209/kube-multus-additional-cni-plugins/0.log" May 20 14:12:29.984414 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:29.984380 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4n8gm_0968bab8-1e4f-4bee-974b-7245aac58209/egress-router-binary-copy/0.log" May 20 14:12:30.005955 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:30.005910 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4n8gm_0968bab8-1e4f-4bee-974b-7245aac58209/cni-plugins/0.log" May 20 14:12:30.027237 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:30.027208 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4n8gm_0968bab8-1e4f-4bee-974b-7245aac58209/bond-cni-plugin/0.log" May 20 14:12:30.050815 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:30.050788 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4n8gm_0968bab8-1e4f-4bee-974b-7245aac58209/routeoverride-cni/0.log" May 20 14:12:30.076508 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:30.076480 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4n8gm_0968bab8-1e4f-4bee-974b-7245aac58209/whereabouts-cni-bincopy/0.log" May 20 14:12:30.101100 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:30.101074 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4n8gm_0968bab8-1e4f-4bee-974b-7245aac58209/whereabouts-cni/0.log" May 20 14:12:30.627640 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:30.627607 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p2jmv_36452282-6303-4873-8e65-3dbf6166bb05/network-metrics-daemon/0.log" May 20 14:12:30.649891 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:30.649855 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p2jmv_36452282-6303-4873-8e65-3dbf6166bb05/kube-rbac-proxy/0.log" May 20 14:12:32.093386 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.093354 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-controller/0.log" May 20 14:12:32.115166 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.115134 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/0.log" May 20 14:12:32.127438 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.127410 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovn-acl-logging/1.log" May 20 14:12:32.153111 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.153063 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/kube-rbac-proxy-node/0.log" May 20 14:12:32.176247 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.176213 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/kube-rbac-proxy-ovn-metrics/0.log" May 20 14:12:32.196212 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.196185 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/northd/0.log" May 20 14:12:32.224152 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.224119 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/nbdb/0.log" May 20 14:12:32.248241 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.248212 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/sbdb/0.log" May 20 14:12:32.402745 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:32.402668 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h5w7v_8cbf7364-8411-408b-9455-bb929a9088fc/ovnkube-controller/0.log" May 20 14:12:33.525712 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:33.525677 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9dmw9_250bd337-fccf-462c-a9f7-d6df8b909ac6/network-check-target-container/0.log" May 20 14:12:34.562860 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:34.562836 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wcbdd_646aad3c-162b-4e94-8e66-2c7d2c3f4575/iptables-alerter/0.log" May 20 14:12:35.262459 ip-10-0-128-199 kubenswrapper[2552]: I0520 14:12:35.262426 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-gl9qq_f49780be-f70f-4b46-b68f-756e0fbc1a83/tuned/0.log"