Jun 02 01:48:15.051827 ip-10-0-142-223 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 01:48:15.051840 ip-10-0-142-223 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 01:48:15.051850 ip-10-0-142-223 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 01:48:15.052180 ip-10-0-142-223 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 01:48:24.394076 ip-10-0-142-223 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 01:48:24.394092 ip-10-0-142-223 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot befafedbb4d443bfad154876b396f24c -- Jun 02 01:50:38.458688 ip-10-0-142-223 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:50:38.894239 ip-10-0-142-223 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:50:38.894239 ip-10-0-142-223 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:50:38.894239 ip-10-0-142-223 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:50:38.894239 ip-10-0-142-223 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:50:38.894239 ip-10-0-142-223 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:50:38.895105 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.895034 2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:50:38.901086 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901072 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.901086 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901085 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901091 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901094 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901097 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901100 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901103 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901105 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901108 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901111 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901113 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901116 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901118 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901121 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901124 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901126 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901129 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901132 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901135 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901137 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.901151 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901148 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901151 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901154 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901158 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901161 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901164 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901166 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901169 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901171 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901174 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901176 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901179 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901181 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901184 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901187 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901189 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901192 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901194 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901197 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901199 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.901620 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901202 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901204 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901207 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901209 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901212 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901215 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901217 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901220 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901223 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901227 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901230 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901233 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901236 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901238 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901242 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901245 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901247 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901250 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901252 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901255 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.902123 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901257 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901260 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901263 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901265 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901267 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901270 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901273 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901275 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901278 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901280 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901284 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901287 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901290 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901293 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901295 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901297 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901301 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901305 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901308 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.902634 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901311 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901313 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901316 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901319 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901322 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901324 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901328 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901699 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901705 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901707 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901710 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901713 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901716 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901718 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901721 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901723 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901726 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901729 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901732 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901734 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.903094 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901737 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901739 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901742 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901745 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901747 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901750 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901752 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901755 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901757 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901760 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901763 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901765 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901767 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901770 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901773 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901777 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901780 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901783 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901786 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.903597 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901789 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901791 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901794 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901797 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901799 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901802 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901804 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901807 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901809 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901812 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901814 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901817 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901819 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901821 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901824 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901826 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901829 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901832 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901834 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901837 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.904105 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901840 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901843 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901845 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901848 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901850 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901853 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901855 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901858 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901860 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901863 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901865 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901869 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901872 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901874 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901877 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901879 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901882 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901884 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901887 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901890 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.904708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901892 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901895 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901897 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901900 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901902 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901906 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901910 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901914 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901916 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901919 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901922 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901925 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901927 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.901929 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903472 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903481 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903487 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903492 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903499 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903502 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:50:38.905206 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903507 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903511 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903514 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903518 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903521 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903525 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903528 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903531 2558 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903535 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903538 2558 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903541 2558 flags.go:64] FLAG: --cloud-config="" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903544 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903547 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903552 2558 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903555 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903558 2558 flags.go:64] FLAG: --config-dir="" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903561 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903564 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903568 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903571 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903574 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903577 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903580 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903584 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:50:38.905713 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903587 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903590 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903593 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903597 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903601 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903603 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903606 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903609 2558 flags.go:64] FLAG: --enable-server="true" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903613 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903619 2558 flags.go:64] FLAG: --event-burst="100" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903622 2558 flags.go:64] FLAG: --event-qps="50" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903625 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903628 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903631 2558 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903635 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903638 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903641 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903644 2558 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903647 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903650 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903653 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903656 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903659 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903662 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903664 2558 flags.go:64] FLAG: --feature-gates="" Jun 02 01:50:38.906301 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903668 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903671 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903674 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903677 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903680 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903683 2558 flags.go:64] FLAG: --help="false" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903686 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-142-223.ec2.internal" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903690 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903693 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903696 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903699 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903703 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903705 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903708 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903711 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903714 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903717 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903720 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903723 2558 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903726 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903729 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903732 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903735 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903738 2558 flags.go:64] FLAG: --lock-file="" Jun 02 01:50:38.906916 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903741 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903744 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903747 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903752 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903755 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903758 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903761 2558 flags.go:64] FLAG: --logging-format="text" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903764 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903767 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903770 2558 flags.go:64] FLAG: --manifest-url="" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903773 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903777 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903780 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903784 2558 flags.go:64] FLAG: --max-pods="110" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903787 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903790 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903793 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903796 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903799 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903802 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903805 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903812 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903815 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903818 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:50:38.907521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903821 2558 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903825 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903830 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903833 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903837 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903839 2558 flags.go:64] FLAG: --port="10250" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903842 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903845 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05749444fefd418be" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903849 2558 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903852 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903855 2558 flags.go:64] FLAG: --register-node="true" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903858 2558 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903861 2558 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903865 2558 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903868 2558 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903870 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903873 2558 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903877 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903880 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903882 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903885 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903888 2558 flags.go:64] FLAG: --runonce="false" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903891 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903894 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903897 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:50:38.908102 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903900 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903903 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903906 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903909 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903912 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903915 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903917 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903921 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903923 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903926 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903929 2558 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903932 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903938 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903940 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903945 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903950 2558 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903952 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903955 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903958 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903961 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903964 2558 flags.go:64] FLAG: --v="2" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903968 2558 flags.go:64] FLAG: --version="false" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903972 2558 flags.go:64] FLAG: --vmodule="" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903975 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.903979 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:50:38.908764 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904066 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904070 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904073 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904075 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904078 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904081 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904083 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904086 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904089 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904092 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904094 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904097 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904099 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904102 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904108 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904110 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904113 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904116 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904119 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904122 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.909393 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904124 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904128 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904130 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904133 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904135 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904138 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904142 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904146 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904150 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904154 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904156 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904159 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904163 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904166 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904169 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904172 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904175 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904177 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904180 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.909912 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904182 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904185 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904188 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904191 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904194 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904197 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904200 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904203 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904206 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904209 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904211 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904214 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904216 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904219 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904221 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904224 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904226 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904229 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904232 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904234 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.910440 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904237 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904239 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904242 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904244 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904246 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904249 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904252 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904254 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904257 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904260 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904262 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904265 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904277 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904280 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904283 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904286 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904289 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904291 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904294 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904298 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.910931 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904301 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904303 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904306 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904309 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904311 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904314 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.904316 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.905240 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.911292 2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.911307 2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911352 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911356 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911360 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911363 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911366 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.911443 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911369 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911372 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911375 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911378 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911381 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911383 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911386 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911388 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911391 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911394 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911412 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911416 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911420 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911423 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911425 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911428 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911430 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911433 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911437 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.911818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911441 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911444 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911448 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911452 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911456 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911459 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911461 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911464 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911467 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911469 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911472 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911475 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911477 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911480 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911482 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911486 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911489 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911491 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911494 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911497 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.912310 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911500 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911502 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911505 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911507 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911510 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911513 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911516 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911519 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911522 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911524 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911527 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911529 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911532 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911534 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911537 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911539 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911542 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911544 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911547 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911549 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.912818 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911552 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911554 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911556 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911559 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911562 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911564 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911567 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911570 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911573 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911575 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911578 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911581 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911583 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911586 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911589 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911591 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911594 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911596 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911599 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911601 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.913322 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911604 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911607 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.911612 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911707 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911711 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911715 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911719 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911722 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911725 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911728 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911730 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911733 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911735 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911738 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911741 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.913840 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911743 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911746 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911748 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911751 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911754 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911756 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911759 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911761 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911764 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911766 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911769 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911771 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911774 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911776 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911778 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911781 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911783 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911786 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911788 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911791 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.914228 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911793 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911796 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911798 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911801 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911803 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911806 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911808 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911811 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911813 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911816 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911818 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911821 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911824 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911826 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911829 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911832 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911835 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911837 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911840 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911842 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.914745 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911845 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911847 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911850 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911852 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911855 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911857 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911860 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911862 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911865 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911867 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911870 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911872 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911875 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911877 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911880 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911882 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911886 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911888 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911891 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.915234 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911893 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911896 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911898 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911900 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911903 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911906 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911908 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911910 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911913 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911916 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911919 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911922 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911924 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911927 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:38.911929 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.911934 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:50:38.915711 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.912800 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:50:38.916181 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.915879 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:50:38.916839 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.916828 2558 server.go:1019] "Starting client certificate rotation" Jun 02 01:50:38.916940 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.916924 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:50:38.916983 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.916958 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:50:38.944213 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.944196 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:50:38.946066 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.946047 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:50:38.961898 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.961880 2558 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:50:38.967463 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.967448 2558 log.go:25] "Validated CRI v1 image API" Jun 02 01:50:38.968734 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.968718 2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:50:38.973046 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.973027 2558 fs.go:135] Filesystem UUIDs: map[009f8544-09e8-44bc-9fb9-1f0f8516d29a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dfcb15ae-ac4b-44aa-a14b-f726e05b5af3:/dev/nvme0n1p4] Jun 02 01:50:38.973094 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.973047 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:50:38.977126 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.977009 2558 manager.go:217] Machine: {Timestamp:2026-06-02 01:50:38.976541603 +0000 UTC m=+0.403382674 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102179 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212dcc167af5cb0bed7d7937471d1b SystemUUID:ec212dcc-167a-f5cb-0bed-7d7937471d1b BootID:befafedb-b4d4-43bf-ad15-4876b396f24c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:91:da:e4:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:91:da:e4:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:fc:af:6e:bb:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:50:38.977757 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.977747 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:50:38.977832 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.977821 2558 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:50:38.979739 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.979719 2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:50:38.979863 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.979740 2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:50:38.979910 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.979872 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:50:38.979910 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.979881 2558 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:50:38.979910 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.979888 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:50:38.980732 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.980721 2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:50:38.981175 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.981160 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:50:38.982160 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.982147 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:50:38.982271 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.982262 2558 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:50:38.984545 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.984534 2558 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:50:38.984606 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.984547 2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:50:38.984606 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.984559 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:50:38.984606 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.984568 2558 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:50:38.984606 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.984577 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:50:38.985641 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.985629 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:50:38.985675 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.985648 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:50:38.988707 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.988691 2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:50:38.990579 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.990565 2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:50:38.992682 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992669 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992686 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992693 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992698 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992707 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992712 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992720 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992728 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992736 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:50:38.992744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992744 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:50:38.993019 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992761 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:50:38.993019 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.992767 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:50:38.993647 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.993636 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:50:38.993677 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.993650 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:50:38.996620 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.996603 2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:50:38.996974 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.996962 2558 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:50:38.997021 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.996998 2558 server.go:1295] "Started kubelet" Jun 02 01:50:38.997180 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.997129 2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:50:38.997180 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:38.997167 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:50:38.997278 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:38.997164 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:50:38.997278 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.997206 2558 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:50:38.999354 ip-10-0-142-223 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:50:38.999544 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.997200 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:50:38.999931 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:38.999724 2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:50:39.004153 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.004134 2558 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:50:39.005943 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.005924 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:50:39.005943 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.005936 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:50:39.006056 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.005972 2558 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:50:39.006056 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.005980 2558 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:50:39.006056 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.005994 2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:50:39.006187 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006068 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:50:39.006187 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006079 2558 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:50:39.006611 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006595 2558 factory.go:55] Registering systemd factory Jun 02 01:50:39.006611 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006613 2558 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:50:39.006749 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.006658 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.006835 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006821 2558 factory.go:153] Registering CRI-O factory Jun 02 01:50:39.006871 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006840 2558 factory.go:223] Registration of the crio container factory successfully Jun 02 01:50:39.006905 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006894 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:50:39.006935 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006914 2558 factory.go:103] Registering Raw factory Jun 02 01:50:39.006963 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.006935 2558 manager.go:1196] Started watching for new ooms in manager Jun 02 01:50:39.007205 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.007196 2558 manager.go:319] Starting recovery of all containers Jun 02 01:50:39.007754 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.007720 2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:50:39.010844 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.010808 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 01:50:39.011532 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.011508 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 01:50:39.011850 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.010903 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-223.ec2.internal.18b52091f7f07218 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-223.ec2.internal,UID:ip-10-0-142-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-223.ec2.internal,},FirstTimestamp:2026-06-02 01:50:38.996976152 +0000 UTC m=+0.423817223,LastTimestamp:2026-06-02 01:50:38.996976152 +0000 UTC m=+0.423817223,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-223.ec2.internal,}" Jun 02 01:50:39.018000 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.017907 2558 manager.go:324] Recovery completed Jun 02 01:50:39.021840 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.021827 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:39.023991 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.023956 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:39.024055 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.023995 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:39.024055 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.024005 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:39.024460 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.024446 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:50:39.024460 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.024458 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:50:39.024594 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.024475 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:50:39.026802 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.026787 2558 policy_none.go:49] "None policy: Start" Jun 02 01:50:39.026874 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.026808 2558 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:50:39.026874 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.026821 2558 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:50:39.032227 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.032150 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-223.ec2.internal.18b52091f98c8ca6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-223.ec2.internal,UID:ip-10-0-142-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-223.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-223.ec2.internal,},FirstTimestamp:2026-06-02 01:50:39.023983782 +0000 UTC m=+0.450824854,LastTimestamp:2026-06-02 01:50:39.023983782 +0000 UTC m=+0.450824854,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-223.ec2.internal,}" Jun 02 01:50:39.044097 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.044038 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-223.ec2.internal.18b52091f98ccbe9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-223.ec2.internal,UID:ip-10-0-142-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-223.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-223.ec2.internal,},FirstTimestamp:2026-06-02 01:50:39.023999977 +0000 UTC m=+0.450841047,LastTimestamp:2026-06-02 01:50:39.023999977 +0000 UTC m=+0.450841047,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-223.ec2.internal,}" Jun 02 01:50:39.054144 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.054080 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-223.ec2.internal.18b52091f98cf16f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-223.ec2.internal,UID:ip-10-0-142-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-223.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-223.ec2.internal,},FirstTimestamp:2026-06-02 01:50:39.024009583 +0000 UTC m=+0.450850655,LastTimestamp:2026-06-02 01:50:39.024009583 +0000 UTC m=+0.450850655,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-223.ec2.internal,}" Jun 02 01:50:39.057521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.057493 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l85fm" Jun 02 01:50:39.065050 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.065031 2558 manager.go:341] "Starting Device Plugin manager" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.065066 2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.065078 2558 server.go:85] "Starting device plugin registration server" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.065274 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.065283 2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.065367 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.065447 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.065453 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.065931 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.065962 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.076234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.067519 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l85fm" Jun 02 01:50:39.104875 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.104853 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:50:39.105972 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.105954 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:50:39.105972 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.105970 2558 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:50:39.106074 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.105985 2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:50:39.106074 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.105992 2558 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:50:39.106074 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.106026 2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:50:39.109375 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.109355 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:39.166345 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.166301 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:39.167319 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.167305 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:39.167373 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.167331 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:39.167373 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.167341 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:39.167373 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.167360 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.176343 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.176326 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.176389 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.176345 2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-223.ec2.internal\": node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.206905 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.206883 2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal"] Jun 02 01:50:39.206968 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.206941 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:39.207128 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.207115 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.207787 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.207772 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:39.207873 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.207801 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:39.207873 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.207827 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:39.209152 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209137 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:39.209284 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209271 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.209327 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209297 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:39.209825 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209811 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:39.209825 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209819 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:39.209935 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209838 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:39.209935 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209838 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:39.209935 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209850 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:39.209935 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.209858 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:39.210988 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.210973 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.211079 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.210995 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:39.211624 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.211605 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:39.211624 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.211627 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:39.211764 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.211641 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:39.235047 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.235028 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-223.ec2.internal\" not found" node="ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.239512 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.239497 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-223.ec2.internal\" not found" node="ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.307520 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.307496 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.407989 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.407958 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.408068 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.408022 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4d8956cc70aced3c2a171d0401f8d5a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-223.ec2.internal\" (UID: \"a4d8956cc70aced3c2a171d0401f8d5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.408068 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.408043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9bd5686652d9b0190011e67d7768421-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal\" (UID: \"b9bd5686652d9b0190011e67d7768421\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.408136 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.408061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9bd5686652d9b0190011e67d7768421-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal\" (UID: \"b9bd5686652d9b0190011e67d7768421\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.508578 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.508562 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.508643 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.508592 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4d8956cc70aced3c2a171d0401f8d5a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-223.ec2.internal\" (UID: \"a4d8956cc70aced3c2a171d0401f8d5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.508643 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.508616 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9bd5686652d9b0190011e67d7768421-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal\" (UID: \"b9bd5686652d9b0190011e67d7768421\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.508643 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.508635 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9bd5686652d9b0190011e67d7768421-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal\" (UID: \"b9bd5686652d9b0190011e67d7768421\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.508773 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.508679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a4d8956cc70aced3c2a171d0401f8d5a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-223.ec2.internal\" (UID: \"a4d8956cc70aced3c2a171d0401f8d5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.508773 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.508675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9bd5686652d9b0190011e67d7768421-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal\" (UID: \"b9bd5686652d9b0190011e67d7768421\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.508773 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.508713 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9bd5686652d9b0190011e67d7768421-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal\" (UID: \"b9bd5686652d9b0190011e67d7768421\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.537732 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.537706 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.543258 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.543243 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" Jun 02 01:50:39.608999 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.608976 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.709354 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.709331 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.809737 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.809691 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.910187 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:39.910163 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-223.ec2.internal\" not found" Jun 02 01:50:39.917347 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.917326 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:50:39.917542 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.917485 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:50:39.976581 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.976561 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:39.984711 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.984692 2558 apiserver.go:52] "Watching apiserver" Jun 02 01:50:39.993914 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.993889 2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:50:39.995599 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.995576 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-dxd9q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5","openshift-cluster-node-tuning-operator/tuned-9r48n","openshift-dns/node-resolver-zfdlf","openshift-image-registry/node-ca-szbhm","openshift-multus/network-metrics-daemon-td25w","openshift-ovn-kubernetes/ovnkube-node-pxgw2","kube-system/konnectivity-agent-mqbdl","openshift-multus/multus-additional-cni-plugins-w6txs","openshift-multus/multus-z9pdz","openshift-network-diagnostics/network-check-target-k2fnv"] Jun 02 01:50:39.996847 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.996827 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:39.998993 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.998973 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:39.999266 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.999246 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:50:39.999333 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.999296 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:50:39.999372 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.999346 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:50:39.999421 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:39.999367 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-krgjr\"" Jun 02 01:50:40.000250 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.000232 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.000335 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.000312 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.001976 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.001581 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ggtl7\"" Jun 02 01:50:40.001976 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.001786 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:50:40.001976 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.001836 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.001976 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.001897 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.002480 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.002308 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.003154 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.002943 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.003235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.003224 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.003851 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.003294 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.003851 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.003472 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.003851 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.003664 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bdlw\"" Jun 02 01:50:40.003851 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.003735 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5wtx\"" Jun 02 01:50:40.004326 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.004284 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:40.004513 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.004474 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:40.006132 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.006042 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:50:40.006230 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.006173 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.006230 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.006222 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" Jun 02 01:50:40.006334 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.006318 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.006392 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.006334 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-59qlj\"" Jun 02 01:50:40.006483 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.006463 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:50:40.007707 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.007692 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.007944 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.007925 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.009022 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.009007 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.009738 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.009719 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:50:40.010222 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010205 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.010420 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d04fa77f-2175-478e-a43f-badbcde3f382-hosts-file\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.010514 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010433 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqz7\" (UniqueName: \"kubernetes.io/projected/d04fa77f-2175-478e-a43f-badbcde3f382-kube-api-access-qfqz7\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.010514 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010459 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-slash\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.010514 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-run-netns\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.010514 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-log-socket\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxhxt\" (UniqueName: \"kubernetes.io/projected/4bd74378-1130-4430-b19a-15ac28885e01-kube-api-access-qxhxt\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-systemd-units\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-var-lib-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010596 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62a3631a-2d33-40ad-b862-b2a7af8ad3ef-agent-certs\") pod \"konnectivity-agent-mqbdl\" (UID: \"62a3631a-2d33-40ad-b862-b2a7af8ad3ef\") " pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysconfig\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysctl-d\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovnkube-script-lib\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010671 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:40.010705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6xzn\" (UniqueName: \"kubernetes.io/projected/928fb900-c296-4c88-807c-ae64652ec392-kube-api-access-s6xzn\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-kubelet\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010731 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76bb6ec9-1b46-4c27-ac37-3dafa30524db-host-slash\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-tuned\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d04fa77f-2175-478e-a43f-badbcde3f382-tmp-dir\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-etc-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010860 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkftz\" (UniqueName: \"kubernetes.io/projected/b37840fc-7d63-46ff-a768-b3d57ad45b95-kube-api-access-pkftz\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-modprobe-d\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-var-lib-kubelet\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010924 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-env-overrides\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010946 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76bb6ec9-1b46-4c27-ac37-3dafa30524db-iptables-alerter-script\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.010992 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-systemd\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g94mm\" (UniqueName: \"kubernetes.io/projected/76bb6ec9-1b46-4c27-ac37-3dafa30524db-kube-api-access-g94mm\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.011113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwxbn\" (UniqueName: \"kubernetes.io/projected/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-kube-api-access-jwxbn\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011085 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-systemd\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011117 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-run\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-socket-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysctl-conf\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-sys-fs\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011283 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-kubernetes\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-lib-modules\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011372 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-cni-bin\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-host\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011416 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b02b7e-df64-4938-b827-5dc74ecd593a-tmp\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-node-log\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovn-node-metrics-cert\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-serviceca\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovnkube-config\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.011828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-device-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-sys\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-cni-netd\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-host\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-ovn\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62a3631a-2d33-40ad-b862-b2a7af8ad3ef-konnectivity-ca\") pod \"konnectivity-agent-mqbdl\" (UID: \"62a3631a-2d33-40ad-b862-b2a7af8ad3ef\") " pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8dxw\" (UniqueName: \"kubernetes.io/projected/a5b02b7e-df64-4938-b827-5dc74ecd593a-kube-api-access-n8dxw\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011755 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011790 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cl5tr\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-registration-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.011835 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-etc-selinux\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.011978 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012214 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012275 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012277 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012340 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q74tj\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012350 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qgc5m\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012438 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.012610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012559 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012647 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6x9wh\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012704 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012766 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012767 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012861 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.012933 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.013040 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:50:40.013361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.013224 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:50:40.018108 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.018066 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d8956cc70aced3c2a171d0401f8d5a.slice/crio-672ed966ff9d6043d4a1c40bf02edc7e80b2ffe9cd3bd22335a784832624dd12 WatchSource:0}: Error finding container 672ed966ff9d6043d4a1c40bf02edc7e80b2ffe9cd3bd22335a784832624dd12: Status 404 returned error can't find the container with id 672ed966ff9d6043d4a1c40bf02edc7e80b2ffe9cd3bd22335a784832624dd12 Jun 02 01:50:40.018326 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.018305 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bd5686652d9b0190011e67d7768421.slice/crio-68222dc5a3ee957dfe639f3f520a99adfb443f08ddeed1bc9474128a6b6b254e WatchSource:0}: Error finding container 68222dc5a3ee957dfe639f3f520a99adfb443f08ddeed1bc9474128a6b6b254e: Status 404 returned error can't find the container with id 68222dc5a3ee957dfe639f3f520a99adfb443f08ddeed1bc9474128a6b6b254e Jun 02 01:50:40.018870 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.018851 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:50:40.018956 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.018914 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" Jun 02 01:50:40.020055 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.020037 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal"] Jun 02 01:50:40.021848 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.021826 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:50:40.027538 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.027519 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:50:40.028506 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.028487 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:40.035682 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.035665 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal"] Jun 02 01:50:40.035949 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.035937 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:50:40.047029 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.047013 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nc24p" Jun 02 01:50:40.057143 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.057126 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nc24p" Jun 02 01:50:40.069363 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.069342 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:45:39 +0000 UTC" deadline="2028-02-08 19:47:26.860781582 +0000 UTC" Jun 02 01:50:40.069435 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.069362 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14801h56m46.791420974s" Jun 02 01:50:40.107666 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.107644 2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:50:40.108539 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.108492 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" event={"ID":"a4d8956cc70aced3c2a171d0401f8d5a","Type":"ContainerStarted","Data":"672ed966ff9d6043d4a1c40bf02edc7e80b2ffe9cd3bd22335a784832624dd12"} Jun 02 01:50:40.109288 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.109272 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" event={"ID":"b9bd5686652d9b0190011e67d7768421","Type":"ContainerStarted","Data":"68222dc5a3ee957dfe639f3f520a99adfb443f08ddeed1bc9474128a6b6b254e"} Jun 02 01:50:40.111980 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.111961 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-registration-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.112068 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.111983 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-etc-selinux\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.112068 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.111998 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d04fa77f-2175-478e-a43f-badbcde3f382-hosts-file\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.112068 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112014 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqz7\" (UniqueName: \"kubernetes.io/projected/d04fa77f-2175-478e-a43f-badbcde3f382-kube-api-access-qfqz7\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.112068 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112030 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-slash\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112080 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-registration-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112090 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-etc-selinux\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d04fa77f-2175-478e-a43f-badbcde3f382-hosts-file\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112122 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-run-netns\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-run-netns\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112146 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-log-socket\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-k8s-cni-cncf-io\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112183 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxhxt\" (UniqueName: \"kubernetes.io/projected/4bd74378-1130-4430-b19a-15ac28885e01-kube-api-access-qxhxt\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-log-socket\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112211 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-systemd-units\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-slash\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112235 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112227 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-var-lib-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112245 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-system-cni-dir\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-systemd-units\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-var-lib-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112309 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62a3631a-2d33-40ad-b862-b2a7af8ad3ef-agent-certs\") pod \"konnectivity-agent-mqbdl\" (UID: \"62a3631a-2d33-40ad-b862-b2a7af8ad3ef\") " pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112331 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysconfig\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112345 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysctl-d\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112360 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovnkube-script-lib\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-netns\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112443 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysconfig\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112468 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6xzn\" (UniqueName: \"kubernetes.io/projected/928fb900-c296-4c88-807c-ae64652ec392-kube-api-access-s6xzn\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysctl-d\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112491 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-kubelet\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-kubelet\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.112560 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112624 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.112744 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.112651 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:40.61260276 +0000 UTC m=+2.039443840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112672 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-cni-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112705 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-cni-multus\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112686 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112725 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76bb6ec9-1b46-4c27-ac37-3dafa30524db-host-slash\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112789 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-tuned\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76bb6ec9-1b46-4c27-ac37-3dafa30524db-host-slash\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112817 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d04fa77f-2175-478e-a43f-badbcde3f382-tmp-dir\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112843 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-etc-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-etc-openvswitch\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112897 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112923 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovnkube-script-lib\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112942 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkftz\" (UniqueName: \"kubernetes.io/projected/b37840fc-7d63-46ff-a768-b3d57ad45b95-kube-api-access-pkftz\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-multus-certs\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.112988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-run-ovn-kubernetes\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113000 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-modprobe-d\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113027 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-var-lib-kubelet\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.113477 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113060 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-env-overrides\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-os-release\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-var-lib-kubelet\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113130 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-modprobe-d\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-conf-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d04fa77f-2175-478e-a43f-badbcde3f382-tmp-dir\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113165 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76bb6ec9-1b46-4c27-ac37-3dafa30524db-iptables-alerter-script\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113196 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113220 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-systemd\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113276 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b02f26a-8e91-4996-83a3-eb441924c7ad-cni-binary-copy\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-systemd\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-kubelet\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113333 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g94mm\" (UniqueName: \"kubernetes.io/projected/76bb6ec9-1b46-4c27-ac37-3dafa30524db-kube-api-access-g94mm\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113359 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwxbn\" (UniqueName: \"kubernetes.io/projected/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-kube-api-access-jwxbn\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113384 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-systemd\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.114234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113423 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-env-overrides\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-systemd\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113509 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-run\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113538 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113590 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-run\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-daemon-config\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113651 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-socket-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113676 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysctl-conf\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-cni-bin\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113728 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-sys-fs\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113752 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-kubernetes\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113764 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-socket-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113774 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-lib-modules\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113778 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-sysctl-conf\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113792 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-sys-fs\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.115023 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113796 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-cni-bin\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113829 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-kubernetes\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113830 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-host\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-cni-bin\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113859 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-host\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113860 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b02b7e-df64-4938-b827-5dc74ecd593a-tmp\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-lib-modules\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113900 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-node-log\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113929 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-node-log\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113946 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovn-node-metrics-cert\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-cnibin\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.113999 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-socket-dir-parent\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114023 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114049 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-serviceca\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114073 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovnkube-config\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-os-release\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114150 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-device-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.115531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114179 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-sys\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114202 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-cni-netd\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4szg\" (UniqueName: \"kubernetes.io/projected/d409a04e-6b2c-4fed-8817-9edd829b9e82-kube-api-access-l4szg\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-etc-kubernetes\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114282 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-host\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114307 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-ovn\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-system-cni-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-hostroot\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114446 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw4h2\" (UniqueName: \"kubernetes.io/projected/3b02f26a-8e91-4996-83a3-eb441924c7ad-kube-api-access-xw4h2\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114473 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62a3631a-2d33-40ad-b862-b2a7af8ad3ef-konnectivity-ca\") pod \"konnectivity-agent-mqbdl\" (UID: \"62a3631a-2d33-40ad-b862-b2a7af8ad3ef\") " pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114501 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8dxw\" (UniqueName: \"kubernetes.io/projected/a5b02b7e-df64-4938-b827-5dc74ecd593a-kube-api-access-n8dxw\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-cnibin\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/928fb900-c296-4c88-807c-ae64652ec392-device-dir\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovnkube-config\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114606 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-host\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-run-ovn\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.116120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5b02b7e-df64-4938-b827-5dc74ecd593a-sys\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b37840fc-7d63-46ff-a768-b3d57ad45b95-host-cni-netd\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76bb6ec9-1b46-4c27-ac37-3dafa30524db-iptables-alerter-script\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.114966 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-serviceca\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.115065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/62a3631a-2d33-40ad-b862-b2a7af8ad3ef-konnectivity-ca\") pod \"konnectivity-agent-mqbdl\" (UID: \"62a3631a-2d33-40ad-b862-b2a7af8ad3ef\") " pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.115772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5b02b7e-df64-4938-b827-5dc74ecd593a-etc-tuned\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.115963 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/62a3631a-2d33-40ad-b862-b2a7af8ad3ef-agent-certs\") pod \"konnectivity-agent-mqbdl\" (UID: \"62a3631a-2d33-40ad-b862-b2a7af8ad3ef\") " pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.116095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b02b7e-df64-4938-b827-5dc74ecd593a-tmp\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.116882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.116230 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b37840fc-7d63-46ff-a768-b3d57ad45b95-ovn-node-metrics-cert\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.124140 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.124115 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwxbn\" (UniqueName: \"kubernetes.io/projected/5163a79b-ba0d-424f-a8c2-6f6d203a3ce1-kube-api-access-jwxbn\") pod \"node-ca-szbhm\" (UID: \"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1\") " pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.124234 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.124148 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8dxw\" (UniqueName: \"kubernetes.io/projected/a5b02b7e-df64-4938-b827-5dc74ecd593a-kube-api-access-n8dxw\") pod \"tuned-9r48n\" (UID: \"a5b02b7e-df64-4938-b827-5dc74ecd593a\") " pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.124528 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.124509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqz7\" (UniqueName: \"kubernetes.io/projected/d04fa77f-2175-478e-a43f-badbcde3f382-kube-api-access-qfqz7\") pod \"node-resolver-zfdlf\" (UID: \"d04fa77f-2175-478e-a43f-badbcde3f382\") " pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.124597 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.124582 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxhxt\" (UniqueName: \"kubernetes.io/projected/4bd74378-1130-4430-b19a-15ac28885e01-kube-api-access-qxhxt\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:40.124638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.124606 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g94mm\" (UniqueName: \"kubernetes.io/projected/76bb6ec9-1b46-4c27-ac37-3dafa30524db-kube-api-access-g94mm\") pod \"iptables-alerter-dxd9q\" (UID: \"76bb6ec9-1b46-4c27-ac37-3dafa30524db\") " pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.124723 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.124709 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6xzn\" (UniqueName: \"kubernetes.io/projected/928fb900-c296-4c88-807c-ae64652ec392-kube-api-access-s6xzn\") pod \"aws-ebs-csi-driver-node-cshp5\" (UID: \"928fb900-c296-4c88-807c-ae64652ec392\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.124762 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.124732 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkftz\" (UniqueName: \"kubernetes.io/projected/b37840fc-7d63-46ff-a768-b3d57ad45b95-kube-api-access-pkftz\") pod \"ovnkube-node-pxgw2\" (UID: \"b37840fc-7d63-46ff-a768-b3d57ad45b95\") " pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.215006 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.214981 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-netns\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215101 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215024 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-cni-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215101 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215047 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-cni-multus\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215101 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215074 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-multus-certs\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215101 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215099 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-cni-multus\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215101 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-os-release\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215100 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-cni-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215076 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-netns\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215126 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-conf-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-multus-certs\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215171 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215183 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-conf-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215194 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-os-release\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b02f26a-8e91-4996-83a3-eb441924c7ad-cni-binary-copy\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215233 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-kubelet\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215251 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.215280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215271 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-daemon-config\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215296 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-cni-bin\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215301 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-kubelet\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215327 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-cnibin\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215361 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-cnibin\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215370 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-var-lib-cni-bin\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215427 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-socket-dir-parent\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215431 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215456 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215462 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-socket-dir-parent\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215475 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215492 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-os-release\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215514 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4szg\" (UniqueName: \"kubernetes.io/projected/d409a04e-6b2c-4fed-8817-9edd829b9e82-kube-api-access-l4szg\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215539 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-etc-kubernetes\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215563 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-os-release\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215563 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215607 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-etc-kubernetes\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215651 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-system-cni-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215682 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-hostroot\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215712 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw4h2\" (UniqueName: \"kubernetes.io/projected/3b02f26a-8e91-4996-83a3-eb441924c7ad-kube-api-access-xw4h2\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215741 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-cnibin\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215756 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-system-cni-dir\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215773 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-k8s-cni-cncf-io\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215806 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-system-cni-dir\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215824 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-hostroot\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215825 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-cnibin\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215854 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b02f26a-8e91-4996-83a3-eb441924c7ad-multus-daemon-config\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b02f26a-8e91-4996-83a3-eb441924c7ad-host-run-k8s-cni-cncf-io\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215857 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b02f26a-8e91-4996-83a3-eb441924c7ad-cni-binary-copy\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215907 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d409a04e-6b2c-4fed-8817-9edd829b9e82-system-cni-dir\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.215929 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-cni-binary-copy\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.216015 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.216638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.216318 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d409a04e-6b2c-4fed-8817-9edd829b9e82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.226066 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.226050 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:40.226120 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.226066 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:40.226120 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.226076 2558 projected.go:194] Error preparing data for projected volume kube-api-access-qvbfs for pod openshift-network-diagnostics/network-check-target-k2fnv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:40.226176 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.226127 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs podName:adf087f9-b192-4b64-b4b5-fbad249d8a12 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:40.726112602 +0000 UTC m=+2.152953679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qvbfs" (UniqueName: "kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs") pod "network-check-target-k2fnv" (UID: "adf087f9-b192-4b64-b4b5-fbad249d8a12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:40.228008 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.227989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4szg\" (UniqueName: \"kubernetes.io/projected/d409a04e-6b2c-4fed-8817-9edd829b9e82-kube-api-access-l4szg\") pod \"multus-additional-cni-plugins-w6txs\" (UID: \"d409a04e-6b2c-4fed-8817-9edd829b9e82\") " pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.228092 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.228077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw4h2\" (UniqueName: \"kubernetes.io/projected/3b02f26a-8e91-4996-83a3-eb441924c7ad-kube-api-access-xw4h2\") pod \"multus-z9pdz\" (UID: \"3b02f26a-8e91-4996-83a3-eb441924c7ad\") " pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.246588 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.246571 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:40.323967 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.323918 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxd9q" Jun 02 01:50:40.329605 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.329583 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bb6ec9_1b46_4c27_ac37_3dafa30524db.slice/crio-e7082a64e6abe33f697428b6bfa415932173f58a90df81b7b991912a5a78496f WatchSource:0}: Error finding container e7082a64e6abe33f697428b6bfa415932173f58a90df81b7b991912a5a78496f: Status 404 returned error can't find the container with id e7082a64e6abe33f697428b6bfa415932173f58a90df81b7b991912a5a78496f Jun 02 01:50:40.330243 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.330227 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" Jun 02 01:50:40.337107 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.337090 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9r48n" Jun 02 01:50:40.337953 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.337926 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928fb900_c296_4c88_807c_ae64652ec392.slice/crio-c4fdc00dc0f244d2f522af4cfa884f9ad78dc4200fbf44b9b1ce10090f3f5fea WatchSource:0}: Error finding container c4fdc00dc0f244d2f522af4cfa884f9ad78dc4200fbf44b9b1ce10090f3f5fea: Status 404 returned error can't find the container with id c4fdc00dc0f244d2f522af4cfa884f9ad78dc4200fbf44b9b1ce10090f3f5fea Jun 02 01:50:40.341839 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.341821 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zfdlf" Jun 02 01:50:40.343842 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.343820 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b02b7e_df64_4938_b827_5dc74ecd593a.slice/crio-115a431b924b2f0c72ecd949c4b5c2d005f3be285be470418ccf19e9c4fd3251 WatchSource:0}: Error finding container 115a431b924b2f0c72ecd949c4b5c2d005f3be285be470418ccf19e9c4fd3251: Status 404 returned error can't find the container with id 115a431b924b2f0c72ecd949c4b5c2d005f3be285be470418ccf19e9c4fd3251 Jun 02 01:50:40.347114 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.347084 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-szbhm" Jun 02 01:50:40.349031 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.349009 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04fa77f_2175_478e_a43f_badbcde3f382.slice/crio-22aa2e4ca5399f22ba8286e07979b1572a54e0e00f11d64763d7e2e1c97de777 WatchSource:0}: Error finding container 22aa2e4ca5399f22ba8286e07979b1572a54e0e00f11d64763d7e2e1c97de777: Status 404 returned error can't find the container with id 22aa2e4ca5399f22ba8286e07979b1572a54e0e00f11d64763d7e2e1c97de777 Jun 02 01:50:40.352795 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.352760 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:50:40.354098 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.354075 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5163a79b_ba0d_424f_a8c2_6f6d203a3ce1.slice/crio-bd0ded2dafa7dbe667b7bae1292f5e2874cd29d6ed15072a79e6f5e95ef6004a WatchSource:0}: Error finding container bd0ded2dafa7dbe667b7bae1292f5e2874cd29d6ed15072a79e6f5e95ef6004a: Status 404 returned error can't find the container with id bd0ded2dafa7dbe667b7bae1292f5e2874cd29d6ed15072a79e6f5e95ef6004a Jun 02 01:50:40.357068 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.357048 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:40.359519 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.359498 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37840fc_7d63_46ff_a768_b3d57ad45b95.slice/crio-143a8e4f98085290f09473b3b324768b5abb780c179d688b632b0169b3cb64bb WatchSource:0}: Error finding container 143a8e4f98085290f09473b3b324768b5abb780c179d688b632b0169b3cb64bb: Status 404 returned error can't find the container with id 143a8e4f98085290f09473b3b324768b5abb780c179d688b632b0169b3cb64bb Jun 02 01:50:40.364720 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.364703 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w6txs" Jun 02 01:50:40.364810 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.364777 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a3631a_2d33_40ad_b862_b2a7af8ad3ef.slice/crio-db11c3d95a75139ce0e1b719caa9bbe5604304294a4036710a850d3739afea4b WatchSource:0}: Error finding container db11c3d95a75139ce0e1b719caa9bbe5604304294a4036710a850d3739afea4b: Status 404 returned error can't find the container with id db11c3d95a75139ce0e1b719caa9bbe5604304294a4036710a850d3739afea4b Jun 02 01:50:40.369272 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.369254 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9pdz" Jun 02 01:50:40.370942 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.370917 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd409a04e_6b2c_4fed_8817_9edd829b9e82.slice/crio-2ba53700e398b67aad7ef8548e5631a378ddfabbbf9c28ad88d6f664fd504cc1 WatchSource:0}: Error finding container 2ba53700e398b67aad7ef8548e5631a378ddfabbbf9c28ad88d6f664fd504cc1: Status 404 returned error can't find the container with id 2ba53700e398b67aad7ef8548e5631a378ddfabbbf9c28ad88d6f664fd504cc1 Jun 02 01:50:40.376601 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:50:40.376580 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b02f26a_8e91_4996_83a3_eb441924c7ad.slice/crio-298fa37849733f316c54e988f81bc529456d1ecbb4d7490bb58c397505f428a1 WatchSource:0}: Error finding container 298fa37849733f316c54e988f81bc529456d1ecbb4d7490bb58c397505f428a1: Status 404 returned error can't find the container with id 298fa37849733f316c54e988f81bc529456d1ecbb4d7490bb58c397505f428a1 Jun 02 01:50:40.619385 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.619303 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:40.619554 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.619513 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:40.619617 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.619578 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:41.619557921 +0000 UTC m=+3.046399003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:40.821228 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.821192 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:40.821499 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.821478 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:40.821587 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.821509 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:40.821587 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.821523 2558 projected.go:194] Error preparing data for projected volume kube-api-access-qvbfs for pod openshift-network-diagnostics/network-check-target-k2fnv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:40.821705 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:40.821587 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs podName:adf087f9-b192-4b64-b4b5-fbad249d8a12 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:41.821568742 +0000 UTC m=+3.248409804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvbfs" (UniqueName: "kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs") pod "network-check-target-k2fnv" (UID: "adf087f9-b192-4b64-b4b5-fbad249d8a12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:40.924431 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:40.924355 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:41.058370 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.058330 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:45:40 +0000 UTC" deadline="2028-02-23 20:35:57.902934724 +0000 UTC" Jun 02 01:50:41.058370 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.058374 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15162h45m16.844565133s" Jun 02 01:50:41.114446 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.114393 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-szbhm" event={"ID":"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1","Type":"ContainerStarted","Data":"bd0ded2dafa7dbe667b7bae1292f5e2874cd29d6ed15072a79e6f5e95ef6004a"} Jun 02 01:50:41.118184 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.118155 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zfdlf" event={"ID":"d04fa77f-2175-478e-a43f-badbcde3f382","Type":"ContainerStarted","Data":"22aa2e4ca5399f22ba8286e07979b1572a54e0e00f11d64763d7e2e1c97de777"} Jun 02 01:50:41.122186 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.122158 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxd9q" event={"ID":"76bb6ec9-1b46-4c27-ac37-3dafa30524db","Type":"ContainerStarted","Data":"e7082a64e6abe33f697428b6bfa415932173f58a90df81b7b991912a5a78496f"} Jun 02 01:50:41.126659 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.126633 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqbdl" event={"ID":"62a3631a-2d33-40ad-b862-b2a7af8ad3ef","Type":"ContainerStarted","Data":"db11c3d95a75139ce0e1b719caa9bbe5604304294a4036710a850d3739afea4b"} Jun 02 01:50:41.131890 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.131766 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"143a8e4f98085290f09473b3b324768b5abb780c179d688b632b0169b3cb64bb"} Jun 02 01:50:41.143270 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.143245 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9r48n" event={"ID":"a5b02b7e-df64-4938-b827-5dc74ecd593a","Type":"ContainerStarted","Data":"115a431b924b2f0c72ecd949c4b5c2d005f3be285be470418ccf19e9c4fd3251"} Jun 02 01:50:41.144667 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.144644 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" event={"ID":"928fb900-c296-4c88-807c-ae64652ec392","Type":"ContainerStarted","Data":"c4fdc00dc0f244d2f522af4cfa884f9ad78dc4200fbf44b9b1ce10090f3f5fea"} Jun 02 01:50:41.157651 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.157627 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9pdz" event={"ID":"3b02f26a-8e91-4996-83a3-eb441924c7ad","Type":"ContainerStarted","Data":"298fa37849733f316c54e988f81bc529456d1ecbb4d7490bb58c397505f428a1"} Jun 02 01:50:41.168111 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.168087 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerStarted","Data":"2ba53700e398b67aad7ef8548e5631a378ddfabbbf9c28ad88d6f664fd504cc1"} Jun 02 01:50:41.415785 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.415753 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pxh7h"] Jun 02 01:50:41.417816 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.417797 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.417937 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.417879 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:41.532071 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.531864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.532071 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.531917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20b042ec-3d12-4d9d-bd6a-7b4be48de194-dbus\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.532071 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.531975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20b042ec-3d12-4d9d-bd6a-7b4be48de194-kubelet-config\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.633245 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.633206 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.633395 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.633264 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20b042ec-3d12-4d9d-bd6a-7b4be48de194-dbus\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.633395 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.633297 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:41.633395 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.633337 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20b042ec-3d12-4d9d-bd6a-7b4be48de194-kubelet-config\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.633593 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.633444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20b042ec-3d12-4d9d-bd6a-7b4be48de194-kubelet-config\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.633593 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.633547 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:41.633701 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.633604 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret podName:20b042ec-3d12-4d9d-bd6a-7b4be48de194 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:42.133584952 +0000 UTC m=+3.560426013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret") pod "global-pull-secret-syncer-pxh7h" (UID: "20b042ec-3d12-4d9d-bd6a-7b4be48de194") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:41.634107 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.633944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20b042ec-3d12-4d9d-bd6a-7b4be48de194-dbus\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:41.634107 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.634033 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:41.634107 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.634079 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:43.634064192 +0000 UTC m=+5.060905251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:41.835071 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:41.835037 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:41.835270 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.835247 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:41.835270 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.835271 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:41.835412 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.835284 2558 projected.go:194] Error preparing data for projected volume kube-api-access-qvbfs for pod openshift-network-diagnostics/network-check-target-k2fnv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:41.835412 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:41.835344 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs podName:adf087f9-b192-4b64-b4b5-fbad249d8a12 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:43.835325916 +0000 UTC m=+5.262166980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvbfs" (UniqueName: "kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs") pod "network-check-target-k2fnv" (UID: "adf087f9-b192-4b64-b4b5-fbad249d8a12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:42.059574 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:42.059494 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:45:40 +0000 UTC" deadline="2027-11-22 21:51:30.049254825 +0000 UTC" Jun 02 01:50:42.059574 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:42.059542 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12932h0m47.989716538s" Jun 02 01:50:42.107193 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:42.106470 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:42.107193 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:42.106601 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:42.107193 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:42.107002 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:42.107193 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:42.107096 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:42.137355 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:42.136860 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:42.137355 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:42.136995 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:42.137355 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:42.137049 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret podName:20b042ec-3d12-4d9d-bd6a-7b4be48de194 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:43.137030008 +0000 UTC m=+4.563871081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret") pod "global-pull-secret-syncer-pxh7h" (UID: "20b042ec-3d12-4d9d-bd6a-7b4be48de194") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:43.108696 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:43.107040 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:43.108696 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.107173 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:43.145942 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:43.145914 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:43.146123 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.146094 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:43.146193 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.146161 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret podName:20b042ec-3d12-4d9d-bd6a-7b4be48de194 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:45.146143001 +0000 UTC m=+6.572984085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret") pod "global-pull-secret-syncer-pxh7h" (UID: "20b042ec-3d12-4d9d-bd6a-7b4be48de194") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:43.650161 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:43.649926 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:43.650161 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.650089 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:43.650161 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.650147 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:47.650129246 +0000 UTC m=+9.076970311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:43.851846 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:43.851806 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:43.852015 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.851992 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:43.852085 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.852023 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:43.852085 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.852036 2558 projected.go:194] Error preparing data for projected volume kube-api-access-qvbfs for pod openshift-network-diagnostics/network-check-target-k2fnv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:43.852188 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:43.852097 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs podName:adf087f9-b192-4b64-b4b5-fbad249d8a12 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:47.85207749 +0000 UTC m=+9.278918574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvbfs" (UniqueName: "kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs") pod "network-check-target-k2fnv" (UID: "adf087f9-b192-4b64-b4b5-fbad249d8a12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:44.106514 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:44.106479 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:44.106672 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:44.106484 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:44.106672 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:44.106602 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:44.106790 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:44.106673 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:45.106424 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:45.106379 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:45.106799 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:45.106524 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:45.163578 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:45.163430 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:45.163714 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:45.163594 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:45.163714 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:45.163651 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret podName:20b042ec-3d12-4d9d-bd6a-7b4be48de194 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:49.163633729 +0000 UTC m=+10.590474788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret") pod "global-pull-secret-syncer-pxh7h" (UID: "20b042ec-3d12-4d9d-bd6a-7b4be48de194") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:46.107240 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:46.107204 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:46.107725 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:46.107348 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:46.107725 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:46.107211 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:46.107840 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:46.107786 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:47.107536 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:47.107153 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:47.107536 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:47.107248 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:47.683939 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:47.683902 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:47.684115 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:47.684074 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:47.684181 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:47.684156 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:55.684135597 +0000 UTC m=+17.110976669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:47.885919 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:47.885889 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:47.886093 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:47.886004 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:47.886093 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:47.886018 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:47.886093 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:47.886027 2558 projected.go:194] Error preparing data for projected volume kube-api-access-qvbfs for pod openshift-network-diagnostics/network-check-target-k2fnv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:47.886093 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:47.886076 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs podName:adf087f9-b192-4b64-b4b5-fbad249d8a12 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:55.886061593 +0000 UTC m=+17.312902672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvbfs" (UniqueName: "kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs") pod "network-check-target-k2fnv" (UID: "adf087f9-b192-4b64-b4b5-fbad249d8a12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:48.106864 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:48.106835 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:48.106864 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:48.106855 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:48.107054 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:48.106945 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:48.107106 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:48.107057 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:49.107369 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:49.107336 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:49.107900 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:49.107464 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:49.197589 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:49.197547 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:49.197761 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:49.197710 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:49.197761 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:49.197753 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret podName:20b042ec-3d12-4d9d-bd6a-7b4be48de194 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:57.197739433 +0000 UTC m=+18.624580491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret") pod "global-pull-secret-syncer-pxh7h" (UID: "20b042ec-3d12-4d9d-bd6a-7b4be48de194") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:50.106968 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:50.106313 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:50.106968 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:50.106461 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:50.106968 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:50.106555 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:50.106968 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:50.106623 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:51.107637 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:51.107157 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:51.107637 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:51.107504 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:51.195449 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:51.195392 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9r48n" event={"ID":"a5b02b7e-df64-4938-b827-5dc74ecd593a","Type":"ContainerStarted","Data":"72dea19b690dd3f4d7a9b97f3bf5da2ec76911846d3e1016ea8367b2ff7a3704"} Jun 02 01:50:51.197830 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:51.197801 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" event={"ID":"a4d8956cc70aced3c2a171d0401f8d5a","Type":"ContainerStarted","Data":"4a5fd2217a56a7ec4582ca5d116e49ad05490cd60a403d061770044115af853a"} Jun 02 01:50:51.221989 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:51.221678 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9r48n" podStartSLOduration=2.071825563 podStartE2EDuration="12.22166452s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.345767338 +0000 UTC m=+1.772608408" lastFinishedPulling="2026-06-02 01:50:50.495606295 +0000 UTC m=+11.922447365" observedRunningTime="2026-06-02 01:50:51.2212376 +0000 UTC m=+12.648078682" watchObservedRunningTime="2026-06-02 01:50:51.22166452 +0000 UTC m=+12.648505609" Jun 02 01:50:51.235910 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:51.235877 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-223.ec2.internal" podStartSLOduration=11.235867298 podStartE2EDuration="11.235867298s" podCreationTimestamp="2026-06-02 01:50:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:51.235566235 +0000 UTC m=+12.662407316" watchObservedRunningTime="2026-06-02 01:50:51.235867298 +0000 UTC m=+12.662708377" Jun 02 01:50:52.106517 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.106455 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:52.106688 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.106464 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:52.106688 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:52.106565 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:52.106688 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:52.106654 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:52.200845 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.200811 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" event={"ID":"928fb900-c296-4c88-807c-ae64652ec392","Type":"ContainerStarted","Data":"e2b2bcb55484aa0b944467346f4c79bc873eb5183caa584733f3cb7ac689137a"} Jun 02 01:50:52.202299 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.202270 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" event={"ID":"b9bd5686652d9b0190011e67d7768421","Type":"ContainerStarted","Data":"66f11337d41d6597c0fe74de240398aa6437b9079543e56352064d7e5437fd81"} Jun 02 01:50:52.203803 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.203752 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerStarted","Data":"9aaca00aed9b6e0bf1f3c25feba4a32d661b29889abaf12aaa358cfac4155e8c"} Jun 02 01:50:52.205247 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.205223 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-szbhm" event={"ID":"5163a79b-ba0d-424f-a8c2-6f6d203a3ce1","Type":"ContainerStarted","Data":"a494a760d27ceef8972dc00e829b9102426b1f05ae464fca972a2aa991743b37"} Jun 02 01:50:52.206726 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.206659 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zfdlf" event={"ID":"d04fa77f-2175-478e-a43f-badbcde3f382","Type":"ContainerStarted","Data":"59d1cae0c65c882ed64043ad9b48f4a5fd6b17621dcdcc9fc005ee8d85f61314"} Jun 02 01:50:52.208060 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.208041 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxd9q" event={"ID":"76bb6ec9-1b46-4c27-ac37-3dafa30524db","Type":"ContainerStarted","Data":"728da8880ced653d37f0c1aca8163c5c2c1c8379ac233a880b1d23d1f8460acc"} Jun 02 01:50:52.209282 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.209258 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqbdl" event={"ID":"62a3631a-2d33-40ad-b862-b2a7af8ad3ef","Type":"ContainerStarted","Data":"ec0b313d6cbfca2f03562f8a1943cc1a9ddc2282eab3ab363ca563df387cd951"} Jun 02 01:50:52.232647 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.232611 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dxd9q" podStartSLOduration=3.124077544 podStartE2EDuration="13.232599957s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.331178171 +0000 UTC m=+1.758019229" lastFinishedPulling="2026-06-02 01:50:50.439700571 +0000 UTC m=+11.866541642" observedRunningTime="2026-06-02 01:50:52.231922765 +0000 UTC m=+13.658763845" watchObservedRunningTime="2026-06-02 01:50:52.232599957 +0000 UTC m=+13.659441037" Jun 02 01:50:52.244902 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.244862 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zfdlf" podStartSLOduration=3.155818017 podStartE2EDuration="13.244852039s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.350958267 +0000 UTC m=+1.777799326" lastFinishedPulling="2026-06-02 01:50:50.439992276 +0000 UTC m=+11.866833348" observedRunningTime="2026-06-02 01:50:52.244413688 +0000 UTC m=+13.671254761" watchObservedRunningTime="2026-06-02 01:50:52.244852039 +0000 UTC m=+13.671693119" Jun 02 01:50:52.275418 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.275370 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-szbhm" podStartSLOduration=3.190856838 podStartE2EDuration="13.275360038s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.356030715 +0000 UTC m=+1.782871788" lastFinishedPulling="2026-06-02 01:50:50.440533918 +0000 UTC m=+11.867374988" observedRunningTime="2026-06-02 01:50:52.275138291 +0000 UTC m=+13.701979372" watchObservedRunningTime="2026-06-02 01:50:52.275360038 +0000 UTC m=+13.702201118" Jun 02 01:50:52.288118 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.288082 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mqbdl" podStartSLOduration=3.228511029 podStartE2EDuration="13.288072779s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.367638193 +0000 UTC m=+1.794479254" lastFinishedPulling="2026-06-02 01:50:50.427199942 +0000 UTC m=+11.854041004" observedRunningTime="2026-06-02 01:50:52.287873546 +0000 UTC m=+13.714714620" watchObservedRunningTime="2026-06-02 01:50:52.288072779 +0000 UTC m=+13.714913862" Jun 02 01:50:52.864324 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.864145 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:52.864856 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:52.864838 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:53.106533 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:53.106505 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:53.106704 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:53.106650 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:54.028567 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:54.028533 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:54.029159 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:54.029128 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mqbdl" Jun 02 01:50:54.106165 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:54.106135 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:54.106165 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:54.106142 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:54.106364 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:54.106229 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:54.106450 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:54.106365 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:55.106831 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:55.106797 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:55.107327 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:55.106930 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:55.751060 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:55.751027 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:55.751268 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:55.751131 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:55.751268 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:55.751181 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:11.751167369 +0000 UTC m=+33.178008428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:55.952856 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:55.952823 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:55.953023 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:55.953004 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:55.953023 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:55.953023 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:55.953122 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:55.953035 2558 projected.go:194] Error preparing data for projected volume kube-api-access-qvbfs for pod openshift-network-diagnostics/network-check-target-k2fnv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:55.953122 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:55.953090 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs podName:adf087f9-b192-4b64-b4b5-fbad249d8a12 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:11.953071658 +0000 UTC m=+33.379912731 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvbfs" (UniqueName: "kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs") pod "network-check-target-k2fnv" (UID: "adf087f9-b192-4b64-b4b5-fbad249d8a12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:56.106310 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:56.106242 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:56.106456 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:56.106242 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:56.106456 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:56.106365 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:56.106456 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:56.106429 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:56.216884 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:56.216849 2558 generic.go:358] "Generic (PLEG): container finished" podID="b9bd5686652d9b0190011e67d7768421" containerID="66f11337d41d6597c0fe74de240398aa6437b9079543e56352064d7e5437fd81" exitCode=0 Jun 02 01:50:56.217566 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:56.216924 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" event={"ID":"b9bd5686652d9b0190011e67d7768421","Type":"ContainerDied","Data":"66f11337d41d6597c0fe74de240398aa6437b9079543e56352064d7e5437fd81"} Jun 02 01:50:56.218247 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:56.218219 2558 generic.go:358] "Generic (PLEG): container finished" podID="d409a04e-6b2c-4fed-8817-9edd829b9e82" containerID="9aaca00aed9b6e0bf1f3c25feba4a32d661b29889abaf12aaa358cfac4155e8c" exitCode=0 Jun 02 01:50:56.218359 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:56.218261 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerDied","Data":"9aaca00aed9b6e0bf1f3c25feba4a32d661b29889abaf12aaa358cfac4155e8c"} Jun 02 01:50:57.106927 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:57.106894 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:57.107081 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:57.107022 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:57.264172 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:57.264142 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:57.264597 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:57.264247 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:57.264597 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:57.264299 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret podName:20b042ec-3d12-4d9d-bd6a-7b4be48de194 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:13.264283514 +0000 UTC m=+34.691124575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret") pod "global-pull-secret-syncer-pxh7h" (UID: "20b042ec-3d12-4d9d-bd6a-7b4be48de194") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:58.107025 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:58.106999 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:50:58.107200 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:58.107001 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:50:58.107200 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:58.107095 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:50:58.107320 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:58.107192 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:50:59.107452 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:59.107421 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:50:59.107913 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:50:59.107500 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:50:59.514025 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:50:59.513809 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:51:00.082141 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.081919 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:50:59.514008863Z","UUID":"fa015d21-36a2-4e14-9818-90f378fc7b52","Handler":null,"Name":"","Endpoint":""} Jun 02 01:51:00.085059 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.085026 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:51:00.085180 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.085069 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:51:00.106542 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.106507 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:00.106684 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.106524 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:00.106684 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:00.106636 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:51:00.106821 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:00.106733 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:51:00.229515 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.229280 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"39f3113bf9e10a1f5967dd2c93aa808c1e00b7c19cbf96b13f2b2c203fccc13b"} Jun 02 01:51:00.230062 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.229529 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"36111cf37c73ea0559849bd7cf24dc38cf152ca298fdb027b9be1fdc67b3b17e"} Jun 02 01:51:00.230062 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.229547 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"a7cdd3f231c46c1d5a2f59fc8ed9f26d356f551938b47809c91e886157cecd07"} Jun 02 01:51:00.230062 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.229560 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"9e4f568c72767404a604262fcd7fe5819a70c49edff3d8fc4e3085a787feb334"} Jun 02 01:51:00.230062 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.229572 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"df9353b02b0af667ab28718b1ed49910b47fe5f857f13b18566a782b10db16fd"} Jun 02 01:51:00.230062 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.229585 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"eccf4b8e207857179d23f9a1f823241f24e507711e86523745493fc2ff938f5d"} Jun 02 01:51:00.231266 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.231235 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" event={"ID":"928fb900-c296-4c88-807c-ae64652ec392","Type":"ContainerStarted","Data":"c97c38232088fd2495b8267dfce576dbf5404b5622dc0a9370f95966be57ceea"} Jun 02 01:51:00.233123 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.233095 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" event={"ID":"b9bd5686652d9b0190011e67d7768421","Type":"ContainerStarted","Data":"52a36e7d70829945fc743d9a428aee814f32f67ac9aaf6ff14a8e95ab5ff9c01"} Jun 02 01:51:00.234896 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.234872 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9pdz" event={"ID":"3b02f26a-8e91-4996-83a3-eb441924c7ad","Type":"ContainerStarted","Data":"3c2ea4371e91671891db12f1b31e812126a349d9341135b28575e6a8cc12178f"} Jun 02 01:51:00.248263 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.248224 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-223.ec2.internal" podStartSLOduration=20.24820853 podStartE2EDuration="20.24820853s" podCreationTimestamp="2026-06-02 01:50:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:51:00.247908477 +0000 UTC m=+21.674749560" watchObservedRunningTime="2026-06-02 01:51:00.24820853 +0000 UTC m=+21.675049612" Jun 02 01:51:00.264767 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:00.264728 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-z9pdz" podStartSLOduration=2.241519871 podStartE2EDuration="21.264693701s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.378266555 +0000 UTC m=+1.805107612" lastFinishedPulling="2026-06-02 01:50:59.401440369 +0000 UTC m=+20.828281442" observedRunningTime="2026-06-02 01:51:00.264030201 +0000 UTC m=+21.690871280" watchObservedRunningTime="2026-06-02 01:51:00.264693701 +0000 UTC m=+21.691534782" Jun 02 01:51:01.106383 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:01.106344 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:01.106672 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:01.106488 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:51:01.238549 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:01.238516 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" event={"ID":"928fb900-c296-4c88-807c-ae64652ec392","Type":"ContainerStarted","Data":"9b895ab75b1af34ed3d5b50faab464083eedb77e05465f9f860c5e74267f2ddc"} Jun 02 01:51:01.255956 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:01.255914 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cshp5" podStartSLOduration=1.960307512 podStartE2EDuration="22.255901768s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.340413524 +0000 UTC m=+1.767254581" lastFinishedPulling="2026-06-02 01:51:00.636007764 +0000 UTC m=+22.062848837" observedRunningTime="2026-06-02 01:51:01.255888129 +0000 UTC m=+22.682729230" watchObservedRunningTime="2026-06-02 01:51:01.255901768 +0000 UTC m=+22.682742843" Jun 02 01:51:02.106361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:02.106280 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:02.106361 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:02.106297 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:02.106602 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:02.106423 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:51:02.106602 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:02.106528 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:51:03.106466 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:03.106439 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:03.106916 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:03.106550 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:51:03.244903 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:03.244876 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"d8520945d6324049af4db6bb9bc0d3230b2d6f3720ee8e40fc06906a03450543"} Jun 02 01:51:04.106459 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:04.106429 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:04.106459 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:04.106446 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:04.106905 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:04.106531 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:51:04.106905 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:04.106633 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:51:04.247973 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:04.247949 2558 generic.go:358] "Generic (PLEG): container finished" podID="d409a04e-6b2c-4fed-8817-9edd829b9e82" containerID="9942e8f6a8b0a72ed86b1c4300820eb0fe8c44340e6376a7152a93e365462f02" exitCode=0 Jun 02 01:51:04.248082 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:04.247982 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerDied","Data":"9942e8f6a8b0a72ed86b1c4300820eb0fe8c44340e6376a7152a93e365462f02"} Jun 02 01:51:05.106319 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:05.106295 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:05.106446 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:05.106431 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:51:05.250983 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:05.250956 2558 generic.go:358] "Generic (PLEG): container finished" podID="d409a04e-6b2c-4fed-8817-9edd829b9e82" containerID="1a8d8fd5d034cf2f75b4b340639c0ae19fa092ea72e81bc3125a68a00ae10948" exitCode=0 Jun 02 01:51:05.251505 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:05.250995 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerDied","Data":"1a8d8fd5d034cf2f75b4b340639c0ae19fa092ea72e81bc3125a68a00ae10948"} Jun 02 01:51:06.107093 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.106938 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:06.107251 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.106950 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:06.107251 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:06.107159 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:51:06.107251 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:06.107234 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:51:06.255232 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.255197 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" event={"ID":"b37840fc-7d63-46ff-a768-b3d57ad45b95","Type":"ContainerStarted","Data":"90b44954f042a30b4a81b63fe7586fdcf67694bb969333f642a6d0f56a68102f"} Jun 02 01:51:06.255605 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.255581 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:51:06.255673 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.255620 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:51:06.255673 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.255634 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:51:06.257449 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.257424 2558 generic.go:358] "Generic (PLEG): container finished" podID="d409a04e-6b2c-4fed-8817-9edd829b9e82" containerID="cf43f0ab564bc49f865dabd4182068226e4e6e1cfad2ee2717b69c4e2d4b6e26" exitCode=0 Jun 02 01:51:06.257534 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.257462 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerDied","Data":"cf43f0ab564bc49f865dabd4182068226e4e6e1cfad2ee2717b69c4e2d4b6e26"} Jun 02 01:51:06.269833 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.269812 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:51:06.269918 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.269906 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:51:06.279722 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:06.279683 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" podStartSLOduration=8.276757759 podStartE2EDuration="27.279669517s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.361321751 +0000 UTC m=+1.788162824" lastFinishedPulling="2026-06-02 01:50:59.364233509 +0000 UTC m=+20.791074582" observedRunningTime="2026-06-02 01:51:06.278529951 +0000 UTC m=+27.705371032" watchObservedRunningTime="2026-06-02 01:51:06.279669517 +0000 UTC m=+27.706510589" Jun 02 01:51:07.106506 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:07.106461 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:07.106691 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:07.106584 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:51:07.686913 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:07.686882 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pxh7h"] Jun 02 01:51:07.687294 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:07.686999 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:07.687294 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:07.687119 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:51:07.689981 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:07.689812 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k2fnv"] Jun 02 01:51:07.689981 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:07.689920 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:07.690141 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:07.690003 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:51:07.690480 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:07.690368 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-td25w"] Jun 02 01:51:07.690480 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:07.690485 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:07.690629 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:07.690575 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:51:09.107521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:09.107491 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:09.107909 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:09.107581 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:09.107909 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:09.107604 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:51:09.107909 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:09.107659 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:51:09.107909 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:09.107698 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:09.107909 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:09.107816 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:51:11.106996 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:11.106799 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:11.107463 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:11.106846 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:11.107463 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.107088 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxh7h" podUID="20b042ec-3d12-4d9d-bd6a-7b4be48de194" Jun 02 01:51:11.107463 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:11.106863 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:11.107463 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.107212 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:51:11.107463 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.107313 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k2fnv" podUID="adf087f9-b192-4b64-b4b5-fbad249d8a12" Jun 02 01:51:11.782302 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:11.782262 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:11.782511 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.782382 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:51:11.782511 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.782455 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:43.782440494 +0000 UTC m=+65.209281552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:51:11.961875 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:11.961847 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-223.ec2.internal" event="NodeReady" Jun 02 01:51:11.962031 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:11.961988 2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:51:11.983893 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:11.983866 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:11.984037 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.983992 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:51:11.984037 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.984013 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:51:11.984037 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.984022 2558 projected.go:194] Error preparing data for projected volume kube-api-access-qvbfs for pod openshift-network-diagnostics/network-check-target-k2fnv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:51:11.984194 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:11.984074 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs podName:adf087f9-b192-4b64-b4b5-fbad249d8a12 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:43.984055556 +0000 UTC m=+65.410896634 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qvbfs" (UniqueName: "kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs") pod "network-check-target-k2fnv" (UID: "adf087f9-b192-4b64-b4b5-fbad249d8a12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:51:12.000084 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.000064 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84447884bb-vhdwf"] Jun 02 01:51:12.026709 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.026683 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv"] Jun 02 01:51:12.026866 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.026843 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.029912 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.029714 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 01:51:12.029912 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.029834 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 01:51:12.030097 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.030053 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 01:51:12.030854 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.030835 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r2bbv\"" Jun 02 01:51:12.042964 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.042629 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4"] Jun 02 01:51:12.054482 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.054455 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 01:51:12.062521 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.062490 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm"] Jun 02 01:51:12.062642 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.062607 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.062702 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.062681 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.065531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.065480 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 01:51:12.065531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.065501 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 01:51:12.065531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.065513 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 01:51:12.065531 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.065526 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5plfc\"" Jun 02 01:51:12.065765 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.065500 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 01:51:12.065765 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.065523 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 01:51:12.075722 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.075703 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84447884bb-vhdwf"] Jun 02 01:51:12.075722 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.075725 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv"] Jun 02 01:51:12.075886 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.075733 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm"] Jun 02 01:51:12.075886 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.075746 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tqv5x"] Jun 02 01:51:12.075886 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.075870 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.078783 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.078754 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 01:51:12.078882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.078804 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 01:51:12.078882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.078820 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 01:51:12.078882 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.078834 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 01:51:12.085137 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085113 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.085215 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28btd\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-kube-api-access-28btd\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085215 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00aebc-2333-492a-8c64-3a9c61dc4b59-ca-trust-extracted\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085295 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-trusted-ca\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085295 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-hub\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.085359 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-image-registry-private-configuration\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085359 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.085359 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcc15678-7a78-4968-af3d-f057558a3737-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b94f6856-fjvj4\" (UID: \"fcc15678-7a78-4968-af3d-f057558a3737\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.085482 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085482 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztw6r\" (UniqueName: \"kubernetes.io/projected/8555e068-c632-40e0-afc3-2ebd28d9ff4b-kube-api-access-ztw6r\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.085482 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sz88\" (UniqueName: \"kubernetes.io/projected/fcc15678-7a78-4968-af3d-f057558a3737-kube-api-access-5sz88\") pod \"managed-serviceaccount-addon-agent-b94f6856-fjvj4\" (UID: \"fcc15678-7a78-4968-af3d-f057558a3737\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.085573 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8555e068-c632-40e0-afc3-2ebd28d9ff4b-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.085605 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085571 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-installation-pull-secrets\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085667 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085646 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw845\" (UniqueName: \"kubernetes.io/projected/0d929090-271b-4e1d-b231-9effbab71e88-kube-api-access-cw845\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.085770 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-certificates\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085770 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-bound-sa-token\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.085883 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0d929090-271b-4e1d-b231-9effbab71e88-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.085883 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8555e068-c632-40e0-afc3-2ebd28d9ff4b-tmp\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.085883 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.085827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-ca\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.094130 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.094108 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hdjcr"] Jun 02 01:51:12.094263 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.094244 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.096720 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.096705 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:51:12.096814 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.096786 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:51:12.096814 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.096794 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqf6s\"" Jun 02 01:51:12.108821 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.108801 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4"] Jun 02 01:51:12.109148 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.108830 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqv5x"] Jun 02 01:51:12.109148 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.108845 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hdjcr"] Jun 02 01:51:12.109148 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.108883 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:12.111360 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.111340 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:51:12.111360 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.111352 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:51:12.111544 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.111462 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jf6tl\"" Jun 02 01:51:12.111544 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.111481 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:51:12.186174 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186134 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-certificates\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186174 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186175 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-bound-sa-token\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186202 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0d929090-271b-4e1d-b231-9effbab71e88-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186226 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8555e068-c632-40e0-afc3-2ebd28d9ff4b-tmp\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186250 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-ca\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f70a751-8443-4000-a3fa-011b6f2266c4-config-volume\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186308 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186335 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28btd\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-kube-api-access-28btd\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186365 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00aebc-2333-492a-8c64-3a9c61dc4b59-ca-trust-extracted\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186425 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186392 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-trusted-ca\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186441 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f70a751-8443-4000-a3fa-011b6f2266c4-tmp-dir\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkscv\" (UniqueName: \"kubernetes.io/projected/4f70a751-8443-4000-a3fa-011b6f2266c4-kube-api-access-gkscv\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186510 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-hub\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwqn\" (UniqueName: \"kubernetes.io/projected/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-kube-api-access-nhwqn\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186636 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-image-registry-private-configuration\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186664 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186690 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcc15678-7a78-4968-af3d-f057558a3737-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b94f6856-fjvj4\" (UID: \"fcc15678-7a78-4968-af3d-f057558a3737\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186729 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186756 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztw6r\" (UniqueName: \"kubernetes.io/projected/8555e068-c632-40e0-afc3-2ebd28d9ff4b-kube-api-access-ztw6r\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186783 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sz88\" (UniqueName: \"kubernetes.io/projected/fcc15678-7a78-4968-af3d-f057558a3737-kube-api-access-5sz88\") pod \"managed-serviceaccount-addon-agent-b94f6856-fjvj4\" (UID: \"fcc15678-7a78-4968-af3d-f057558a3737\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-certificates\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.186826 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186814 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8555e068-c632-40e0-afc3-2ebd28d9ff4b-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.187446 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186873 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-installation-pull-secrets\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.187446 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:12.187446 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.186933 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cw845\" (UniqueName: \"kubernetes.io/projected/0d929090-271b-4e1d-b231-9effbab71e88-kube-api-access-cw845\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.187600 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.187465 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8555e068-c632-40e0-afc3-2ebd28d9ff4b-tmp\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.187668 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.187639 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00aebc-2333-492a-8c64-3a9c61dc4b59-ca-trust-extracted\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.187855 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.187836 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:51:12.187930 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.187857 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:51:12.187930 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.187872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0d929090-271b-4e1d-b231-9effbab71e88-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.187930 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.187920 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:12.687904074 +0000 UTC m=+34.114745131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:51:12.188522 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.188498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-trusted-ca\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.192006 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.191900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.192006 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.191925 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-hub\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.192006 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.191961 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcc15678-7a78-4968-af3d-f057558a3737-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b94f6856-fjvj4\" (UID: \"fcc15678-7a78-4968-af3d-f057558a3737\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.192006 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.191966 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8555e068-c632-40e0-afc3-2ebd28d9ff4b-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.192546 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.192524 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.192831 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.192810 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-image-registry-private-configuration\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.193229 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.193205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-installation-pull-secrets\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.193795 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.193776 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d929090-271b-4e1d-b231-9effbab71e88-ca\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.196372 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.196350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-bound-sa-token\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.196589 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.196568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28btd\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-kube-api-access-28btd\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.199535 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.199509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztw6r\" (UniqueName: \"kubernetes.io/projected/8555e068-c632-40e0-afc3-2ebd28d9ff4b-kube-api-access-ztw6r\") pod \"klusterlet-addon-workmgr-6f56c58669-mzwfv\" (UID: \"8555e068-c632-40e0-afc3-2ebd28d9ff4b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.199634 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.199541 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sz88\" (UniqueName: \"kubernetes.io/projected/fcc15678-7a78-4968-af3d-f057558a3737-kube-api-access-5sz88\") pod \"managed-serviceaccount-addon-agent-b94f6856-fjvj4\" (UID: \"fcc15678-7a78-4968-af3d-f057558a3737\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.199787 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.199765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw845\" (UniqueName: \"kubernetes.io/projected/0d929090-271b-4e1d-b231-9effbab71e88-kube-api-access-cw845\") pod \"cluster-proxy-proxy-agent-58fc8d47df-mxqtm\" (UID: \"0d929090-271b-4e1d-b231-9effbab71e88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.287346 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287278 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:12.287346 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287344 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f70a751-8443-4000-a3fa-011b6f2266c4-config-volume\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.287563 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287379 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f70a751-8443-4000-a3fa-011b6f2266c4-tmp-dir\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.287563 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287422 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkscv\" (UniqueName: \"kubernetes.io/projected/4f70a751-8443-4000-a3fa-011b6f2266c4-kube-api-access-gkscv\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.287563 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.287434 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:12.287563 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287464 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwqn\" (UniqueName: \"kubernetes.io/projected/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-kube-api-access-nhwqn\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:12.287563 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287498 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.287563 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.287512 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:12.787492824 +0000 UTC m=+34.214333900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:51:12.287563 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.287559 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:12.287937 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.287592 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:12.787581896 +0000 UTC m=+34.214422955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:51:12.287937 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f70a751-8443-4000-a3fa-011b6f2266c4-tmp-dir\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.287937 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.287900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f70a751-8443-4000-a3fa-011b6f2266c4-config-volume\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.296739 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.296718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkscv\" (UniqueName: \"kubernetes.io/projected/4f70a751-8443-4000-a3fa-011b6f2266c4-kube-api-access-gkscv\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.297094 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.297066 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwqn\" (UniqueName: \"kubernetes.io/projected/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-kube-api-access-nhwqn\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:12.381100 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.381080 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:51:12.388809 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.388785 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:12.395496 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.395466 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:51:12.550847 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.550785 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4"] Jun 02 01:51:12.553469 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.553447 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm"] Jun 02 01:51:12.556054 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.556035 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv"] Jun 02 01:51:12.610224 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:51:12.610196 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcc15678_7a78_4968_af3d_f057558a3737.slice/crio-794d97fafaa23c6830018115f8e5670e297e9c7f23131bbfd2683c971399492f WatchSource:0}: Error finding container 794d97fafaa23c6830018115f8e5670e297e9c7f23131bbfd2683c971399492f: Status 404 returned error can't find the container with id 794d97fafaa23c6830018115f8e5670e297e9c7f23131bbfd2683c971399492f Jun 02 01:51:12.613771 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:51:12.613745 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d929090_271b_4e1d_b231_9effbab71e88.slice/crio-c7bbede29934a771c2a6c572b0931c6c60258e55a70ab6440bb6880e4e78fd35 WatchSource:0}: Error finding container c7bbede29934a771c2a6c572b0931c6c60258e55a70ab6440bb6880e4e78fd35: Status 404 returned error can't find the container with id c7bbede29934a771c2a6c572b0931c6c60258e55a70ab6440bb6880e4e78fd35 Jun 02 01:51:12.614622 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:51:12.614599 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8555e068_c632_40e0_afc3_2ebd28d9ff4b.slice/crio-dac18768a7ed1a49159a547a5b5b5dcf63f374503edc852e0eb803bb2f868819 WatchSource:0}: Error finding container dac18768a7ed1a49159a547a5b5b5dcf63f374503edc852e0eb803bb2f868819: Status 404 returned error can't find the container with id dac18768a7ed1a49159a547a5b5b5dcf63f374503edc852e0eb803bb2f868819 Jun 02 01:51:12.690331 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.690303 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:12.690455 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.690438 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:51:12.690455 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.690455 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:51:12.690602 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.690510 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:13.690491983 +0000 UTC m=+35.117333046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:51:12.790804 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.790636 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:12.790973 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.790773 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:12.790973 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:12.790869 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:12.790973 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.790913 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:13.790897796 +0000 UTC m=+35.217738854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:51:12.791118 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.790976 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:12.791118 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:12.791031 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:13.791015932 +0000 UTC m=+35.217857007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:51:13.107230 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.107168 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:13.107230 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.107199 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:13.107354 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.107182 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:13.110218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.110088 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:51:13.110218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.110099 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:51:13.110218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.110112 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsfrq\"" Jun 02 01:51:13.110218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.110125 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:51:13.110218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.110112 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:51:13.110218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.110088 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkwhc\"" Jun 02 01:51:13.271737 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.271713 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" event={"ID":"8555e068-c632-40e0-afc3-2ebd28d9ff4b","Type":"ContainerStarted","Data":"dac18768a7ed1a49159a547a5b5b5dcf63f374503edc852e0eb803bb2f868819"} Jun 02 01:51:13.272653 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.272628 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" event={"ID":"0d929090-271b-4e1d-b231-9effbab71e88","Type":"ContainerStarted","Data":"c7bbede29934a771c2a6c572b0931c6c60258e55a70ab6440bb6880e4e78fd35"} Jun 02 01:51:13.273574 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.273550 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" event={"ID":"fcc15678-7a78-4968-af3d-f057558a3737","Type":"ContainerStarted","Data":"794d97fafaa23c6830018115f8e5670e297e9c7f23131bbfd2683c971399492f"} Jun 02 01:51:13.275670 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.275651 2558 generic.go:358] "Generic (PLEG): container finished" podID="d409a04e-6b2c-4fed-8817-9edd829b9e82" containerID="334c08bcfe0fb5220596cc9af41945518f8605e9f2cf7d58f3ec2880660caf9c" exitCode=0 Jun 02 01:51:13.275753 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.275679 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerDied","Data":"334c08bcfe0fb5220596cc9af41945518f8605e9f2cf7d58f3ec2880660caf9c"} Jun 02 01:51:13.293391 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.293368 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:13.296228 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.296205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20b042ec-3d12-4d9d-bd6a-7b4be48de194-original-pull-secret\") pod \"global-pull-secret-syncer-pxh7h\" (UID: \"20b042ec-3d12-4d9d-bd6a-7b4be48de194\") " pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:13.422860 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.422834 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxh7h" Jun 02 01:51:13.538593 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.538567 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pxh7h"] Jun 02 01:51:13.548500 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:51:13.548477 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b042ec_3d12_4d9d_bd6a_7b4be48de194.slice/crio-b6fc8a99b03f27f43aa91e855b2e920aeb9680f821dba206bcfba2ace975c6dc WatchSource:0}: Error finding container b6fc8a99b03f27f43aa91e855b2e920aeb9680f821dba206bcfba2ace975c6dc: Status 404 returned error can't find the container with id b6fc8a99b03f27f43aa91e855b2e920aeb9680f821dba206bcfba2ace975c6dc Jun 02 01:51:13.695366 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.695305 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:13.695509 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:13.695439 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:51:13.695509 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:13.695457 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:51:13.695611 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:13.695518 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:15.69550329 +0000 UTC m=+37.122344362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:51:13.796525 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.795927 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:13.796525 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:13.796022 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:13.796525 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:13.796085 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:13.796525 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:13.796134 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:13.796525 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:13.796163 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:15.796143552 +0000 UTC m=+37.222984629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:51:13.796525 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:13.796186 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:15.796175059 +0000 UTC m=+37.223016123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:51:14.289280 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:14.289245 2558 generic.go:358] "Generic (PLEG): container finished" podID="d409a04e-6b2c-4fed-8817-9edd829b9e82" containerID="b7cf81e6531230a5a22450bc5a04bd0554138ec0d7214c0b95b7a5b8b4eb7894" exitCode=0 Jun 02 01:51:14.289788 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:14.289454 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerDied","Data":"b7cf81e6531230a5a22450bc5a04bd0554138ec0d7214c0b95b7a5b8b4eb7894"} Jun 02 01:51:14.292014 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:14.291992 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pxh7h" event={"ID":"20b042ec-3d12-4d9d-bd6a-7b4be48de194","Type":"ContainerStarted","Data":"b6fc8a99b03f27f43aa91e855b2e920aeb9680f821dba206bcfba2ace975c6dc"} Jun 02 01:51:15.299382 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:15.299006 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w6txs" event={"ID":"d409a04e-6b2c-4fed-8817-9edd829b9e82","Type":"ContainerStarted","Data":"670cd1916f192ca74d384b73ca2b9793c4982dcf638c36f0631720b087a44991"} Jun 02 01:51:15.323719 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:15.323662 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w6txs" podStartSLOduration=4.051733084 podStartE2EDuration="36.323648317s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:40.373150067 +0000 UTC m=+1.799991124" lastFinishedPulling="2026-06-02 01:51:12.645065298 +0000 UTC m=+34.071906357" observedRunningTime="2026-06-02 01:51:15.321443247 +0000 UTC m=+36.748284327" watchObservedRunningTime="2026-06-02 01:51:15.323648317 +0000 UTC m=+36.750489397" Jun 02 01:51:15.716210 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:15.716130 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:15.716375 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:15.716275 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:51:15.716375 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:15.716298 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:51:15.716375 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:15.716362 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:19.716346005 +0000 UTC m=+41.143187063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:51:15.817320 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:15.816503 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:15.817320 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:15.816592 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:15.817320 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:15.816759 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:15.817320 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:15.816818 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:19.816799108 +0000 UTC m=+41.243640180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:51:15.817320 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:15.817195 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:15.817320 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:15.817261 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:19.817245736 +0000 UTC m=+41.244086800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:51:19.746359 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:19.746322 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:19.747024 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:19.746511 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:51:19.747024 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:19.746535 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:51:19.747024 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:19.746606 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:27.746583403 +0000 UTC m=+49.173424480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:51:19.846914 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:19.846879 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:19.847067 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:19.846962 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:19.847067 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:19.847057 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:19.847163 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:19.847090 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:19.847163 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:19.847115 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:27.847098977 +0000 UTC m=+49.273940036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:51:19.847163 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:19.847145 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:27.847132945 +0000 UTC m=+49.273974002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:51:23.317597 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.317557 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" event={"ID":"fcc15678-7a78-4968-af3d-f057558a3737","Type":"ContainerStarted","Data":"7edc7d55f2cfe11723fc8638382991dc7aaa47ffb89a9974f99fa75559b5a412"} Jun 02 01:51:23.318976 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.318931 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" event={"ID":"8555e068-c632-40e0-afc3-2ebd28d9ff4b","Type":"ContainerStarted","Data":"9c38158088761ad1a59bdff750f24b85d8b6f11aa760a3188eaf9533fc0cd3cf"} Jun 02 01:51:23.319164 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.319142 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:23.320439 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.320396 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pxh7h" event={"ID":"20b042ec-3d12-4d9d-bd6a-7b4be48de194","Type":"ContainerStarted","Data":"9a76e79c19a4e2f679586cf80228a67193ce8ab36416390738a32ce7821846b8"} Jun 02 01:51:23.320977 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.320953 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:51:23.321850 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.321820 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" event={"ID":"0d929090-271b-4e1d-b231-9effbab71e88","Type":"ContainerStarted","Data":"90d96d261612a5bc1ad0475235d895c668ea1e44fb6349a985b96a3a1d9094f8"} Jun 02 01:51:23.334550 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.334508 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" podStartSLOduration=9.722730808 podStartE2EDuration="19.334497414s" podCreationTimestamp="2026-06-02 01:51:04 +0000 UTC" firstStartedPulling="2026-06-02 01:51:12.611702877 +0000 UTC m=+34.038543935" lastFinishedPulling="2026-06-02 01:51:22.223469468 +0000 UTC m=+43.650310541" observedRunningTime="2026-06-02 01:51:23.333206793 +0000 UTC m=+44.760047874" watchObservedRunningTime="2026-06-02 01:51:23.334497414 +0000 UTC m=+44.761338537" Jun 02 01:51:23.353076 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.353036 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" podStartSLOduration=9.73648841 podStartE2EDuration="19.353024999s" podCreationTimestamp="2026-06-02 01:51:04 +0000 UTC" firstStartedPulling="2026-06-02 01:51:12.621640756 +0000 UTC m=+34.048481832" lastFinishedPulling="2026-06-02 01:51:22.23817736 +0000 UTC m=+43.665018421" observedRunningTime="2026-06-02 01:51:23.352098723 +0000 UTC m=+44.778939802" watchObservedRunningTime="2026-06-02 01:51:23.353024999 +0000 UTC m=+44.779866078" Jun 02 01:51:23.367083 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:23.367047 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pxh7h" podStartSLOduration=33.693379509 podStartE2EDuration="42.367037619s" podCreationTimestamp="2026-06-02 01:50:41 +0000 UTC" firstStartedPulling="2026-06-02 01:51:13.550086781 +0000 UTC m=+34.976927839" lastFinishedPulling="2026-06-02 01:51:22.223744882 +0000 UTC m=+43.650585949" observedRunningTime="2026-06-02 01:51:23.365981376 +0000 UTC m=+44.792822456" watchObservedRunningTime="2026-06-02 01:51:23.367037619 +0000 UTC m=+44.793878699" Jun 02 01:51:27.334706 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:27.334672 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" event={"ID":"0d929090-271b-4e1d-b231-9effbab71e88","Type":"ContainerStarted","Data":"fb3753b027a2c542dc4f163814ea84f2b45832d196e8138ee6b4f534926b7865"} Jun 02 01:51:27.334706 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:27.334708 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" event={"ID":"0d929090-271b-4e1d-b231-9effbab71e88","Type":"ContainerStarted","Data":"ef1d53ac894cd7ba7a54e163f5a9072d5b313257684a86d9c1a976bd6e4289d9"} Jun 02 01:51:27.353804 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:27.353757 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" podStartSLOduration=9.371151139 podStartE2EDuration="23.35374244s" podCreationTimestamp="2026-06-02 01:51:04 +0000 UTC" firstStartedPulling="2026-06-02 01:51:12.621576698 +0000 UTC m=+34.048417767" lastFinishedPulling="2026-06-02 01:51:26.604168002 +0000 UTC m=+48.031009068" observedRunningTime="2026-06-02 01:51:27.352938401 +0000 UTC m=+48.779779481" watchObservedRunningTime="2026-06-02 01:51:27.35374244 +0000 UTC m=+48.780583519" Jun 02 01:51:27.807211 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:27.807181 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:27.807372 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:27.807304 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:51:27.807372 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:27.807316 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:51:27.807474 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:27.807379 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:43.807362986 +0000 UTC m=+65.234204044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:51:27.908340 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:27.908306 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:27.908494 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:27.908366 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:27.908494 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:27.908473 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:27.908569 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:27.908552 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:43.908537325 +0000 UTC m=+65.335378382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:51:27.908608 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:27.908480 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:27.908645 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:27.908618 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:43.908602734 +0000 UTC m=+65.335443793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:51:38.272230 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:38.272197 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pxgw2" Jun 02 01:51:43.822015 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:43.821977 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:51:43.822430 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:43.822069 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:51:43.822430 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.822153 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:51:43.822430 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.822163 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:51:43.822430 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.822222 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:52:15.822206577 +0000 UTC m=+97.249047636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:51:43.825086 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:43.825065 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:51:43.832317 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.832299 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:51:43.832370 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.832363 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:52:47.832345812 +0000 UTC m=+129.259186870 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : secret "metrics-daemon-secret" not found Jun 02 01:51:43.922725 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:43.922700 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:51:43.922838 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:43.922755 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:51:43.922838 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.922819 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:43.922921 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.922857 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:43.922921 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.922865 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:52:15.9228543 +0000 UTC m=+97.349695358 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:51:43.922921 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:51:43.922892 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:52:15.922880609 +0000 UTC m=+97.349721666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:51:44.023575 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:44.023546 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:44.026162 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:44.026144 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:51:44.036655 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:44.036635 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:51:44.048330 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:44.048312 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvbfs\" (UniqueName: \"kubernetes.io/projected/adf087f9-b192-4b64-b4b5-fbad249d8a12-kube-api-access-qvbfs\") pod \"network-check-target-k2fnv\" (UID: \"adf087f9-b192-4b64-b4b5-fbad249d8a12\") " pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:44.321603 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:44.321582 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkwhc\"" Jun 02 01:51:44.327133 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:44.327116 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:44.447430 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:44.447387 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k2fnv"] Jun 02 01:51:44.450020 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:51:44.449991 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf087f9_b192_4b64_b4b5_fbad249d8a12.slice/crio-fe0d24c90994a481a3cb70a77796a6f04faafc143b6afcc98e1aa5599339cb61 WatchSource:0}: Error finding container fe0d24c90994a481a3cb70a77796a6f04faafc143b6afcc98e1aa5599339cb61: Status 404 returned error can't find the container with id fe0d24c90994a481a3cb70a77796a6f04faafc143b6afcc98e1aa5599339cb61 Jun 02 01:51:45.382765 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:45.382721 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k2fnv" event={"ID":"adf087f9-b192-4b64-b4b5-fbad249d8a12","Type":"ContainerStarted","Data":"fe0d24c90994a481a3cb70a77796a6f04faafc143b6afcc98e1aa5599339cb61"} Jun 02 01:51:48.393788 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:48.393652 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k2fnv" event={"ID":"adf087f9-b192-4b64-b4b5-fbad249d8a12","Type":"ContainerStarted","Data":"b2cb0cfec74bd69dc576895613877ff940c3e8969d0332e85af5cc943468c510"} Jun 02 01:51:48.394248 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:48.393786 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:51:48.409109 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:51:48.409057 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k2fnv" podStartSLOduration=66.460955741 podStartE2EDuration="1m9.409042872s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:51:44.451804105 +0000 UTC m=+65.878645163" lastFinishedPulling="2026-06-02 01:51:47.399891233 +0000 UTC m=+68.826732294" observedRunningTime="2026-06-02 01:51:48.408383047 +0000 UTC m=+69.835224185" watchObservedRunningTime="2026-06-02 01:51:48.409042872 +0000 UTC m=+69.835883953" Jun 02 01:52:15.847311 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:52:15.847256 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:52:15.847897 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:15.847424 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:52:15.847897 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:15.847444 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:52:15.847897 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:15.847518 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.847496195 +0000 UTC m=+161.274337270 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:52:15.947872 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:52:15.947829 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:52:15.947998 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:52:15.947915 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:52:15.947998 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:15.947987 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:52:15.948066 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:15.948003 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:52:15.948099 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:15.948074 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.948056132 +0000 UTC m=+161.374897190 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:52:15.948099 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:15.948090 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.948083406 +0000 UTC m=+161.374924464 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:52:19.398941 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:52:19.398907 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k2fnv" Jun 02 01:52:47.860534 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:52:47.860495 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:52:47.861021 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:47.860637 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:52:47.861021 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:52:47.860713 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs podName:4bd74378-1130-4430-b19a-15ac28885e01 nodeName:}" failed. No retries permitted until 2026-06-02 01:54:49.860695869 +0000 UTC m=+251.287536928 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs") pod "network-metrics-daemon-td25w" (UID: "4bd74378-1130-4430-b19a-15ac28885e01") : secret "metrics-daemon-secret" not found Jun 02 01:53:15.039740 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:15.039690 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" Jun 02 01:53:15.122119 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:15.122089 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tqv5x" podUID="4f70a751-8443-4000-a3fa-011b6f2266c4" Jun 02 01:53:15.127260 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:15.127237 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hdjcr" podUID="fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0" Jun 02 01:53:15.599664 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:15.599631 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqv5x" Jun 02 01:53:15.599821 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:15.599640 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:53:15.599821 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:15.599640 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:53:16.128366 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:16.128324 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-td25w" podUID="4bd74378-1130-4430-b19a-15ac28885e01" Jun 02 01:53:18.297985 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:18.297909 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zfdlf_d04fa77f-2175-478e-a43f-badbcde3f382/dns-node-resolver/0.log" Jun 02 01:53:19.096064 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:19.096032 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-szbhm_5163a79b-ba0d-424f-a8c2-6f6d203a3ce1/node-ca/0.log" Jun 02 01:53:19.891081 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:19.891047 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:53:19.891495 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:19.891214 2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:53:19.891495 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:19.891234 2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84447884bb-vhdwf: secret "image-registry-tls" not found Jun 02 01:53:19.891495 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:19.891299 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls podName:dc00aebc-2333-492a-8c64-3a9c61dc4b59 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:21.891284305 +0000 UTC m=+283.318125363 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls") pod "image-registry-84447884bb-vhdwf" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59") : secret "image-registry-tls" not found Jun 02 01:53:19.991502 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:19.991476 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:53:19.991625 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:19.991525 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:53:19.991625 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:19.991611 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:53:19.991741 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:19.991666 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:53:19.991741 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:19.991673 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert podName:fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:21.991658921 +0000 UTC m=+283.418499979 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert") pod "ingress-canary-hdjcr" (UID: "fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0") : secret "canary-serving-cert" not found Jun 02 01:53:19.991741 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:53:19.991701 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls podName:4f70a751-8443-4000-a3fa-011b6f2266c4 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:21.99169099 +0000 UTC m=+283.418532047 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls") pod "dns-default-tqv5x" (UID: "4f70a751-8443-4000-a3fa-011b6f2266c4") : secret "dns-default-metrics-tls" not found Jun 02 01:53:22.617677 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:22.617647 2558 generic.go:358] "Generic (PLEG): container finished" podID="fcc15678-7a78-4968-af3d-f057558a3737" containerID="7edc7d55f2cfe11723fc8638382991dc7aaa47ffb89a9974f99fa75559b5a412" exitCode=255 Jun 02 01:53:22.618042 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:22.617724 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" event={"ID":"fcc15678-7a78-4968-af3d-f057558a3737","Type":"ContainerDied","Data":"7edc7d55f2cfe11723fc8638382991dc7aaa47ffb89a9974f99fa75559b5a412"} Jun 02 01:53:22.618120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:22.618064 2558 scope.go:117] "RemoveContainer" containerID="7edc7d55f2cfe11723fc8638382991dc7aaa47ffb89a9974f99fa75559b5a412" Jun 02 01:53:22.619074 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:22.619047 2558 generic.go:358] "Generic (PLEG): container finished" podID="8555e068-c632-40e0-afc3-2ebd28d9ff4b" containerID="9c38158088761ad1a59bdff750f24b85d8b6f11aa760a3188eaf9533fc0cd3cf" exitCode=1 Jun 02 01:53:22.619164 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:22.619088 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" event={"ID":"8555e068-c632-40e0-afc3-2ebd28d9ff4b","Type":"ContainerDied","Data":"9c38158088761ad1a59bdff750f24b85d8b6f11aa760a3188eaf9533fc0cd3cf"} Jun 02 01:53:22.619416 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:22.619367 2558 scope.go:117] "RemoveContainer" containerID="9c38158088761ad1a59bdff750f24b85d8b6f11aa760a3188eaf9533fc0cd3cf" Jun 02 01:53:23.319241 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:23.319211 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:53:23.622881 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:23.622787 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" event={"ID":"8555e068-c632-40e0-afc3-2ebd28d9ff4b","Type":"ContainerStarted","Data":"151ba176e081db89b3faa19634a5a8b2d75762bf39ab0a688915284b0854aec7"} Jun 02 01:53:23.623291 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:23.623012 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:53:23.623636 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:23.623615 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:53:23.624549 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:23.624521 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" event={"ID":"fcc15678-7a78-4968-af3d-f057558a3737","Type":"ContainerStarted","Data":"1422da8a4f86e057b6372ef3b0fb334ef05c83796b0890ee23f8dd21581da77b"} Jun 02 01:53:30.107089 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:30.107048 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:53:40.375369 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.375325 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mjjbr"] Jun 02 01:53:40.378850 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.378813 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.382420 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.382367 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:53:40.382420 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.382385 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:53:40.382611 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.382425 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:53:40.382611 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.382446 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:53:40.382611 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.382536 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r9ggs\"" Jun 02 01:53:40.395579 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.395555 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjjbr"] Jun 02 01:53:40.536903 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.536876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/062e4d3b-949d-47c2-af63-e1a7124e436d-crio-socket\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.537002 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.536934 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/062e4d3b-949d-47c2-af63-e1a7124e436d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.537043 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.537006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/062e4d3b-949d-47c2-af63-e1a7124e436d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.537078 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.537061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbnz7\" (UniqueName: \"kubernetes.io/projected/062e4d3b-949d-47c2-af63-e1a7124e436d-kube-api-access-bbnz7\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.537115 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.537085 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/062e4d3b-949d-47c2-af63-e1a7124e436d-data-volume\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.637908 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.637835 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/062e4d3b-949d-47c2-af63-e1a7124e436d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.637908 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.637881 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/062e4d3b-949d-47c2-af63-e1a7124e436d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.638053 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.637929 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbnz7\" (UniqueName: \"kubernetes.io/projected/062e4d3b-949d-47c2-af63-e1a7124e436d-kube-api-access-bbnz7\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.638053 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.637950 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/062e4d3b-949d-47c2-af63-e1a7124e436d-data-volume\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.638222 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.638178 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/062e4d3b-949d-47c2-af63-e1a7124e436d-crio-socket\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.638346 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.638257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/062e4d3b-949d-47c2-af63-e1a7124e436d-crio-socket\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.638390 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.638345 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/062e4d3b-949d-47c2-af63-e1a7124e436d-data-volume\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.638622 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.638600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/062e4d3b-949d-47c2-af63-e1a7124e436d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.640416 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.640383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/062e4d3b-949d-47c2-af63-e1a7124e436d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.648499 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.648477 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbnz7\" (UniqueName: \"kubernetes.io/projected/062e4d3b-949d-47c2-af63-e1a7124e436d-kube-api-access-bbnz7\") pod \"insights-runtime-extractor-mjjbr\" (UID: \"062e4d3b-949d-47c2-af63-e1a7124e436d\") " pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.688164 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.688144 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjjbr" Jun 02 01:53:40.807979 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:40.807952 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjjbr"] Jun 02 01:53:40.810937 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:53:40.810914 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062e4d3b_949d_47c2_af63_e1a7124e436d.slice/crio-76ddcca92f13183e1b5e1fd9c9eb429ebdaec4040bb17bb966c194dc2fbc7562 WatchSource:0}: Error finding container 76ddcca92f13183e1b5e1fd9c9eb429ebdaec4040bb17bb966c194dc2fbc7562: Status 404 returned error can't find the container with id 76ddcca92f13183e1b5e1fd9c9eb429ebdaec4040bb17bb966c194dc2fbc7562 Jun 02 01:53:41.669001 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:41.668974 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjjbr" event={"ID":"062e4d3b-949d-47c2-af63-e1a7124e436d","Type":"ContainerStarted","Data":"5f5fe9e0e2af8cec5fc60336c497060570f34e178440f60b25bfa3ee9d52d042"} Jun 02 01:53:41.669292 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:41.669013 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjjbr" event={"ID":"062e4d3b-949d-47c2-af63-e1a7124e436d","Type":"ContainerStarted","Data":"1fa874c8096a07e35d6a0dd73ac8de6bd7fcb8462cc9bab016e8c7400f8b9c20"} Jun 02 01:53:41.669292 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:41.669027 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjjbr" event={"ID":"062e4d3b-949d-47c2-af63-e1a7124e436d","Type":"ContainerStarted","Data":"76ddcca92f13183e1b5e1fd9c9eb429ebdaec4040bb17bb966c194dc2fbc7562"} Jun 02 01:53:43.675502 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:43.675427 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjjbr" event={"ID":"062e4d3b-949d-47c2-af63-e1a7124e436d","Type":"ContainerStarted","Data":"29529c96bb106d19438eb8782986a97b862cdd906213c032ed7507d099e79259"} Jun 02 01:53:43.696127 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:43.696070 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mjjbr" podStartSLOduration=1.243993223 podStartE2EDuration="3.696058015s" podCreationTimestamp="2026-06-02 01:53:40 +0000 UTC" firstStartedPulling="2026-06-02 01:53:40.865131491 +0000 UTC m=+182.291972549" lastFinishedPulling="2026-06-02 01:53:43.317196283 +0000 UTC m=+184.744037341" observedRunningTime="2026-06-02 01:53:43.694452806 +0000 UTC m=+185.121293887" watchObservedRunningTime="2026-06-02 01:53:43.696058015 +0000 UTC m=+185.122899095" Jun 02 01:53:53.552284 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.552255 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8dwzp"] Jun 02 01:53:53.555326 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.555311 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.559783 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.559758 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xd8pq\"" Jun 02 01:53:53.560905 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.560878 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:53:53.560905 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.560914 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:53:53.561090 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.560937 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:53:53.561146 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.561119 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:53:53.561198 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.561159 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:53:53.561674 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.561341 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:53:53.727483 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727626 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-sys\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727626 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727560 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840b8578-8756-464a-8c62-5ad5d4b16a5a-metrics-client-ca\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727626 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-root\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727626 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-textfile\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727819 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-tls\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727819 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-wtmp\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727819 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxl2h\" (UniqueName: \"kubernetes.io/projected/840b8578-8756-464a-8c62-5ad5d4b16a5a-kube-api-access-vxl2h\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.727819 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.727804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.828918 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.828833 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-root\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.828918 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.828870 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-textfile\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.828918 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.828916 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-tls\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.828936 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-wtmp\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.828955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-root\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829000 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxl2h\" (UniqueName: \"kubernetes.io/projected/840b8578-8756-464a-8c62-5ad5d4b16a5a-kube-api-access-vxl2h\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-wtmp\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829049 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829104 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829164 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-sys\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/840b8578-8756-464a-8c62-5ad5d4b16a5a-sys\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829567 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-textfile\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829567 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829274 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840b8578-8756-464a-8c62-5ad5d4b16a5a-metrics-client-ca\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829670 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829626 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.829743 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.829724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840b8578-8756-464a-8c62-5ad5d4b16a5a-metrics-client-ca\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.831295 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.831271 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-tls\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.831379 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.831314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840b8578-8756-464a-8c62-5ad5d4b16a5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.849800 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.849771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxl2h\" (UniqueName: \"kubernetes.io/projected/840b8578-8756-464a-8c62-5ad5d4b16a5a-kube-api-access-vxl2h\") pod \"node-exporter-8dwzp\" (UID: \"840b8578-8756-464a-8c62-5ad5d4b16a5a\") " pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.864338 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:53.864317 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dwzp" Jun 02 01:53:53.874089 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:53:53.874070 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840b8578_8756_464a_8c62_5ad5d4b16a5a.slice/crio-8027625bc9fb0ea0078d72d8f4f056cf2c4f61389f1783893344797f668b8661 WatchSource:0}: Error finding container 8027625bc9fb0ea0078d72d8f4f056cf2c4f61389f1783893344797f668b8661: Status 404 returned error can't find the container with id 8027625bc9fb0ea0078d72d8f4f056cf2c4f61389f1783893344797f668b8661 Jun 02 01:53:54.702866 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:54.702837 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dwzp" event={"ID":"840b8578-8756-464a-8c62-5ad5d4b16a5a","Type":"ContainerStarted","Data":"dfc5321c1972240a89b878a7b39b9f4765995f7fdaaf46e3d5cd20e88a51cf87"} Jun 02 01:53:54.703141 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:54.702878 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dwzp" event={"ID":"840b8578-8756-464a-8c62-5ad5d4b16a5a","Type":"ContainerStarted","Data":"8027625bc9fb0ea0078d72d8f4f056cf2c4f61389f1783893344797f668b8661"} Jun 02 01:53:55.706649 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:55.706608 2558 generic.go:358] "Generic (PLEG): container finished" podID="840b8578-8756-464a-8c62-5ad5d4b16a5a" containerID="dfc5321c1972240a89b878a7b39b9f4765995f7fdaaf46e3d5cd20e88a51cf87" exitCode=0 Jun 02 01:53:55.707114 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:55.706674 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dwzp" event={"ID":"840b8578-8756-464a-8c62-5ad5d4b16a5a","Type":"ContainerDied","Data":"dfc5321c1972240a89b878a7b39b9f4765995f7fdaaf46e3d5cd20e88a51cf87"} Jun 02 01:53:56.710961 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:56.710924 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dwzp" event={"ID":"840b8578-8756-464a-8c62-5ad5d4b16a5a","Type":"ContainerStarted","Data":"2dbc1e29f435977d7e47fd5f75a9899ebb065ee5b7bc5ef97b27b2dd2428823e"} Jun 02 01:53:56.710961 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:56.710967 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dwzp" event={"ID":"840b8578-8756-464a-8c62-5ad5d4b16a5a","Type":"ContainerStarted","Data":"e9f2b7e0fe674ed1946556274babef144fdd7c4a8d55486889334105398fc774"} Jun 02 01:53:56.731303 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:53:56.731254 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8dwzp" podStartSLOduration=2.979399914 podStartE2EDuration="3.731240353s" podCreationTimestamp="2026-06-02 01:53:53 +0000 UTC" firstStartedPulling="2026-06-02 01:53:53.876034853 +0000 UTC m=+195.302875910" lastFinishedPulling="2026-06-02 01:53:54.627875276 +0000 UTC m=+196.054716349" observedRunningTime="2026-06-02 01:53:56.729483542 +0000 UTC m=+198.156324625" watchObservedRunningTime="2026-06-02 01:53:56.731240353 +0000 UTC m=+198.158081433" Jun 02 01:54:02.396705 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:02.396648 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" podUID="0d929090-271b-4e1d-b231-9effbab71e88" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:54:12.397006 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:12.396595 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" podUID="0d929090-271b-4e1d-b231-9effbab71e88" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:54:22.396985 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:22.396938 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" podUID="0d929090-271b-4e1d-b231-9effbab71e88" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:54:22.397395 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:22.397035 2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" Jun 02 01:54:22.397666 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:22.397630 2558 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"fb3753b027a2c542dc4f163814ea84f2b45832d196e8138ee6b4f534926b7865"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 01:54:22.397714 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:22.397693 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" podUID="0d929090-271b-4e1d-b231-9effbab71e88" containerName="service-proxy" containerID="cri-o://fb3753b027a2c542dc4f163814ea84f2b45832d196e8138ee6b4f534926b7865" gracePeriod=30 Jun 02 01:54:22.783845 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:22.783815 2558 generic.go:358] "Generic (PLEG): container finished" podID="0d929090-271b-4e1d-b231-9effbab71e88" containerID="fb3753b027a2c542dc4f163814ea84f2b45832d196e8138ee6b4f534926b7865" exitCode=2 Jun 02 01:54:22.783996 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:22.783860 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" event={"ID":"0d929090-271b-4e1d-b231-9effbab71e88","Type":"ContainerDied","Data":"fb3753b027a2c542dc4f163814ea84f2b45832d196e8138ee6b4f534926b7865"} Jun 02 01:54:22.783996 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:22.783904 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58fc8d47df-mxqtm" event={"ID":"0d929090-271b-4e1d-b231-9effbab71e88","Type":"ContainerStarted","Data":"d851dc80ad0b622391d2fd64d4742ee4280e65024112ad2fd31816fee248a744"} Jun 02 01:54:31.533758 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:31.533719 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dwzp_840b8578-8756-464a-8c62-5ad5d4b16a5a/init-textfile/0.log" Jun 02 01:54:31.735299 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:31.735272 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dwzp_840b8578-8756-464a-8c62-5ad5d4b16a5a/node-exporter/0.log" Jun 02 01:54:31.937649 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:31.937587 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dwzp_840b8578-8756-464a-8c62-5ad5d4b16a5a/kube-rbac-proxy/0.log" Jun 02 01:54:39.932467 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:39.932435 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zfdlf_d04fa77f-2175-478e-a43f-badbcde3f382/dns-node-resolver/0.log" Jun 02 01:54:40.732377 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:40.732349 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-szbhm_5163a79b-ba0d-424f-a8c2-6f6d203a3ce1/node-ca/0.log" Jun 02 01:54:49.910141 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:49.910048 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:54:49.912523 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:49.912501 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bd74378-1130-4430-b19a-15ac28885e01-metrics-certs\") pod \"network-metrics-daemon-td25w\" (UID: \"4bd74378-1130-4430-b19a-15ac28885e01\") " pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:54:50.210253 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:50.210186 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsfrq\"" Jun 02 01:54:50.217653 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:50.217628 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td25w" Jun 02 01:54:50.341230 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:50.341202 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-td25w"] Jun 02 01:54:50.344667 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:54:50.344632 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd74378_1130_4430_b19a_15ac28885e01.slice/crio-f0902714f0d1bb9c0dbe163070b0115e53b6cae996678ebd9833631f93713b46 WatchSource:0}: Error finding container f0902714f0d1bb9c0dbe163070b0115e53b6cae996678ebd9833631f93713b46: Status 404 returned error can't find the container with id f0902714f0d1bb9c0dbe163070b0115e53b6cae996678ebd9833631f93713b46 Jun 02 01:54:50.861607 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:50.861567 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td25w" event={"ID":"4bd74378-1130-4430-b19a-15ac28885e01","Type":"ContainerStarted","Data":"f0902714f0d1bb9c0dbe163070b0115e53b6cae996678ebd9833631f93713b46"} Jun 02 01:54:51.865549 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:51.865514 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td25w" event={"ID":"4bd74378-1130-4430-b19a-15ac28885e01","Type":"ContainerStarted","Data":"e1b284dd785f151593e5449ff28c35604d817c35ee27921248773bc4c0f484a8"} Jun 02 01:54:51.865549 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:51.865551 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td25w" event={"ID":"4bd74378-1130-4430-b19a-15ac28885e01","Type":"ContainerStarted","Data":"90748caa73f19fd39efed69e416a7e75254fee5b333fec2acc91f2b5ec68eb07"} Jun 02 01:54:51.883261 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:54:51.883217 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-td25w" podStartSLOduration=251.873234961 podStartE2EDuration="4m12.883203697s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:54:50.346866042 +0000 UTC m=+251.773707113" lastFinishedPulling="2026-06-02 01:54:51.356834791 +0000 UTC m=+252.783675849" observedRunningTime="2026-06-02 01:54:51.882597651 +0000 UTC m=+253.309438731" watchObservedRunningTime="2026-06-02 01:54:51.883203697 +0000 UTC m=+253.310044776" Jun 02 01:55:18.600689 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:18.600649 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hdjcr" podUID="fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0" Jun 02 01:55:18.600689 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:18.600651 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" Jun 02 01:55:18.601142 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:18.600651 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tqv5x" podUID="4f70a751-8443-4000-a3fa-011b6f2266c4" Jun 02 01:55:18.943971 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:18.943895 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:55:18.943971 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:18.943928 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqv5x" Jun 02 01:55:18.944157 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:18.944070 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:55:21.931673 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:21.931629 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:55:21.934236 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:21.934208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"image-registry-84447884bb-vhdwf\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:55:21.947991 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:21.947963 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r2bbv\"" Jun 02 01:55:21.955660 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:21.955640 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:55:22.033063 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.033029 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:55:22.033183 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.033088 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:55:22.035441 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.035387 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f70a751-8443-4000-a3fa-011b6f2266c4-metrics-tls\") pod \"dns-default-tqv5x\" (UID: \"4f70a751-8443-4000-a3fa-011b6f2266c4\") " pod="openshift-dns/dns-default-tqv5x" Jun 02 01:55:22.035871 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.035852 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0-cert\") pod \"ingress-canary-hdjcr\" (UID: \"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0\") " pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:55:22.091495 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.091468 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84447884bb-vhdwf"] Jun 02 01:55:22.095788 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:55:22.095762 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc00aebc_2333_492a_8c64_3a9c61dc4b59.slice/crio-01154e0bbac2cc4878dd9762204e0c28110e1df207b8237d74b31bf3347b86b7 WatchSource:0}: Error finding container 01154e0bbac2cc4878dd9762204e0c28110e1df207b8237d74b31bf3347b86b7: Status 404 returned error can't find the container with id 01154e0bbac2cc4878dd9762204e0c28110e1df207b8237d74b31bf3347b86b7 Jun 02 01:55:22.247499 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.247472 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jf6tl\"" Jun 02 01:55:22.247644 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.247581 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqf6s\"" Jun 02 01:55:22.255163 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.255142 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqv5x" Jun 02 01:55:22.255317 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.255302 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hdjcr" Jun 02 01:55:22.401113 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.401086 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hdjcr"] Jun 02 01:55:22.402878 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:55:22.402844 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdfea84c_aa82_4adb_94e3_9f7f8c3aefa0.slice/crio-bb68d2f9c0161db42683f0e4156e030e1357abf222eab849e34314210512174b WatchSource:0}: Error finding container bb68d2f9c0161db42683f0e4156e030e1357abf222eab849e34314210512174b: Status 404 returned error can't find the container with id bb68d2f9c0161db42683f0e4156e030e1357abf222eab849e34314210512174b Jun 02 01:55:22.417452 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.417388 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqv5x"] Jun 02 01:55:22.420025 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:55:22.419997 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f70a751_8443_4000_a3fa_011b6f2266c4.slice/crio-c63c657be63f6343a20763fea877016d21b46a994a543eff55bd091149406c70 WatchSource:0}: Error finding container c63c657be63f6343a20763fea877016d21b46a994a543eff55bd091149406c70: Status 404 returned error can't find the container with id c63c657be63f6343a20763fea877016d21b46a994a543eff55bd091149406c70 Jun 02 01:55:22.955119 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.955083 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqv5x" event={"ID":"4f70a751-8443-4000-a3fa-011b6f2266c4","Type":"ContainerStarted","Data":"c63c657be63f6343a20763fea877016d21b46a994a543eff55bd091149406c70"} Jun 02 01:55:22.956911 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.956835 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" event={"ID":"dc00aebc-2333-492a-8c64-3a9c61dc4b59","Type":"ContainerStarted","Data":"d210a8ada785b97eb2c9012ceab0c9cf632510558988ad78a8dac152c3961738"} Jun 02 01:55:22.956911 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.956881 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" event={"ID":"dc00aebc-2333-492a-8c64-3a9c61dc4b59","Type":"ContainerStarted","Data":"01154e0bbac2cc4878dd9762204e0c28110e1df207b8237d74b31bf3347b86b7"} Jun 02 01:55:22.957095 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.956971 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:55:22.958540 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.958512 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hdjcr" event={"ID":"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0","Type":"ContainerStarted","Data":"bb68d2f9c0161db42683f0e4156e030e1357abf222eab849e34314210512174b"} Jun 02 01:55:22.960559 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.960532 2558 generic.go:358] "Generic (PLEG): container finished" podID="fcc15678-7a78-4968-af3d-f057558a3737" containerID="1422da8a4f86e057b6372ef3b0fb334ef05c83796b0890ee23f8dd21581da77b" exitCode=255 Jun 02 01:55:22.960670 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.960628 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" event={"ID":"fcc15678-7a78-4968-af3d-f057558a3737","Type":"ContainerDied","Data":"1422da8a4f86e057b6372ef3b0fb334ef05c83796b0890ee23f8dd21581da77b"} Jun 02 01:55:22.960670 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.960661 2558 scope.go:117] "RemoveContainer" containerID="7edc7d55f2cfe11723fc8638382991dc7aaa47ffb89a9974f99fa75559b5a412" Jun 02 01:55:22.961385 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.961118 2558 scope.go:117] "RemoveContainer" containerID="1422da8a4f86e057b6372ef3b0fb334ef05c83796b0890ee23f8dd21581da77b" Jun 02 01:55:22.961385 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:22.961335 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-b94f6856-fjvj4_open-cluster-management-agent-addon(fcc15678-7a78-4968-af3d-f057558a3737)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" podUID="fcc15678-7a78-4968-af3d-f057558a3737" Jun 02 01:55:22.963170 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.963146 2558 generic.go:358] "Generic (PLEG): container finished" podID="8555e068-c632-40e0-afc3-2ebd28d9ff4b" containerID="151ba176e081db89b3faa19634a5a8b2d75762bf39ab0a688915284b0854aec7" exitCode=1 Jun 02 01:55:22.963287 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.963199 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" event={"ID":"8555e068-c632-40e0-afc3-2ebd28d9ff4b","Type":"ContainerDied","Data":"151ba176e081db89b3faa19634a5a8b2d75762bf39ab0a688915284b0854aec7"} Jun 02 01:55:22.963558 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.963538 2558 scope.go:117] "RemoveContainer" containerID="151ba176e081db89b3faa19634a5a8b2d75762bf39ab0a688915284b0854aec7" Jun 02 01:55:22.963771 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:22.963737 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f56c58669-mzwfv_open-cluster-management-agent-addon(8555e068-c632-40e0-afc3-2ebd28d9ff4b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" podUID="8555e068-c632-40e0-afc3-2ebd28d9ff4b" Jun 02 01:55:22.973700 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.973637 2558 scope.go:117] "RemoveContainer" containerID="9c38158088761ad1a59bdff750f24b85d8b6f11aa760a3188eaf9533fc0cd3cf" Jun 02 01:55:22.989161 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:22.989117 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" podStartSLOduration=283.98910116 podStartE2EDuration="4m43.98910116s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:55:22.987724884 +0000 UTC m=+284.414565965" watchObservedRunningTime="2026-06-02 01:55:22.98910116 +0000 UTC m=+284.415942242" Jun 02 01:55:23.623139 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:23.623096 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:55:23.969610 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:23.969591 2558 scope.go:117] "RemoveContainer" containerID="151ba176e081db89b3faa19634a5a8b2d75762bf39ab0a688915284b0854aec7" Jun 02 01:55:23.969989 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:23.969808 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f56c58669-mzwfv_open-cluster-management-agent-addon(8555e068-c632-40e0-afc3-2ebd28d9ff4b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" podUID="8555e068-c632-40e0-afc3-2ebd28d9ff4b" Jun 02 01:55:24.974470 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:24.974396 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqv5x" event={"ID":"4f70a751-8443-4000-a3fa-011b6f2266c4","Type":"ContainerStarted","Data":"ff3a280b92c03c68c24d14ce7059fd0ece11157a55043dc4030f134fc9fa97f5"} Jun 02 01:55:24.974470 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:24.974469 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqv5x" event={"ID":"4f70a751-8443-4000-a3fa-011b6f2266c4","Type":"ContainerStarted","Data":"2cf562cda538a359cfe23f410f0624d3e7b82e581d70c63fd1b72333468a0acf"} Jun 02 01:55:24.974959 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:24.974548 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tqv5x" Jun 02 01:55:24.975995 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:24.975973 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hdjcr" event={"ID":"fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0","Type":"ContainerStarted","Data":"9e6dc5e6864a055bb92edc93a7699e9b65fabbf413ec1c9a6a50a7e14b83c2db"} Jun 02 01:55:24.999557 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:24.999503 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-tqv5x" podStartSLOduration=251.25219097 podStartE2EDuration="4m12.999491526s" podCreationTimestamp="2026-06-02 01:51:12 +0000 UTC" firstStartedPulling="2026-06-02 01:55:22.421716186 +0000 UTC m=+283.848557248" lastFinishedPulling="2026-06-02 01:55:24.16901673 +0000 UTC m=+285.595857804" observedRunningTime="2026-06-02 01:55:24.997707344 +0000 UTC m=+286.424548424" watchObservedRunningTime="2026-06-02 01:55:24.999491526 +0000 UTC m=+286.426332661" Jun 02 01:55:25.020310 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:25.020265 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hdjcr" podStartSLOduration=251.252240622 podStartE2EDuration="4m13.020253092s" podCreationTimestamp="2026-06-02 01:51:12 +0000 UTC" firstStartedPulling="2026-06-02 01:55:22.404818693 +0000 UTC m=+283.831659751" lastFinishedPulling="2026-06-02 01:55:24.172831148 +0000 UTC m=+285.599672221" observedRunningTime="2026-06-02 01:55:25.020062003 +0000 UTC m=+286.446903083" watchObservedRunningTime="2026-06-02 01:55:25.020253092 +0000 UTC m=+286.447094235" Jun 02 01:55:32.381766 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:32.381727 2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" Jun 02 01:55:32.382257 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:32.382068 2558 scope.go:117] "RemoveContainer" containerID="1422da8a4f86e057b6372ef3b0fb334ef05c83796b0890ee23f8dd21581da77b" Jun 02 01:55:32.382325 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:32.382269 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-b94f6856-fjvj4_open-cluster-management-agent-addon(fcc15678-7a78-4968-af3d-f057558a3737)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" podUID="fcc15678-7a78-4968-af3d-f057558a3737" Jun 02 01:55:32.389140 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:32.389111 2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:55:32.389490 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:32.389474 2558 scope.go:117] "RemoveContainer" containerID="151ba176e081db89b3faa19634a5a8b2d75762bf39ab0a688915284b0854aec7" Jun 02 01:55:32.389644 ip-10-0-142-223 kubenswrapper[2558]: E0602 01:55:32.389626 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f56c58669-mzwfv_open-cluster-management-agent-addon(8555e068-c632-40e0-afc3-2ebd28d9ff4b)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" podUID="8555e068-c632-40e0-afc3-2ebd28d9ff4b" Jun 02 01:55:34.982694 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:34.982659 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tqv5x" Jun 02 01:55:39.036517 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:39.036490 2558 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:55:40.906260 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:40.906226 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84447884bb-vhdwf"] Jun 02 01:55:40.911049 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:40.911017 2558 patch_prober.go:28] interesting pod/image-registry-84447884bb-vhdwf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 01:55:40.911174 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:40.911065 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:55:46.106653 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:46.106624 2558 scope.go:117] "RemoveContainer" containerID="1422da8a4f86e057b6372ef3b0fb334ef05c83796b0890ee23f8dd21581da77b" Jun 02 01:55:46.107057 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:46.106749 2558 scope.go:117] "RemoveContainer" containerID="151ba176e081db89b3faa19634a5a8b2d75762bf39ab0a688915284b0854aec7" Jun 02 01:55:46.107569 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:46.107552 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:55:47.040814 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:47.040777 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b94f6856-fjvj4" event={"ID":"fcc15678-7a78-4968-af3d-f057558a3737","Type":"ContainerStarted","Data":"b8fbb3044cb85d922f5eacbf89df41c16350f736479a11d7ce5ec259858fd0a2"} Jun 02 01:55:47.042210 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:47.042188 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" event={"ID":"8555e068-c632-40e0-afc3-2ebd28d9ff4b","Type":"ContainerStarted","Data":"370c2c87dcdc5048472ddac09d87c0c86409bc968cb2311e352f3a583fea17e6"} Jun 02 01:55:47.042438 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:47.042422 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:55:47.043777 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:47.043761 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f56c58669-mzwfv" Jun 02 01:55:50.911240 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:55:50.911212 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:56:05.926259 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:05.926186 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" containerName="registry" containerID="cri-o://d210a8ada785b97eb2c9012ceab0c9cf632510558988ad78a8dac152c3961738" gracePeriod=30 Jun 02 01:56:06.097836 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.097804 2558 generic.go:358] "Generic (PLEG): container finished" podID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" containerID="d210a8ada785b97eb2c9012ceab0c9cf632510558988ad78a8dac152c3961738" exitCode=0 Jun 02 01:56:06.097981 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.097880 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" event={"ID":"dc00aebc-2333-492a-8c64-3a9c61dc4b59","Type":"ContainerDied","Data":"d210a8ada785b97eb2c9012ceab0c9cf632510558988ad78a8dac152c3961738"} Jun 02 01:56:06.170809 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.170790 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:56:06.323022 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.322997 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-installation-pull-secrets\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323160 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323034 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28btd\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-kube-api-access-28btd\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323160 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323057 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-image-registry-private-configuration\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323160 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323079 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323160 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323106 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-trusted-ca\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323160 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323129 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00aebc-2333-492a-8c64-3a9c61dc4b59-ca-trust-extracted\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323160 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323150 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-certificates\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323522 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323177 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-bound-sa-token\") pod \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\" (UID: \"dc00aebc-2333-492a-8c64-3a9c61dc4b59\") " Jun 02 01:56:06.323700 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323667 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:56:06.323888 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.323812 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:56:06.325563 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.325422 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:56:06.325563 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.325526 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-kube-api-access-28btd" (OuterVolumeSpecName: "kube-api-access-28btd") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "kube-api-access-28btd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:56:06.325727 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.325606 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:56:06.325791 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.325762 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:56:06.325849 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.325807 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:56:06.331708 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.331682 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc00aebc-2333-492a-8c64-3a9c61dc4b59-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dc00aebc-2333-492a-8c64-3a9c61dc4b59" (UID: "dc00aebc-2333-492a-8c64-3a9c61dc4b59"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:56:06.423828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423805 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-installation-pull-secrets\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:06.423828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423826 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28btd\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-kube-api-access-28btd\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:06.423950 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423837 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dc00aebc-2333-492a-8c64-3a9c61dc4b59-image-registry-private-configuration\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:06.423950 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423847 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-tls\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:06.423950 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423856 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-trusted-ca\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:06.423950 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423864 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dc00aebc-2333-492a-8c64-3a9c61dc4b59-ca-trust-extracted\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:06.423950 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423872 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dc00aebc-2333-492a-8c64-3a9c61dc4b59-registry-certificates\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:06.423950 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:06.423880 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc00aebc-2333-492a-8c64-3a9c61dc4b59-bound-sa-token\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.102822 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:07.102784 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" event={"ID":"dc00aebc-2333-492a-8c64-3a9c61dc4b59","Type":"ContainerDied","Data":"01154e0bbac2cc4878dd9762204e0c28110e1df207b8237d74b31bf3347b86b7"} Jun 02 01:56:07.103247 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:07.102838 2558 scope.go:117] "RemoveContainer" containerID="d210a8ada785b97eb2c9012ceab0c9cf632510558988ad78a8dac152c3961738" Jun 02 01:56:07.103247 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:07.102806 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84447884bb-vhdwf" Jun 02 01:56:07.175110 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:07.175083 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84447884bb-vhdwf"] Jun 02 01:56:07.181066 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:07.181038 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84447884bb-vhdwf"] Jun 02 01:56:09.112308 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:56:09.112267 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" path="/var/lib/kubelet/pods/dc00aebc-2333-492a-8c64-3a9c61dc4b59/volumes" Jun 02 01:58:14.353178 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.353100 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-57p6z"] Jun 02 01:58:14.353631 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.353357 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" containerName="registry" Jun 02 01:58:14.353631 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.353368 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" containerName="registry" Jun 02 01:58:14.353631 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.353435 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc00aebc-2333-492a-8c64-3a9c61dc4b59" containerName="registry" Jun 02 01:58:14.355120 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.355105 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.358038 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.358016 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 01:58:14.359013 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.358989 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ll44j\"" Jun 02 01:58:14.359098 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.359019 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 01:58:14.365638 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.365617 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-57p6z"] Jun 02 01:58:14.450806 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.450765 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8698e5e0-7b4f-43ab-95f9-5848c82fd33d-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-57p6z\" (UID: \"8698e5e0-7b4f-43ab-95f9-5848c82fd33d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.450935 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.450818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29btd\" (UniqueName: \"kubernetes.io/projected/8698e5e0-7b4f-43ab-95f9-5848c82fd33d-kube-api-access-29btd\") pod \"cert-manager-cainjector-68b757865b-57p6z\" (UID: \"8698e5e0-7b4f-43ab-95f9-5848c82fd33d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.551737 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.551713 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8698e5e0-7b4f-43ab-95f9-5848c82fd33d-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-57p6z\" (UID: \"8698e5e0-7b4f-43ab-95f9-5848c82fd33d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.551840 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.551746 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29btd\" (UniqueName: \"kubernetes.io/projected/8698e5e0-7b4f-43ab-95f9-5848c82fd33d-kube-api-access-29btd\") pod \"cert-manager-cainjector-68b757865b-57p6z\" (UID: \"8698e5e0-7b4f-43ab-95f9-5848c82fd33d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.559801 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.559773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8698e5e0-7b4f-43ab-95f9-5848c82fd33d-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-57p6z\" (UID: \"8698e5e0-7b4f-43ab-95f9-5848c82fd33d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.561288 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.561268 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29btd\" (UniqueName: \"kubernetes.io/projected/8698e5e0-7b4f-43ab-95f9-5848c82fd33d-kube-api-access-29btd\") pod \"cert-manager-cainjector-68b757865b-57p6z\" (UID: \"8698e5e0-7b4f-43ab-95f9-5848c82fd33d\") " pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.663519 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.663445 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" Jun 02 01:58:14.782223 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:14.782196 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-57p6z"] Jun 02 01:58:14.785624 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:58:14.785600 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8698e5e0_7b4f_43ab_95f9_5848c82fd33d.slice/crio-697690ea287c5879e122126ccf3f034b1acc6e24525e010a93e2087b1de57ba2 WatchSource:0}: Error finding container 697690ea287c5879e122126ccf3f034b1acc6e24525e010a93e2087b1de57ba2: Status 404 returned error can't find the container with id 697690ea287c5879e122126ccf3f034b1acc6e24525e010a93e2087b1de57ba2 Jun 02 01:58:15.433593 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:15.433553 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" event={"ID":"8698e5e0-7b4f-43ab-95f9-5848c82fd33d","Type":"ContainerStarted","Data":"697690ea287c5879e122126ccf3f034b1acc6e24525e010a93e2087b1de57ba2"} Jun 02 01:58:18.441903 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:18.441870 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" event={"ID":"8698e5e0-7b4f-43ab-95f9-5848c82fd33d","Type":"ContainerStarted","Data":"1c87a043d8d00ed5eede228a8f570bad8fc92b0a73fdb0c74c5814ab5794855b"} Jun 02 01:58:18.458828 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:18.458790 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-57p6z" podStartSLOduration=1.7831385229999999 podStartE2EDuration="4.458777146s" podCreationTimestamp="2026-06-02 01:58:14 +0000 UTC" firstStartedPulling="2026-06-02 01:58:14.787413184 +0000 UTC m=+456.214254257" lastFinishedPulling="2026-06-02 01:58:17.463051823 +0000 UTC m=+458.889892880" observedRunningTime="2026-06-02 01:58:18.457991839 +0000 UTC m=+459.884832934" watchObservedRunningTime="2026-06-02 01:58:18.458777146 +0000 UTC m=+459.885618226" Jun 02 01:58:29.867606 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:29.867567 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-f6vjr"] Jun 02 01:58:29.869711 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:29.869692 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:29.872582 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:29.872553 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ll6hl\"" Jun 02 01:58:29.884532 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:29.884502 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-f6vjr"] Jun 02 01:58:30.048935 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.048908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88crh\" (UniqueName: \"kubernetes.io/projected/fbf83f99-d952-480f-95a4-c334aecdf540-kube-api-access-88crh\") pod \"cert-manager-79c8d999ff-f6vjr\" (UID: \"fbf83f99-d952-480f-95a4-c334aecdf540\") " pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:30.049050 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.048948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbf83f99-d952-480f-95a4-c334aecdf540-bound-sa-token\") pod \"cert-manager-79c8d999ff-f6vjr\" (UID: \"fbf83f99-d952-480f-95a4-c334aecdf540\") " pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:30.150198 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.150129 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88crh\" (UniqueName: \"kubernetes.io/projected/fbf83f99-d952-480f-95a4-c334aecdf540-kube-api-access-88crh\") pod \"cert-manager-79c8d999ff-f6vjr\" (UID: \"fbf83f99-d952-480f-95a4-c334aecdf540\") " pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:30.150198 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.150177 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbf83f99-d952-480f-95a4-c334aecdf540-bound-sa-token\") pod \"cert-manager-79c8d999ff-f6vjr\" (UID: \"fbf83f99-d952-480f-95a4-c334aecdf540\") " pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:30.158340 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.158308 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbf83f99-d952-480f-95a4-c334aecdf540-bound-sa-token\") pod \"cert-manager-79c8d999ff-f6vjr\" (UID: \"fbf83f99-d952-480f-95a4-c334aecdf540\") " pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:30.158449 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.158439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88crh\" (UniqueName: \"kubernetes.io/projected/fbf83f99-d952-480f-95a4-c334aecdf540-kube-api-access-88crh\") pod \"cert-manager-79c8d999ff-f6vjr\" (UID: \"fbf83f99-d952-480f-95a4-c334aecdf540\") " pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:30.179044 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.179024 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-f6vjr" Jun 02 01:58:30.297798 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.297773 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-f6vjr"] Jun 02 01:58:30.300520 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:58:30.300489 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbf83f99_d952_480f_95a4_c334aecdf540.slice/crio-c607a48d941937ff513bfa484555fa4b2d98c282eee432f20fb597f966e72935 WatchSource:0}: Error finding container c607a48d941937ff513bfa484555fa4b2d98c282eee432f20fb597f966e72935: Status 404 returned error can't find the container with id c607a48d941937ff513bfa484555fa4b2d98c282eee432f20fb597f966e72935 Jun 02 01:58:30.474680 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.474652 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-f6vjr" event={"ID":"fbf83f99-d952-480f-95a4-c334aecdf540","Type":"ContainerStarted","Data":"25a0ea44b899f1288b3844a5f2683383620206bc332a5300817cab8110fb624c"} Jun 02 01:58:30.474820 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.474687 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-f6vjr" event={"ID":"fbf83f99-d952-480f-95a4-c334aecdf540","Type":"ContainerStarted","Data":"c607a48d941937ff513bfa484555fa4b2d98c282eee432f20fb597f966e72935"} Jun 02 01:58:30.496958 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:30.496916 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-f6vjr" podStartSLOduration=1.4969024069999999 podStartE2EDuration="1.496902407s" podCreationTimestamp="2026-06-02 01:58:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:58:30.495549817 +0000 UTC m=+471.922390899" watchObservedRunningTime="2026-06-02 01:58:30.496902407 +0000 UTC m=+471.923743488" Jun 02 01:58:48.314377 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.314340 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4"] Jun 02 01:58:48.317288 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.317268 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.321781 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.321749 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:58:48.321908 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.321819 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:58:48.322062 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.322048 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pb8p4\"" Jun 02 01:58:48.322245 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.322230 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:58:48.322296 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.322236 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:58:48.337850 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.337826 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4"] Jun 02 01:58:48.362033 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.362010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4929b698-0aaf-4c0d-b808-d8b850d28ec6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.362134 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.362036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4929b698-0aaf-4c0d-b808-d8b850d28ec6-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.362134 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.362063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4929b698-0aaf-4c0d-b808-d8b850d28ec6-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.362134 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.362119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m849x\" (UniqueName: \"kubernetes.io/projected/4929b698-0aaf-4c0d-b808-d8b850d28ec6-kube-api-access-m849x\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.362253 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.362155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4929b698-0aaf-4c0d-b808-d8b850d28ec6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.463093 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.463072 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4929b698-0aaf-4c0d-b808-d8b850d28ec6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.463214 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.463100 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4929b698-0aaf-4c0d-b808-d8b850d28ec6-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.463214 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.463125 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4929b698-0aaf-4c0d-b808-d8b850d28ec6-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.463214 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.463150 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m849x\" (UniqueName: \"kubernetes.io/projected/4929b698-0aaf-4c0d-b808-d8b850d28ec6-kube-api-access-m849x\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.463214 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.463198 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4929b698-0aaf-4c0d-b808-d8b850d28ec6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.463623 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.463600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4929b698-0aaf-4c0d-b808-d8b850d28ec6-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.465503 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.465483 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4929b698-0aaf-4c0d-b808-d8b850d28ec6-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.465591 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.465573 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4929b698-0aaf-4c0d-b808-d8b850d28ec6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.465637 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.465625 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4929b698-0aaf-4c0d-b808-d8b850d28ec6-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.472512 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.472494 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m849x\" (UniqueName: \"kubernetes.io/projected/4929b698-0aaf-4c0d-b808-d8b850d28ec6-kube-api-access-m849x\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-dsrw4\" (UID: \"4929b698-0aaf-4c0d-b808-d8b850d28ec6\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.627443 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.627368 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:48.760428 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:48.760091 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4"] Jun 02 01:58:48.765238 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:58:48.765212 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4929b698_0aaf_4c0d_b808_d8b850d28ec6.slice/crio-29c1e2a1de367eebce64be1c67f7c3bcc11db8de6bbd3cc56e09579cd358359c WatchSource:0}: Error finding container 29c1e2a1de367eebce64be1c67f7c3bcc11db8de6bbd3cc56e09579cd358359c: Status 404 returned error can't find the container with id 29c1e2a1de367eebce64be1c67f7c3bcc11db8de6bbd3cc56e09579cd358359c Jun 02 01:58:49.526798 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:49.526760 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" event={"ID":"4929b698-0aaf-4c0d-b808-d8b850d28ec6","Type":"ContainerStarted","Data":"29c1e2a1de367eebce64be1c67f7c3bcc11db8de6bbd3cc56e09579cd358359c"} Jun 02 01:58:52.535800 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:52.535760 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" event={"ID":"4929b698-0aaf-4c0d-b808-d8b850d28ec6","Type":"ContainerStarted","Data":"86ec500ec0608393832d46f6230f246e24c439a0d016801ec88e641ff7a5af70"} Jun 02 01:58:53.540296 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:53.540258 2558 generic.go:358] "Generic (PLEG): container finished" podID="4929b698-0aaf-4c0d-b808-d8b850d28ec6" containerID="86ec500ec0608393832d46f6230f246e24c439a0d016801ec88e641ff7a5af70" exitCode=0 Jun 02 01:58:53.540715 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:53.540305 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" event={"ID":"4929b698-0aaf-4c0d-b808-d8b850d28ec6","Type":"ContainerDied","Data":"86ec500ec0608393832d46f6230f246e24c439a0d016801ec88e641ff7a5af70"} Jun 02 01:58:54.545104 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:54.545066 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" event={"ID":"4929b698-0aaf-4c0d-b808-d8b850d28ec6","Type":"ContainerStarted","Data":"0bfa165308bbc615b65848b018743a97e787a9900e8ee61dbf6787d20a8ee33e"} Jun 02 01:58:54.545665 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:54.545288 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:58:54.585673 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:58:54.585630 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" podStartSLOduration=1.474678655 podStartE2EDuration="6.585604499s" podCreationTimestamp="2026-06-02 01:58:48 +0000 UTC" firstStartedPulling="2026-06-02 01:58:48.76676747 +0000 UTC m=+490.193608527" lastFinishedPulling="2026-06-02 01:58:53.877693299 +0000 UTC m=+495.304534371" observedRunningTime="2026-06-02 01:58:54.58327808 +0000 UTC m=+496.010119159" watchObservedRunningTime="2026-06-02 01:58:54.585604499 +0000 UTC m=+496.012445648" Jun 02 01:59:05.550683 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:05.550651 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-dsrw4" Jun 02 01:59:07.883967 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.883933 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f"] Jun 02 01:59:07.891727 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.891710 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:07.896779 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.896759 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:59:07.897860 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.897840 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 01:59:07.898126 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.898107 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 01:59:07.898213 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.898108 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:59:07.899585 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.899570 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n9thh\"" Jun 02 01:59:07.907813 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.907791 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f"] Jun 02 01:59:07.998381 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.998362 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rg8s\" (UniqueName: \"kubernetes.io/projected/31e29f2a-d333-4381-96f0-96c52cb46c34-kube-api-access-7rg8s\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:07.998490 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.998390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31e29f2a-d333-4381-96f0-96c52cb46c34-tmp\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:07.998490 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:07.998421 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e29f2a-d333-4381-96f0-96c52cb46c34-tls-certs\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.098967 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.098934 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rg8s\" (UniqueName: \"kubernetes.io/projected/31e29f2a-d333-4381-96f0-96c52cb46c34-kube-api-access-7rg8s\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.099061 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.098974 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31e29f2a-d333-4381-96f0-96c52cb46c34-tmp\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.099061 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.099000 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e29f2a-d333-4381-96f0-96c52cb46c34-tls-certs\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.101245 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.101224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31e29f2a-d333-4381-96f0-96c52cb46c34-tmp\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.101504 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.101484 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31e29f2a-d333-4381-96f0-96c52cb46c34-tls-certs\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.112205 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.112186 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rg8s\" (UniqueName: \"kubernetes.io/projected/31e29f2a-d333-4381-96f0-96c52cb46c34-kube-api-access-7rg8s\") pod \"kube-auth-proxy-c9f895b8b-hml8f\" (UID: \"31e29f2a-d333-4381-96f0-96c52cb46c34\") " pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.201318 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.201264 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" Jun 02 01:59:08.363474 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.363445 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f"] Jun 02 01:59:08.363990 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:59:08.363964 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e29f2a_d333_4381_96f0_96c52cb46c34.slice/crio-8fb67dc9c58431d668ed0d14281a94f3904d9c6cfe82dfee81c7c669a1b29e70 WatchSource:0}: Error finding container 8fb67dc9c58431d668ed0d14281a94f3904d9c6cfe82dfee81c7c669a1b29e70: Status 404 returned error can't find the container with id 8fb67dc9c58431d668ed0d14281a94f3904d9c6cfe82dfee81c7c669a1b29e70 Jun 02 01:59:08.585371 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:08.585343 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" event={"ID":"31e29f2a-d333-4381-96f0-96c52cb46c34","Type":"ContainerStarted","Data":"8fb67dc9c58431d668ed0d14281a94f3904d9c6cfe82dfee81c7c669a1b29e70"} Jun 02 01:59:09.319149 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.319113 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-q48sh"] Jun 02 01:59:09.322138 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.322117 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:09.325878 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.325858 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 01:59:09.338460 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.338436 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-q48sh"] Jun 02 01:59:09.409348 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.409316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbf62a8-f331-488b-8c92-57a77475ff4e-tls-certs\") pod \"model-serving-api-6577596cd5-q48sh\" (UID: \"2fbf62a8-f331-488b-8c92-57a77475ff4e\") " pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:09.409465 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.409364 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62bl7\" (UniqueName: \"kubernetes.io/projected/2fbf62a8-f331-488b-8c92-57a77475ff4e-kube-api-access-62bl7\") pod \"model-serving-api-6577596cd5-q48sh\" (UID: \"2fbf62a8-f331-488b-8c92-57a77475ff4e\") " pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:09.510363 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.509999 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbf62a8-f331-488b-8c92-57a77475ff4e-tls-certs\") pod \"model-serving-api-6577596cd5-q48sh\" (UID: \"2fbf62a8-f331-488b-8c92-57a77475ff4e\") " pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:09.510363 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.510047 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62bl7\" (UniqueName: \"kubernetes.io/projected/2fbf62a8-f331-488b-8c92-57a77475ff4e-kube-api-access-62bl7\") pod \"model-serving-api-6577596cd5-q48sh\" (UID: \"2fbf62a8-f331-488b-8c92-57a77475ff4e\") " pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:09.513103 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.513054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fbf62a8-f331-488b-8c92-57a77475ff4e-tls-certs\") pod \"model-serving-api-6577596cd5-q48sh\" (UID: \"2fbf62a8-f331-488b-8c92-57a77475ff4e\") " pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:09.528306 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.528282 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62bl7\" (UniqueName: \"kubernetes.io/projected/2fbf62a8-f331-488b-8c92-57a77475ff4e-kube-api-access-62bl7\") pod \"model-serving-api-6577596cd5-q48sh\" (UID: \"2fbf62a8-f331-488b-8c92-57a77475ff4e\") " pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:09.634153 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:09.634083 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:11.075738 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:11.075716 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-q48sh"] Jun 02 01:59:11.078049 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:59:11.078022 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbf62a8_f331_488b_8c92_57a77475ff4e.slice/crio-f3fe1eadc7247f9c17376e30fa7754647faa2d381bfd29ae185f3af4f32b6e2f WatchSource:0}: Error finding container f3fe1eadc7247f9c17376e30fa7754647faa2d381bfd29ae185f3af4f32b6e2f: Status 404 returned error can't find the container with id f3fe1eadc7247f9c17376e30fa7754647faa2d381bfd29ae185f3af4f32b6e2f Jun 02 01:59:11.595460 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:11.595429 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" event={"ID":"31e29f2a-d333-4381-96f0-96c52cb46c34","Type":"ContainerStarted","Data":"c61712cc16bd1d184e5fe63aabb2abb338f2967c90237f85e844096c90237e94"} Jun 02 01:59:11.596501 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:11.596477 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-q48sh" event={"ID":"2fbf62a8-f331-488b-8c92-57a77475ff4e","Type":"ContainerStarted","Data":"f3fe1eadc7247f9c17376e30fa7754647faa2d381bfd29ae185f3af4f32b6e2f"} Jun 02 01:59:11.614108 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:11.614065 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-c9f895b8b-hml8f" podStartSLOduration=1.968402288 podStartE2EDuration="4.614054651s" podCreationTimestamp="2026-06-02 01:59:07 +0000 UTC" firstStartedPulling="2026-06-02 01:59:08.36563356 +0000 UTC m=+509.792474618" lastFinishedPulling="2026-06-02 01:59:11.011285923 +0000 UTC m=+512.438126981" observedRunningTime="2026-06-02 01:59:11.612118644 +0000 UTC m=+513.038959723" watchObservedRunningTime="2026-06-02 01:59:11.614054651 +0000 UTC m=+513.040895732" Jun 02 01:59:13.602920 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:13.602882 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-q48sh" event={"ID":"2fbf62a8-f331-488b-8c92-57a77475ff4e","Type":"ContainerStarted","Data":"ed14ec81c537061e2de0fda463f19a744ff4e7b87cf7b5e8261c206f9860e6df"} Jun 02 01:59:13.603342 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:13.602996 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:13.624771 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:13.624726 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-q48sh" podStartSLOduration=2.675923321 podStartE2EDuration="4.624712919s" podCreationTimestamp="2026-06-02 01:59:09 +0000 UTC" firstStartedPulling="2026-06-02 01:59:11.080156368 +0000 UTC m=+512.506997434" lastFinishedPulling="2026-06-02 01:59:13.028945971 +0000 UTC m=+514.455787032" observedRunningTime="2026-06-02 01:59:13.623958128 +0000 UTC m=+515.050799208" watchObservedRunningTime="2026-06-02 01:59:13.624712919 +0000 UTC m=+515.051554041" Jun 02 01:59:19.153088 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.153012 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx"] Jun 02 01:59:19.155773 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.155753 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.158501 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.158480 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pg5fg\"" Jun 02 01:59:19.159602 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.159579 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 01:59:19.161087 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.161061 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-g659q"] Jun 02 01:59:19.164036 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.164016 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.167198 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.167180 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cmq7h\"" Jun 02 01:59:19.167483 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.167461 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 01:59:19.169731 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.169711 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx"] Jun 02 01:59:19.186202 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.186165 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-g659q"] Jun 02 01:59:19.281205 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.281180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ac093f0-10e2-4555-9609-79bea6a97f31-cert\") pod \"kserve-controller-manager-7c99ffcdcd-7r5rx\" (UID: \"4ac093f0-10e2-4555-9609-79bea6a97f31\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.281321 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.281220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8z9f\" (UniqueName: \"kubernetes.io/projected/4ac093f0-10e2-4555-9609-79bea6a97f31-kube-api-access-w8z9f\") pod \"kserve-controller-manager-7c99ffcdcd-7r5rx\" (UID: \"4ac093f0-10e2-4555-9609-79bea6a97f31\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.281321 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.281281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtv6b\" (UniqueName: \"kubernetes.io/projected/b18ec1a0-406d-4e40-b1e9-ce4e46ab8005-kube-api-access-qtv6b\") pod \"llmisvc-controller-manager-c6b9847d7-g659q\" (UID: \"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.281449 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.281324 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b18ec1a0-406d-4e40-b1e9-ce4e46ab8005-cert\") pod \"llmisvc-controller-manager-c6b9847d7-g659q\" (UID: \"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.381748 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.381723 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ac093f0-10e2-4555-9609-79bea6a97f31-cert\") pod \"kserve-controller-manager-7c99ffcdcd-7r5rx\" (UID: \"4ac093f0-10e2-4555-9609-79bea6a97f31\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.381849 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.381769 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8z9f\" (UniqueName: \"kubernetes.io/projected/4ac093f0-10e2-4555-9609-79bea6a97f31-kube-api-access-w8z9f\") pod \"kserve-controller-manager-7c99ffcdcd-7r5rx\" (UID: \"4ac093f0-10e2-4555-9609-79bea6a97f31\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.381849 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.381800 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtv6b\" (UniqueName: \"kubernetes.io/projected/b18ec1a0-406d-4e40-b1e9-ce4e46ab8005-kube-api-access-qtv6b\") pod \"llmisvc-controller-manager-c6b9847d7-g659q\" (UID: \"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.381849 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.381818 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b18ec1a0-406d-4e40-b1e9-ce4e46ab8005-cert\") pod \"llmisvc-controller-manager-c6b9847d7-g659q\" (UID: \"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.384247 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.384214 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ac093f0-10e2-4555-9609-79bea6a97f31-cert\") pod \"kserve-controller-manager-7c99ffcdcd-7r5rx\" (UID: \"4ac093f0-10e2-4555-9609-79bea6a97f31\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.384247 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.384231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b18ec1a0-406d-4e40-b1e9-ce4e46ab8005-cert\") pod \"llmisvc-controller-manager-c6b9847d7-g659q\" (UID: \"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.398457 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.398438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8z9f\" (UniqueName: \"kubernetes.io/projected/4ac093f0-10e2-4555-9609-79bea6a97f31-kube-api-access-w8z9f\") pod \"kserve-controller-manager-7c99ffcdcd-7r5rx\" (UID: \"4ac093f0-10e2-4555-9609-79bea6a97f31\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.402024 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.402007 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtv6b\" (UniqueName: \"kubernetes.io/projected/b18ec1a0-406d-4e40-b1e9-ce4e46ab8005-kube-api-access-qtv6b\") pod \"llmisvc-controller-manager-c6b9847d7-g659q\" (UID: \"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.467140 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.467084 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:19.475065 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.474763 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:19.607798 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.607682 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx"] Jun 02 01:59:19.610448 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:59:19.610420 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac093f0_10e2_4555_9609_79bea6a97f31.slice/crio-98142b3362bba5b311e5d77410dfffb2b4a90867d424b037ec9289ab501b75ef WatchSource:0}: Error finding container 98142b3362bba5b311e5d77410dfffb2b4a90867d424b037ec9289ab501b75ef: Status 404 returned error can't find the container with id 98142b3362bba5b311e5d77410dfffb2b4a90867d424b037ec9289ab501b75ef Jun 02 01:59:19.618973 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.618947 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" event={"ID":"4ac093f0-10e2-4555-9609-79bea6a97f31","Type":"ContainerStarted","Data":"98142b3362bba5b311e5d77410dfffb2b4a90867d424b037ec9289ab501b75ef"} Jun 02 01:59:19.633775 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:19.633755 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-g659q"] Jun 02 01:59:19.635711 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:59:19.635687 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb18ec1a0_406d_4e40_b1e9_ce4e46ab8005.slice/crio-c0dc44d7be202d9fc6624a9aeec6b6df5b78cd93e61c1b02709ad6aef397eed0 WatchSource:0}: Error finding container c0dc44d7be202d9fc6624a9aeec6b6df5b78cd93e61c1b02709ad6aef397eed0: Status 404 returned error can't find the container with id c0dc44d7be202d9fc6624a9aeec6b6df5b78cd93e61c1b02709ad6aef397eed0 Jun 02 01:59:20.623128 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:20.623093 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" event={"ID":"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005","Type":"ContainerStarted","Data":"c0dc44d7be202d9fc6624a9aeec6b6df5b78cd93e61c1b02709ad6aef397eed0"} Jun 02 01:59:22.629928 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:22.629893 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" event={"ID":"4ac093f0-10e2-4555-9609-79bea6a97f31","Type":"ContainerStarted","Data":"3f2dc4b34d07369d6071e02a5df64706a7d0be777447058988a1822ffc6b5cf5"} Jun 02 01:59:22.630293 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:22.630004 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:22.654920 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:22.654869 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" podStartSLOduration=0.832556043 podStartE2EDuration="3.654852733s" podCreationTimestamp="2026-06-02 01:59:19 +0000 UTC" firstStartedPulling="2026-06-02 01:59:19.61163919 +0000 UTC m=+521.038480248" lastFinishedPulling="2026-06-02 01:59:22.433935874 +0000 UTC m=+523.860776938" observedRunningTime="2026-06-02 01:59:22.654767996 +0000 UTC m=+524.081609076" watchObservedRunningTime="2026-06-02 01:59:22.654852733 +0000 UTC m=+524.081693814" Jun 02 01:59:23.633439 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:23.633342 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" event={"ID":"b18ec1a0-406d-4e40-b1e9-ce4e46ab8005","Type":"ContainerStarted","Data":"de838c56fcd6ee55a1d8a725dc3f1c34bd69c0e99b4c10c1c249b202ad708d28"} Jun 02 01:59:23.633819 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:23.633610 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:23.668445 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:23.668378 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" podStartSLOduration=1.021228236 podStartE2EDuration="4.668363772s" podCreationTimestamp="2026-06-02 01:59:19 +0000 UTC" firstStartedPulling="2026-06-02 01:59:19.637038789 +0000 UTC m=+521.063879848" lastFinishedPulling="2026-06-02 01:59:23.284174313 +0000 UTC m=+524.711015384" observedRunningTime="2026-06-02 01:59:23.667060241 +0000 UTC m=+525.093901322" watchObservedRunningTime="2026-06-02 01:59:23.668363772 +0000 UTC m=+525.095204851" Jun 02 01:59:24.608900 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:24.608871 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-q48sh" Jun 02 01:59:32.210512 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.210475 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bs574"] Jun 02 01:59:32.212732 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.212710 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.215394 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.215359 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 01:59:32.215500 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.215393 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 01:59:32.215500 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.215359 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-sg5sk\"" Jun 02 01:59:32.223175 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.223142 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bs574"] Jun 02 01:59:32.275462 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.275437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-288tm\" (UniqueName: \"kubernetes.io/projected/29dc1346-9c68-4b85-a6ef-6e88ca2db95a-kube-api-access-288tm\") pod \"servicemesh-operator3-55f49c5f94-bs574\" (UID: \"29dc1346-9c68-4b85-a6ef-6e88ca2db95a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.275557 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.275482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/29dc1346-9c68-4b85-a6ef-6e88ca2db95a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bs574\" (UID: \"29dc1346-9c68-4b85-a6ef-6e88ca2db95a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.375790 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.375765 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-288tm\" (UniqueName: \"kubernetes.io/projected/29dc1346-9c68-4b85-a6ef-6e88ca2db95a-kube-api-access-288tm\") pod \"servicemesh-operator3-55f49c5f94-bs574\" (UID: \"29dc1346-9c68-4b85-a6ef-6e88ca2db95a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.375876 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.375804 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/29dc1346-9c68-4b85-a6ef-6e88ca2db95a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bs574\" (UID: \"29dc1346-9c68-4b85-a6ef-6e88ca2db95a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.378203 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.378185 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/29dc1346-9c68-4b85-a6ef-6e88ca2db95a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bs574\" (UID: \"29dc1346-9c68-4b85-a6ef-6e88ca2db95a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.384230 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.384208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-288tm\" (UniqueName: \"kubernetes.io/projected/29dc1346-9c68-4b85-a6ef-6e88ca2db95a-kube-api-access-288tm\") pod \"servicemesh-operator3-55f49c5f94-bs574\" (UID: \"29dc1346-9c68-4b85-a6ef-6e88ca2db95a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.522420 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.522381 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:32.650315 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:32.650288 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bs574"] Jun 02 01:59:32.655708 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:59:32.655656 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29dc1346_9c68_4b85_a6ef_6e88ca2db95a.slice/crio-4b359c9c3756d153deb9ad72d59f4192d29e3dc3759c61a8d75bd9c76d86d8ff WatchSource:0}: Error finding container 4b359c9c3756d153deb9ad72d59f4192d29e3dc3759c61a8d75bd9c76d86d8ff: Status 404 returned error can't find the container with id 4b359c9c3756d153deb9ad72d59f4192d29e3dc3759c61a8d75bd9c76d86d8ff Jun 02 01:59:33.662505 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:33.662455 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" event={"ID":"29dc1346-9c68-4b85-a6ef-6e88ca2db95a","Type":"ContainerStarted","Data":"4b359c9c3756d153deb9ad72d59f4192d29e3dc3759c61a8d75bd9c76d86d8ff"} Jun 02 01:59:36.673309 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:36.673273 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" event={"ID":"29dc1346-9c68-4b85-a6ef-6e88ca2db95a","Type":"ContainerStarted","Data":"a5728256042dd608052a6b637bd32aa8fa958fab1946c46bd2adb81036c64d5b"} Jun 02 01:59:36.673669 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:36.673331 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:36.695067 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:36.695023 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" podStartSLOduration=1.570230391 podStartE2EDuration="4.695012754s" podCreationTimestamp="2026-06-02 01:59:32 +0000 UTC" firstStartedPulling="2026-06-02 01:59:32.657123412 +0000 UTC m=+534.083964474" lastFinishedPulling="2026-06-02 01:59:35.781905768 +0000 UTC m=+537.208746837" observedRunningTime="2026-06-02 01:59:36.693528703 +0000 UTC m=+538.120369806" watchObservedRunningTime="2026-06-02 01:59:36.695012754 +0000 UTC m=+538.121853833" Jun 02 01:59:43.601760 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.601729 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5ffbc658cc-hh6rm"] Jun 02 01:59:43.606597 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.606574 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:43.609547 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.609521 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 01:59:43.609653 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.609531 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cn584\"" Jun 02 01:59:43.614492 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.614469 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ffbc658cc-hh6rm"] Jun 02 01:59:43.760189 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.760158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d38a282a-d0c3-4e09-84d8-7d3da815260a-redirect-config\") pod \"dashboard-redirect-5ffbc658cc-hh6rm\" (UID: \"d38a282a-d0c3-4e09-84d8-7d3da815260a\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:43.760306 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.760199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wxw\" (UniqueName: \"kubernetes.io/projected/d38a282a-d0c3-4e09-84d8-7d3da815260a-kube-api-access-k9wxw\") pod \"dashboard-redirect-5ffbc658cc-hh6rm\" (UID: \"d38a282a-d0c3-4e09-84d8-7d3da815260a\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:43.861478 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.861395 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wxw\" (UniqueName: \"kubernetes.io/projected/d38a282a-d0c3-4e09-84d8-7d3da815260a-kube-api-access-k9wxw\") pod \"dashboard-redirect-5ffbc658cc-hh6rm\" (UID: \"d38a282a-d0c3-4e09-84d8-7d3da815260a\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:43.861574 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.861479 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d38a282a-d0c3-4e09-84d8-7d3da815260a-redirect-config\") pod \"dashboard-redirect-5ffbc658cc-hh6rm\" (UID: \"d38a282a-d0c3-4e09-84d8-7d3da815260a\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:43.862092 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.862074 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d38a282a-d0c3-4e09-84d8-7d3da815260a-redirect-config\") pod \"dashboard-redirect-5ffbc658cc-hh6rm\" (UID: \"d38a282a-d0c3-4e09-84d8-7d3da815260a\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:43.871790 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.871757 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wxw\" (UniqueName: \"kubernetes.io/projected/d38a282a-d0c3-4e09-84d8-7d3da815260a-kube-api-access-k9wxw\") pod \"dashboard-redirect-5ffbc658cc-hh6rm\" (UID: \"d38a282a-d0c3-4e09-84d8-7d3da815260a\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:43.917418 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:43.917381 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" Jun 02 01:59:44.037551 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:44.037518 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ffbc658cc-hh6rm"] Jun 02 01:59:44.040549 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:59:44.040515 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38a282a_d0c3_4e09_84d8_7d3da815260a.slice/crio-bbd6f33d435c67104b82189f67550372a90cea3ea0f65a23acaf134fe4aacedb WatchSource:0}: Error finding container bbd6f33d435c67104b82189f67550372a90cea3ea0f65a23acaf134fe4aacedb: Status 404 returned error can't find the container with id bbd6f33d435c67104b82189f67550372a90cea3ea0f65a23acaf134fe4aacedb Jun 02 01:59:44.703342 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:44.703306 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" event={"ID":"d38a282a-d0c3-4e09-84d8-7d3da815260a","Type":"ContainerStarted","Data":"bbd6f33d435c67104b82189f67550372a90cea3ea0f65a23acaf134fe4aacedb"} Jun 02 01:59:46.713672 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:46.713635 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" event={"ID":"d38a282a-d0c3-4e09-84d8-7d3da815260a","Type":"ContainerStarted","Data":"db424640f0d2b029f6d5e34c5beb6f5c85233303e159fa322d3cb9baff6e2fc5"} Jun 02 01:59:46.729692 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:46.729645 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5ffbc658cc-hh6rm" podStartSLOduration=1.8293574769999998 podStartE2EDuration="3.729629367s" podCreationTimestamp="2026-06-02 01:59:43 +0000 UTC" firstStartedPulling="2026-06-02 01:59:44.041904471 +0000 UTC m=+545.468745529" lastFinishedPulling="2026-06-02 01:59:45.942176356 +0000 UTC m=+547.369017419" observedRunningTime="2026-06-02 01:59:46.729292963 +0000 UTC m=+548.156134043" watchObservedRunningTime="2026-06-02 01:59:46.729629367 +0000 UTC m=+548.156470447" Jun 02 01:59:47.680556 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:47.680523 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bs574" Jun 02 01:59:53.638770 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:53.638737 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-7r5rx" Jun 02 01:59:54.638205 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:54.638172 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-g659q" Jun 02 01:59:57.351547 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.351509 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4"] Jun 02 01:59:57.356218 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.356196 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.359390 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.359368 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 01:59:57.359390 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.359379 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sdwkx\"" Jun 02 01:59:57.359566 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.359375 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 01:59:57.359621 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.359602 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 01:59:57.359621 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.359611 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 01:59:57.365984 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.365964 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4"] Jun 02 01:59:57.465176 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.465150 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.465288 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.465180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.465288 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.465208 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.465288 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.465234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klk5q\" (UniqueName: \"kubernetes.io/projected/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-kube-api-access-klk5q\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.465387 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.465291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.465387 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.465310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.465387 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.465329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.566281 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.566247 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.566281 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.566284 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.566487 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.566306 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.566487 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.566324 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klk5q\" (UniqueName: \"kubernetes.io/projected/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-kube-api-access-klk5q\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.566596 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.566511 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.566596 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.566552 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.566596 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.566586 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.567186 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.567158 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.568722 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.568703 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-local-certs\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.568822 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.568776 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-cacerts\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.568913 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.568892 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.568999 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.568986 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.574894 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.574873 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klk5q\" (UniqueName: \"kubernetes.io/projected/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-kube-api-access-klk5q\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.574976 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.574922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6104f54-fa8f-4e5e-a9e4-05a44daff41b-istio-token\") pod \"istiod-openshift-gateway-798958bb55-klcr4\" (UID: \"e6104f54-fa8f-4e5e-a9e4-05a44daff41b\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.666592 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.666531 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 01:59:57.806050 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:57.806000 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4"] Jun 02 01:59:57.809125 ip-10-0-142-223 kubenswrapper[2558]: W0602 01:59:57.809090 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6104f54_fa8f_4e5e_a9e4_05a44daff41b.slice/crio-e6d2f95c044a604fca34ab56cdf50f4fb1e427ce4cae2592030a79d2d4e729ea WatchSource:0}: Error finding container e6d2f95c044a604fca34ab56cdf50f4fb1e427ce4cae2592030a79d2d4e729ea: Status 404 returned error can't find the container with id e6d2f95c044a604fca34ab56cdf50f4fb1e427ce4cae2592030a79d2d4e729ea Jun 02 01:59:58.753308 ip-10-0-142-223 kubenswrapper[2558]: I0602 01:59:58.753275 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" event={"ID":"e6104f54-fa8f-4e5e-a9e4-05a44daff41b","Type":"ContainerStarted","Data":"e6d2f95c044a604fca34ab56cdf50f4fb1e427ce4cae2592030a79d2d4e729ea"} Jun 02 02:00:01.930271 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:01.930229 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 02:00:01.930525 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:01.930314 2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 02:00:02.767487 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:02.767453 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" event={"ID":"e6104f54-fa8f-4e5e-a9e4-05a44daff41b","Type":"ContainerStarted","Data":"6f332080e9ad895eebc5d4a1d2fac13748dab3b0223bd7414d3e8df59012f554"} Jun 02 02:00:02.767705 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:02.767686 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 02:00:02.769338 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:02.769313 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-klcr4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 02:00:02.769464 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:02.769370 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" podUID="e6104f54-fa8f-4e5e-a9e4-05a44daff41b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 02:00:02.796804 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:02.796740 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" podStartSLOduration=1.678159561 podStartE2EDuration="5.796722184s" podCreationTimestamp="2026-06-02 01:59:57 +0000 UTC" firstStartedPulling="2026-06-02 01:59:57.811417613 +0000 UTC m=+559.238258673" lastFinishedPulling="2026-06-02 02:00:01.929980221 +0000 UTC m=+563.356821296" observedRunningTime="2026-06-02 02:00:02.79533408 +0000 UTC m=+564.222175160" watchObservedRunningTime="2026-06-02 02:00:02.796722184 +0000 UTC m=+564.223563263" Jun 02 02:00:03.771775 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:00:03.771746 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-klcr4" Jun 02 02:01:08.446670 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.446582 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49"] Jun 02 02:01:08.448636 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.448621 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.452834 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.452812 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s6xgs\"" Jun 02 02:01:08.453001 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.452983 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 02:01:08.453269 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.453252 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 02:01:08.463746 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.463719 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49"] Jun 02 02:01:08.540365 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.540320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcn5s\" (UniqueName: \"kubernetes.io/projected/feafa05a-3b56-4835-8775-e22bdf883746-kube-api-access-gcn5s\") pod \"kuadrant-operator-controller-manager-84b657d985-wfd49\" (UID: \"feafa05a-3b56-4835-8775-e22bdf883746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.540565 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.540380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feafa05a-3b56-4835-8775-e22bdf883746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-wfd49\" (UID: \"feafa05a-3b56-4835-8775-e22bdf883746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.581031 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.580991 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49"] Jun 02 02:01:08.581229 ip-10-0-142-223 kubenswrapper[2558]: E0602 02:01:08.581210 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-gcn5s], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" podUID="feafa05a-3b56-4835-8775-e22bdf883746" Jun 02 02:01:08.623794 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.623758 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9"] Jun 02 02:01:08.626111 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.626088 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.636586 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.636550 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49"] Jun 02 02:01:08.641598 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.641572 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcn5s\" (UniqueName: \"kubernetes.io/projected/feafa05a-3b56-4835-8775-e22bdf883746-kube-api-access-gcn5s\") pod \"kuadrant-operator-controller-manager-84b657d985-wfd49\" (UID: \"feafa05a-3b56-4835-8775-e22bdf883746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.641730 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.641634 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feafa05a-3b56-4835-8775-e22bdf883746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-wfd49\" (UID: \"feafa05a-3b56-4835-8775-e22bdf883746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.641730 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.641667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e2979c6-7a72-494d-a0ab-1e77dcec68ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-524k9\" (UID: \"9e2979c6-7a72-494d-a0ab-1e77dcec68ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.641837 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.641735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q256t\" (UniqueName: \"kubernetes.io/projected/9e2979c6-7a72-494d-a0ab-1e77dcec68ac-kube-api-access-q256t\") pod \"kuadrant-operator-controller-manager-55c7f4c975-524k9\" (UID: \"9e2979c6-7a72-494d-a0ab-1e77dcec68ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.642073 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.642052 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feafa05a-3b56-4835-8775-e22bdf883746-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-wfd49\" (UID: \"feafa05a-3b56-4835-8775-e22bdf883746\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.648017 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.647988 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9"] Jun 02 02:01:08.661891 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.661855 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49"] Jun 02 02:01:08.682600 ip-10-0-142-223 kubenswrapper[2558]: E0602 02:01:08.682572 2558 projected.go:194] Error preparing data for projected volume kube-api-access-gcn5s for pod kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49: failed to fetch token: pods "kuadrant-operator-controller-manager-84b657d985-wfd49" not found Jun 02 02:01:08.682742 ip-10-0-142-223 kubenswrapper[2558]: E0602 02:01:08.682647 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feafa05a-3b56-4835-8775-e22bdf883746-kube-api-access-gcn5s podName:feafa05a-3b56-4835-8775-e22bdf883746 nodeName:}" failed. No retries permitted until 2026-06-02 02:01:09.182628145 +0000 UTC m=+630.609469210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gcn5s" (UniqueName: "kubernetes.io/projected/feafa05a-3b56-4835-8775-e22bdf883746-kube-api-access-gcn5s") pod "kuadrant-operator-controller-manager-84b657d985-wfd49" (UID: "feafa05a-3b56-4835-8775-e22bdf883746") : failed to fetch token: pods "kuadrant-operator-controller-manager-84b657d985-wfd49" not found Jun 02 02:01:08.742981 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.742949 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e2979c6-7a72-494d-a0ab-1e77dcec68ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-524k9\" (UID: \"9e2979c6-7a72-494d-a0ab-1e77dcec68ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.743161 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.743129 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q256t\" (UniqueName: \"kubernetes.io/projected/9e2979c6-7a72-494d-a0ab-1e77dcec68ac-kube-api-access-q256t\") pod \"kuadrant-operator-controller-manager-55c7f4c975-524k9\" (UID: \"9e2979c6-7a72-494d-a0ab-1e77dcec68ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.743323 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.743302 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e2979c6-7a72-494d-a0ab-1e77dcec68ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-524k9\" (UID: \"9e2979c6-7a72-494d-a0ab-1e77dcec68ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.762212 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.762184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q256t\" (UniqueName: \"kubernetes.io/projected/9e2979c6-7a72-494d-a0ab-1e77dcec68ac-kube-api-access-q256t\") pod \"kuadrant-operator-controller-manager-55c7f4c975-524k9\" (UID: \"9e2979c6-7a72-494d-a0ab-1e77dcec68ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.936983 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.936946 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:08.975231 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.975202 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.977868 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.977837 2558 status_manager.go:895] "Failed to get status for pod" podUID="feafa05a-3b56-4835-8775-e22bdf883746" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" err="pods \"kuadrant-operator-controller-manager-84b657d985-wfd49\" is forbidden: User \"system:node:ip-10-0-142-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-223.ec2.internal' and this object" Jun 02 02:01:08.980155 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.980135 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:08.983580 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:08.983172 2558 status_manager.go:895] "Failed to get status for pod" podUID="feafa05a-3b56-4835-8775-e22bdf883746" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" err="pods \"kuadrant-operator-controller-manager-84b657d985-wfd49\" is forbidden: User \"system:node:ip-10-0-142-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-223.ec2.internal' and this object" Jun 02 02:01:09.046018 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.045984 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feafa05a-3b56-4835-8775-e22bdf883746-extensions-socket-volume\") pod \"feafa05a-3b56-4835-8775-e22bdf883746\" (UID: \"feafa05a-3b56-4835-8775-e22bdf883746\") " Jun 02 02:01:09.046217 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.046201 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcn5s\" (UniqueName: \"kubernetes.io/projected/feafa05a-3b56-4835-8775-e22bdf883746-kube-api-access-gcn5s\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 02:01:09.046292 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.046243 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feafa05a-3b56-4835-8775-e22bdf883746-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "feafa05a-3b56-4835-8775-e22bdf883746" (UID: "feafa05a-3b56-4835-8775-e22bdf883746"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:01:09.073855 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.073827 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9"] Jun 02 02:01:09.076591 ip-10-0-142-223 kubenswrapper[2558]: W0602 02:01:09.076556 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2979c6_7a72_494d_a0ab_1e77dcec68ac.slice/crio-159601a0a89f06a8465937a3ecaa88ce8a4881cea44c2c4b27bfb94cb29101e7 WatchSource:0}: Error finding container 159601a0a89f06a8465937a3ecaa88ce8a4881cea44c2c4b27bfb94cb29101e7: Status 404 returned error can't find the container with id 159601a0a89f06a8465937a3ecaa88ce8a4881cea44c2c4b27bfb94cb29101e7 Jun 02 02:01:09.078862 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.078847 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:01:09.111601 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.111566 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feafa05a-3b56-4835-8775-e22bdf883746" path="/var/lib/kubelet/pods/feafa05a-3b56-4835-8775-e22bdf883746/volumes" Jun 02 02:01:09.111866 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.111845 2558 status_manager.go:895] "Failed to get status for pod" podUID="feafa05a-3b56-4835-8775-e22bdf883746" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" err="pods \"kuadrant-operator-controller-manager-84b657d985-wfd49\" is forbidden: User \"system:node:ip-10-0-142-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-223.ec2.internal' and this object" Jun 02 02:01:09.147449 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.147418 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/feafa05a-3b56-4835-8775-e22bdf883746-extensions-socket-volume\") on node \"ip-10-0-142-223.ec2.internal\" DevicePath \"\"" Jun 02 02:01:09.979643 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.979609 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" Jun 02 02:01:09.980108 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.979641 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" event={"ID":"9e2979c6-7a72-494d-a0ab-1e77dcec68ac","Type":"ContainerStarted","Data":"159601a0a89f06a8465937a3ecaa88ce8a4881cea44c2c4b27bfb94cb29101e7"} Jun 02 02:01:09.987926 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:09.987890 2558 status_manager.go:895] "Failed to get status for pod" podUID="feafa05a-3b56-4835-8775-e22bdf883746" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-wfd49" err="pods \"kuadrant-operator-controller-manager-84b657d985-wfd49\" is forbidden: User \"system:node:ip-10-0-142-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-223.ec2.internal' and this object" Jun 02 02:01:12.992473 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:12.992433 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" event={"ID":"9e2979c6-7a72-494d-a0ab-1e77dcec68ac","Type":"ContainerStarted","Data":"d414c6129c002e44f3050d252d451199f36798d170cf32c8a5d8397d1b7c3c3c"} Jun 02 02:01:12.992888 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:12.992566 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:13.015610 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:13.015560 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" podStartSLOduration=1.5049309 podStartE2EDuration="5.015544772s" podCreationTimestamp="2026-06-02 02:01:08 +0000 UTC" firstStartedPulling="2026-06-02 02:01:09.078965369 +0000 UTC m=+630.505806427" lastFinishedPulling="2026-06-02 02:01:12.589579226 +0000 UTC m=+634.016420299" observedRunningTime="2026-06-02 02:01:13.013141097 +0000 UTC m=+634.439982178" watchObservedRunningTime="2026-06-02 02:01:13.015544772 +0000 UTC m=+634.442385923" Jun 02 02:01:23.997933 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:23.997900 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-524k9" Jun 02 02:01:45.369610 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.369570 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:01:45.389284 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.389251 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:01:45.389471 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.389381 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.392356 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.392331 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dvzkm\"" Jun 02 02:01:45.392516 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.392332 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 02:01:45.403240 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.403215 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:01:45.555349 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.555300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwq8f\" (UniqueName: \"kubernetes.io/projected/a00a07f4-0692-450d-8da6-95aa9e09ea12-kube-api-access-zwq8f\") pod \"limitador-limitador-78c99df468-tpkgg\" (UID: \"a00a07f4-0692-450d-8da6-95aa9e09ea12\") " pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.555541 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.555427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a00a07f4-0692-450d-8da6-95aa9e09ea12-config-file\") pod \"limitador-limitador-78c99df468-tpkgg\" (UID: \"a00a07f4-0692-450d-8da6-95aa9e09ea12\") " pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.656596 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.656497 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a00a07f4-0692-450d-8da6-95aa9e09ea12-config-file\") pod \"limitador-limitador-78c99df468-tpkgg\" (UID: \"a00a07f4-0692-450d-8da6-95aa9e09ea12\") " pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.656596 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.656554 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwq8f\" (UniqueName: \"kubernetes.io/projected/a00a07f4-0692-450d-8da6-95aa9e09ea12-kube-api-access-zwq8f\") pod \"limitador-limitador-78c99df468-tpkgg\" (UID: \"a00a07f4-0692-450d-8da6-95aa9e09ea12\") " pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.657170 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.657142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a00a07f4-0692-450d-8da6-95aa9e09ea12-config-file\") pod \"limitador-limitador-78c99df468-tpkgg\" (UID: \"a00a07f4-0692-450d-8da6-95aa9e09ea12\") " pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.668413 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.668375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwq8f\" (UniqueName: \"kubernetes.io/projected/a00a07f4-0692-450d-8da6-95aa9e09ea12-kube-api-access-zwq8f\") pod \"limitador-limitador-78c99df468-tpkgg\" (UID: \"a00a07f4-0692-450d-8da6-95aa9e09ea12\") " pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.700167 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.700127 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:45.843343 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:45.843274 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:01:45.846160 ip-10-0-142-223 kubenswrapper[2558]: W0602 02:01:45.846134 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00a07f4_0692_450d_8da6_95aa9e09ea12.slice/crio-f70078557f4f0d3dad8c4c82acc05796921c19908a4678384528f3f7afeb486b WatchSource:0}: Error finding container f70078557f4f0d3dad8c4c82acc05796921c19908a4678384528f3f7afeb486b: Status 404 returned error can't find the container with id f70078557f4f0d3dad8c4c82acc05796921c19908a4678384528f3f7afeb486b Jun 02 02:01:46.099228 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:46.099193 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" event={"ID":"a00a07f4-0692-450d-8da6-95aa9e09ea12","Type":"ContainerStarted","Data":"f70078557f4f0d3dad8c4c82acc05796921c19908a4678384528f3f7afeb486b"} Jun 02 02:01:49.113508 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:49.113475 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" event={"ID":"a00a07f4-0692-450d-8da6-95aa9e09ea12","Type":"ContainerStarted","Data":"b7b7dc7f85e28b9ab6049444ba594c7b1059568c6611da888604b9e8d51008d9"} Jun 02 02:01:49.113855 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:49.113570 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:01:49.146356 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:01:49.146301 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" podStartSLOduration=1.702233324 podStartE2EDuration="4.146285397s" podCreationTimestamp="2026-06-02 02:01:45 +0000 UTC" firstStartedPulling="2026-06-02 02:01:45.847869651 +0000 UTC m=+667.274710713" lastFinishedPulling="2026-06-02 02:01:48.291921728 +0000 UTC m=+669.718762786" observedRunningTime="2026-06-02 02:01:49.144451313 +0000 UTC m=+670.571292390" watchObservedRunningTime="2026-06-02 02:01:49.146285397 +0000 UTC m=+670.573126522" Jun 02 02:02:00.117167 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:02:00.117135 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-tpkgg" Jun 02 02:03:49.062461 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:03:49.062365 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:04:48.508832 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:04:48.508791 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:04:58.202604 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:04:58.202566 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:05:07.411277 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:05:07.411239 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:05:11.202633 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:05:11.202593 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:05:16.109385 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:05:16.109343 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:05:27.014886 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:05:27.014799 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-tpkgg"] Jun 02 02:11:47.043764 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:47.043734 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ffbc658cc-hh6rm_d38a282a-d0c3-4e09-84d8-7d3da815260a/nginx/0.log" Jun 02 02:11:47.153490 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:47.153456 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-7r5rx_4ac093f0-10e2-4555-9609-79bea6a97f31/manager/0.log" Jun 02 02:11:47.279516 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:47.279476 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-g659q_b18ec1a0-406d-4e40-b1e9-ce4e46ab8005/manager/0.log" Jun 02 02:11:47.612443 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:47.612413 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-q48sh_2fbf62a8-f331-488b-8c92-57a77475ff4e/server/0.log" Jun 02 02:11:47.836947 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:47.836918 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-dsrw4_4929b698-0aaf-4c0d-b808-d8b850d28ec6/copy-manifests/0.log" Jun 02 02:11:47.843847 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:47.843814 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-dsrw4_4929b698-0aaf-4c0d-b808-d8b850d28ec6/manager/0.log" Jun 02 02:11:49.988324 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:49.988285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-524k9_9e2979c6-7a72-494d-a0ab-1e77dcec68ac/manager/0.log" Jun 02 02:11:50.097959 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:50.097927 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-tpkgg_a00a07f4-0692-450d-8da6-95aa9e09ea12/limitador/0.log" Jun 02 02:11:50.667650 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:50.667620 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-klcr4_e6104f54-fa8f-4e5e-a9e4-05a44daff41b/discovery/0.log" Jun 02 02:11:50.780577 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:50.780548 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f895b8b-hml8f_31e29f2a-d333-4381-96f0-96c52cb46c34/kube-auth-proxy/0.log" Jun 02 02:11:56.062865 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.062830 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kl4qd/must-gather-f9dd9"] Jun 02 02:11:56.065056 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.065033 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.067568 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.067547 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kl4qd\"/\"default-dockercfg-pzj7r\"" Jun 02 02:11:56.067664 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.067579 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kl4qd\"/\"openshift-service-ca.crt\"" Jun 02 02:11:56.068157 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.068143 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kl4qd\"/\"kube-root-ca.crt\"" Jun 02 02:11:56.091337 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.091314 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/must-gather-f9dd9"] Jun 02 02:11:56.098738 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.098717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e12146f8-9a85-401f-96df-19e623ec7e79-must-gather-output\") pod \"must-gather-f9dd9\" (UID: \"e12146f8-9a85-401f-96df-19e623ec7e79\") " pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.098863 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.098795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwn2h\" (UniqueName: \"kubernetes.io/projected/e12146f8-9a85-401f-96df-19e623ec7e79-kube-api-access-fwn2h\") pod \"must-gather-f9dd9\" (UID: \"e12146f8-9a85-401f-96df-19e623ec7e79\") " pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.200073 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.200053 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwn2h\" (UniqueName: \"kubernetes.io/projected/e12146f8-9a85-401f-96df-19e623ec7e79-kube-api-access-fwn2h\") pod \"must-gather-f9dd9\" (UID: \"e12146f8-9a85-401f-96df-19e623ec7e79\") " pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.200185 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.200105 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e12146f8-9a85-401f-96df-19e623ec7e79-must-gather-output\") pod \"must-gather-f9dd9\" (UID: \"e12146f8-9a85-401f-96df-19e623ec7e79\") " pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.200365 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.200348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e12146f8-9a85-401f-96df-19e623ec7e79-must-gather-output\") pod \"must-gather-f9dd9\" (UID: \"e12146f8-9a85-401f-96df-19e623ec7e79\") " pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.211004 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.210978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwn2h\" (UniqueName: \"kubernetes.io/projected/e12146f8-9a85-401f-96df-19e623ec7e79-kube-api-access-fwn2h\") pod \"must-gather-f9dd9\" (UID: \"e12146f8-9a85-401f-96df-19e623ec7e79\") " pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.373860 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.373803 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/must-gather-f9dd9" Jun 02 02:11:56.497823 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.497789 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/must-gather-f9dd9"] Jun 02 02:11:56.501015 ip-10-0-142-223 kubenswrapper[2558]: W0602 02:11:56.500983 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode12146f8_9a85_401f_96df_19e623ec7e79.slice/crio-0bb7dcc8c5fb851fdad8d5a11b9d20bf329c44ac71fdc4a575c994893996f2b2 WatchSource:0}: Error finding container 0bb7dcc8c5fb851fdad8d5a11b9d20bf329c44ac71fdc4a575c994893996f2b2: Status 404 returned error can't find the container with id 0bb7dcc8c5fb851fdad8d5a11b9d20bf329c44ac71fdc4a575c994893996f2b2 Jun 02 02:11:56.502666 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:56.502648 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:11:57.091918 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:57.091880 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/must-gather-f9dd9" event={"ID":"e12146f8-9a85-401f-96df-19e623ec7e79","Type":"ContainerStarted","Data":"0bb7dcc8c5fb851fdad8d5a11b9d20bf329c44ac71fdc4a575c994893996f2b2"} Jun 02 02:11:58.099386 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:58.099340 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/must-gather-f9dd9" event={"ID":"e12146f8-9a85-401f-96df-19e623ec7e79","Type":"ContainerStarted","Data":"d2032502b545f1744493215c3ac63d9a5579dc111ba8a7688d9fe928cc347c78"} Jun 02 02:11:58.099881 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:58.099392 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/must-gather-f9dd9" event={"ID":"e12146f8-9a85-401f-96df-19e623ec7e79","Type":"ContainerStarted","Data":"aec48319f445ff0422c8504c689151c0d7eda6bb37b378bcd842ddb7cd7f0594"} Jun 02 02:11:58.122380 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:58.122320 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kl4qd/must-gather-f9dd9" podStartSLOduration=1.152539182 podStartE2EDuration="2.122301449s" podCreationTimestamp="2026-06-02 02:11:56 +0000 UTC" firstStartedPulling="2026-06-02 02:11:56.502774617 +0000 UTC m=+1277.929615675" lastFinishedPulling="2026-06-02 02:11:57.472536872 +0000 UTC m=+1278.899377942" observedRunningTime="2026-06-02 02:11:58.120958219 +0000 UTC m=+1279.547799299" watchObservedRunningTime="2026-06-02 02:11:58.122301449 +0000 UTC m=+1279.549142529" Jun 02 02:11:59.374754 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:59.374714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pxh7h_20b042ec-3d12-4d9d-bd6a-7b4be48de194/global-pull-secret-syncer/0.log" Jun 02 02:11:59.510031 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:59.509994 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mqbdl_62a3631a-2d33-40ad-b862-b2a7af8ad3ef/konnectivity-agent/0.log" Jun 02 02:11:59.651878 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:11:59.651804 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-223.ec2.internal_a4d8956cc70aced3c2a171d0401f8d5a/haproxy/0.log" Jun 02 02:12:03.425637 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:03.425597 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-524k9_9e2979c6-7a72-494d-a0ab-1e77dcec68ac/manager/0.log" Jun 02 02:12:03.451723 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:03.451692 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-tpkgg_a00a07f4-0692-450d-8da6-95aa9e09ea12/limitador/0.log" Jun 02 02:12:05.230476 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:05.230443 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dwzp_840b8578-8756-464a-8c62-5ad5d4b16a5a/node-exporter/0.log" Jun 02 02:12:05.266431 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:05.266372 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dwzp_840b8578-8756-464a-8c62-5ad5d4b16a5a/kube-rbac-proxy/0.log" Jun 02 02:12:05.300672 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:05.300642 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dwzp_840b8578-8756-464a-8c62-5ad5d4b16a5a/init-textfile/0.log" Jun 02 02:12:08.916202 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:08.916167 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz"] Jun 02 02:12:08.923672 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:08.923653 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:08.930374 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:08.930311 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz"] Jun 02 02:12:09.014667 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.014621 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-sys\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.014852 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.014695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-proc\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.014852 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.014722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9qwg\" (UniqueName: \"kubernetes.io/projected/be75afe5-448d-47bb-bcd0-f04e0c39881a-kube-api-access-n9qwg\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.014852 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.014762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-lib-modules\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.014852 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.014821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-podres\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.115978 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.115936 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-lib-modules\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116151 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116020 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-podres\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116151 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116096 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-sys\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116151 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116094 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-lib-modules\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116151 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116122 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-proc\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116151 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116148 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9qwg\" (UniqueName: \"kubernetes.io/projected/be75afe5-448d-47bb-bcd0-f04e0c39881a-kube-api-access-n9qwg\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116355 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116151 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-sys\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116355 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-podres\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.116355 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.116189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be75afe5-448d-47bb-bcd0-f04e0c39881a-proc\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.125110 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.125085 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9qwg\" (UniqueName: \"kubernetes.io/projected/be75afe5-448d-47bb-bcd0-f04e0c39881a-kube-api-access-n9qwg\") pod \"perf-node-gather-daemonset-l9xfz\" (UID: \"be75afe5-448d-47bb-bcd0-f04e0c39881a\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.234513 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.234481 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:09.404038 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:09.404008 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz"] Jun 02 02:12:10.158900 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.158856 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" event={"ID":"be75afe5-448d-47bb-bcd0-f04e0c39881a","Type":"ContainerStarted","Data":"a4f38783c0286d78a83c900533bcee17d2c7ccf351b6834f7b8a47d0d781c945"} Jun 02 02:12:10.158900 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.158908 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" event={"ID":"be75afe5-448d-47bb-bcd0-f04e0c39881a","Type":"ContainerStarted","Data":"a5bf9b7361aeb964709ebd82dfd8470bebfa96cab921ed762bb40d3cbed1cfd0"} Jun 02 02:12:10.159360 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.158944 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:10.177614 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.177573 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" podStartSLOduration=2.177561096 podStartE2EDuration="2.177561096s" podCreationTimestamp="2026-06-02 02:12:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:12:10.175743385 +0000 UTC m=+1291.602584464" watchObservedRunningTime="2026-06-02 02:12:10.177561096 +0000 UTC m=+1291.604402208" Jun 02 02:12:10.280819 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.280776 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqv5x_4f70a751-8443-4000-a3fa-011b6f2266c4/dns/0.log" Jun 02 02:12:10.303687 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.303664 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqv5x_4f70a751-8443-4000-a3fa-011b6f2266c4/kube-rbac-proxy/0.log" Jun 02 02:12:10.381541 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.381520 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zfdlf_d04fa77f-2175-478e-a43f-badbcde3f382/dns-node-resolver/0.log" Jun 02 02:12:10.925941 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:10.925912 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-szbhm_5163a79b-ba0d-424f-a8c2-6f6d203a3ce1/node-ca/0.log" Jun 02 02:12:11.950038 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:11.950005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-klcr4_e6104f54-fa8f-4e5e-a9e4-05a44daff41b/discovery/0.log" Jun 02 02:12:11.974284 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:11.974253 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-c9f895b8b-hml8f_31e29f2a-d333-4381-96f0-96c52cb46c34/kube-auth-proxy/0.log" Jun 02 02:12:12.766049 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:12.766017 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hdjcr_fdfea84c-aa82-4adb-94e3-9f7f8c3aefa0/serve-healthcheck-canary/0.log" Jun 02 02:12:13.242504 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:13.242479 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjjbr_062e4d3b-949d-47c2-af63-e1a7124e436d/kube-rbac-proxy/0.log" Jun 02 02:12:13.268116 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:13.268092 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjjbr_062e4d3b-949d-47c2-af63-e1a7124e436d/exporter/0.log" Jun 02 02:12:13.292887 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:13.292864 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjjbr_062e4d3b-949d-47c2-af63-e1a7124e436d/extractor/0.log" Jun 02 02:12:15.643980 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:15.643950 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ffbc658cc-hh6rm_d38a282a-d0c3-4e09-84d8-7d3da815260a/nginx/0.log" Jun 02 02:12:15.676383 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:15.676355 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-7r5rx_4ac093f0-10e2-4555-9609-79bea6a97f31/manager/0.log" Jun 02 02:12:15.726038 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:15.726007 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-g659q_b18ec1a0-406d-4e40-b1e9-ce4e46ab8005/manager/0.log" Jun 02 02:12:15.824344 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:15.824317 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-q48sh_2fbf62a8-f331-488b-8c92-57a77475ff4e/server/0.log" Jun 02 02:12:15.903219 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:15.903147 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-dsrw4_4929b698-0aaf-4c0d-b808-d8b850d28ec6/manager/0.log" Jun 02 02:12:15.925575 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:15.925556 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-dsrw4_4929b698-0aaf-4c0d-b808-d8b850d28ec6/copy-manifests/0.log" Jun 02 02:12:16.177865 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:16.177792 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-l9xfz" Jun 02 02:12:24.456206 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.456181 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w6txs_d409a04e-6b2c-4fed-8817-9edd829b9e82/kube-multus-additional-cni-plugins/0.log" Jun 02 02:12:24.485446 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.485421 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w6txs_d409a04e-6b2c-4fed-8817-9edd829b9e82/egress-router-binary-copy/0.log" Jun 02 02:12:24.510806 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.510786 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w6txs_d409a04e-6b2c-4fed-8817-9edd829b9e82/cni-plugins/0.log" Jun 02 02:12:24.544465 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.544444 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w6txs_d409a04e-6b2c-4fed-8817-9edd829b9e82/bond-cni-plugin/0.log" Jun 02 02:12:24.575886 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.575867 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w6txs_d409a04e-6b2c-4fed-8817-9edd829b9e82/routeoverride-cni/0.log" Jun 02 02:12:24.600642 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.600619 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w6txs_d409a04e-6b2c-4fed-8817-9edd829b9e82/whereabouts-cni-bincopy/0.log" Jun 02 02:12:24.624459 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.624438 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w6txs_d409a04e-6b2c-4fed-8817-9edd829b9e82/whereabouts-cni/0.log" Jun 02 02:12:24.728655 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.728628 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z9pdz_3b02f26a-8e91-4996-83a3-eb441924c7ad/kube-multus/0.log" Jun 02 02:12:24.897926 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.897888 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-td25w_4bd74378-1130-4430-b19a-15ac28885e01/network-metrics-daemon/0.log" Jun 02 02:12:24.919949 ip-10-0-142-223 kubenswrapper[2558]: I0602 02:12:24.919926 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-td25w_4bd74378-1130-4430-b19a-15ac28885e01/kube-rbac-proxy/0.log"