May 28 10:02:44.969945 ip-10-0-129-122 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 10:02:44.969958 ip-10-0-129-122 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 10:02:44.969968 ip-10-0-129-122 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 10:02:44.970278 ip-10-0-129-122 systemd[1]: Failed to start Kubernetes Kubelet. May 28 10:02:55.169381 ip-10-0-129-122 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 10:02:55.169398 ip-10-0-129-122 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e83cee78e994402eba869935f6fe8733 -- May 28 10:05:08.474640 ip-10-0-129-122 systemd[1]: Starting Kubernetes Kubelet... May 28 10:05:08.967523 ip-10-0-129-122 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 10:05:08.967523 ip-10-0-129-122 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 10:05:08.967523 ip-10-0-129-122 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 10:05:08.967523 ip-10-0-129-122 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 10:05:08.967523 ip-10-0-129-122 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 10:05:08.970952 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.970857 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 10:05:08.975963 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975947 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:05:08.975963 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975962 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975967 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975970 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975974 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975976 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975979 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975982 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975985 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975988 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975991 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.975994 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976004 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976009 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976012 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976015 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976018 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976021 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976023 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976026 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976029 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:05:08.976032 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976032 2574 feature_gate.go:328] unrecognized feature gate: Example May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976034 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976037 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976040 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976042 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976047 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976052 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976055 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976058 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976060 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976063 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976066 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976068 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976071 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976073 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976076 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976078 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976081 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976083 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:05:08.976521 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976086 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976089 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976091 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976094 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976096 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976099 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976101 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976104 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976106 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976109 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976111 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976114 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976117 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976120 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976122 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976125 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976129 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976131 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976135 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:05:08.976973 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976139 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976142 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976145 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976148 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976151 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976153 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976156 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976159 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976162 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976164 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976167 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976169 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976172 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976174 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976177 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976180 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976184 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976186 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976189 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:05:08.977464 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976191 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976194 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976196 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976199 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976201 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976205 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976208 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976211 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976629 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976635 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976639 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976642 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976645 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976647 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976650 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976653 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976655 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976658 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976660 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976663 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:05:08.977928 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976666 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976669 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976672 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976674 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976677 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976680 2574 feature_gate.go:328] unrecognized feature gate: Example May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976682 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976685 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976687 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976690 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976692 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976695 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976697 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976700 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976702 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976705 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976707 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976710 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976713 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976715 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:05:08.978427 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976718 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976721 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976724 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976727 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976729 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976732 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976735 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976737 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976740 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976742 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976744 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976747 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976750 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976753 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976755 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976760 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976763 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976766 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976770 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976772 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:05:08.978915 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976775 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976778 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976781 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976783 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976786 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976789 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976792 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976795 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976798 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976801 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976803 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976806 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976808 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976812 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976816 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976819 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976822 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976824 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976827 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:05:08.979418 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976830 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976833 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976835 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976838 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976841 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976843 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976846 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976849 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976851 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976854 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976856 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976859 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976861 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976864 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.976866 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978386 2574 flags.go:64] FLAG: --address="0.0.0.0" May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978400 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978407 2574 flags.go:64] FLAG: --anonymous-auth="true" May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978411 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978416 2574 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978420 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 10:05:08.979867 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978424 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978429 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978432 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978435 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978439 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978443 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978446 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978449 2574 flags.go:64] FLAG: --cgroup-root="" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978452 2574 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978455 2574 flags.go:64] FLAG: --client-ca-file="" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978458 2574 flags.go:64] FLAG: --cloud-config="" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978461 2574 flags.go:64] FLAG: --cloud-provider="external" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978464 2574 flags.go:64] FLAG: --cluster-dns="[]" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978470 2574 flags.go:64] FLAG: --cluster-domain="" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978473 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978476 2574 flags.go:64] FLAG: --config-dir="" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978479 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978482 2574 flags.go:64] FLAG: --container-log-max-files="5" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978486 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978490 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978494 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978497 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978500 2574 flags.go:64] FLAG: --contention-profiling="false" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978503 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 10:05:08.980412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978507 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978510 2574 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978513 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978517 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978520 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978524 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978527 2574 flags.go:64] FLAG: --enable-load-reader="false" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978531 2574 flags.go:64] FLAG: --enable-server="true" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978534 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978538 2574 flags.go:64] FLAG: --event-burst="100" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978542 2574 flags.go:64] FLAG: --event-qps="50" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978545 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978548 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978551 2574 flags.go:64] FLAG: --eviction-hard="" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978555 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978557 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978560 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978564 2574 flags.go:64] FLAG: --eviction-soft="" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978566 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978569 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978572 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978575 2574 flags.go:64] FLAG: --experimental-mounter-path="" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978579 2574 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978582 2574 flags.go:64] FLAG: --fail-swap-on="true" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978585 2574 flags.go:64] FLAG: --feature-gates="" May 28 10:05:08.981016 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978588 2574 flags.go:64] FLAG: --file-check-frequency="20s" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978591 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978594 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978598 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978601 2574 flags.go:64] FLAG: --healthz-port="10248" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978604 2574 flags.go:64] FLAG: --help="false" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978607 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-129-122.ec2.internal" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978611 2574 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978614 2574 flags.go:64] FLAG: --http-check-frequency="20s" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978617 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978620 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978624 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978627 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978630 2574 flags.go:64] FLAG: --image-service-endpoint="" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978634 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978636 2574 flags.go:64] FLAG: --kube-api-burst="100" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978639 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978643 2574 flags.go:64] FLAG: --kube-api-qps="50" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978646 2574 flags.go:64] FLAG: --kube-reserved="" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978649 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978652 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978655 2574 flags.go:64] FLAG: --kubelet-cgroups="" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978658 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978661 2574 flags.go:64] FLAG: --lock-file="" May 28 10:05:08.981635 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978664 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978667 2574 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978670 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978675 2574 flags.go:64] FLAG: --log-json-split-stream="false" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978678 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978681 2574 flags.go:64] FLAG: --log-text-split-stream="false" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978684 2574 flags.go:64] FLAG: --logging-format="text" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978687 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978690 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978693 2574 flags.go:64] FLAG: --manifest-url="" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978696 2574 flags.go:64] FLAG: --manifest-url-header="" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978700 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978704 2574 flags.go:64] FLAG: --max-open-files="1000000" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978708 2574 flags.go:64] FLAG: --max-pods="110" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978712 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978715 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978718 2574 flags.go:64] FLAG: --memory-manager-policy="None" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978721 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978724 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978727 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978730 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978737 2574 flags.go:64] FLAG: --node-status-max-images="50" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978741 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978744 2574 flags.go:64] FLAG: --oom-score-adj="-999" May 28 10:05:08.982230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978747 2574 flags.go:64] FLAG: --pod-cidr="" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978750 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978756 2574 flags.go:64] FLAG: --pod-manifest-path="" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978759 2574 flags.go:64] FLAG: --pod-max-pids="-1" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978762 2574 flags.go:64] FLAG: --pods-per-core="0" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978766 2574 flags.go:64] FLAG: --port="10250" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978769 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978772 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bd5b1e3c3bbaac62" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978775 2574 flags.go:64] FLAG: --qos-reserved="" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978778 2574 flags.go:64] FLAG: --read-only-port="10255" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978781 2574 flags.go:64] FLAG: --register-node="true" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978784 2574 flags.go:64] FLAG: --register-schedulable="true" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978787 2574 flags.go:64] FLAG: --register-with-taints="" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978791 2574 flags.go:64] FLAG: --registry-burst="10" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978794 2574 flags.go:64] FLAG: --registry-qps="5" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978797 2574 flags.go:64] FLAG: --reserved-cpus="" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978800 2574 flags.go:64] FLAG: --reserved-memory="" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978803 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978806 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978809 2574 flags.go:64] FLAG: --rotate-certificates="false" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978813 2574 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978816 2574 flags.go:64] FLAG: --runonce="false" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978819 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978822 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978826 2574 flags.go:64] FLAG: --seccomp-default="false" May 28 10:05:08.982820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978829 2574 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978831 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978837 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978841 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978844 2574 flags.go:64] FLAG: --storage-driver-password="root" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978847 2574 flags.go:64] FLAG: --storage-driver-secure="false" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978850 2574 flags.go:64] FLAG: --storage-driver-table="stats" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978853 2574 flags.go:64] FLAG: --storage-driver-user="root" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978856 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978859 2574 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978862 2574 flags.go:64] FLAG: --system-cgroups="" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978865 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978870 2574 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978873 2574 flags.go:64] FLAG: --tls-cert-file="" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978876 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978880 2574 flags.go:64] FLAG: --tls-min-version="" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978883 2574 flags.go:64] FLAG: --tls-private-key-file="" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978886 2574 flags.go:64] FLAG: --topology-manager-policy="none" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978890 2574 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978892 2574 flags.go:64] FLAG: --topology-manager-scope="container" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978895 2574 flags.go:64] FLAG: --v="2" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978900 2574 flags.go:64] FLAG: --version="false" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978903 2574 flags.go:64] FLAG: --vmodule="" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978908 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.978911 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 10:05:08.983456 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979004 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979008 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979011 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979014 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979017 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979020 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979022 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979025 2574 feature_gate.go:328] unrecognized feature gate: Example May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979032 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979040 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979042 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979045 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979048 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979051 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979054 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979056 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979059 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979061 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979064 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979067 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:05:08.984046 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979070 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979072 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979075 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979077 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979080 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979082 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979085 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979088 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979090 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979093 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979095 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979098 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979100 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979103 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979105 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979108 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979111 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979114 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979116 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:05:08.984583 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979119 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979122 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979127 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979129 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979133 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979135 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979139 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979142 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979145 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979148 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979150 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979153 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979155 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979159 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979163 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979166 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979169 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979171 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979174 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:05:08.985055 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979177 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979179 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979181 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979184 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979187 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979189 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979192 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979194 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979197 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979200 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979202 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979205 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979208 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979210 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979214 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979218 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979221 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979224 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979226 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979229 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:05:08.985542 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979231 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979234 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979236 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979239 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979241 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979244 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979247 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.979249 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:05:08.986029 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.980124 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 10:05:08.986928 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.986911 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 10:05:08.986966 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.986930 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 10:05:08.986997 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.986976 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:05:08.986997 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.986981 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:05:08.986997 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.986984 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:05:08.986997 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.986989 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:05:08.986997 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.986993 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:05:08.986997 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.986997 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:05:08.986997 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987000 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987002 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987006 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987008 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987011 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987014 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987017 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987019 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987022 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987025 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987028 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987030 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987033 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987035 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987038 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987040 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987043 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987045 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987050 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:05:08.987172 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987054 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987057 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987060 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987063 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987066 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987069 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987073 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987076 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987078 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987081 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987084 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987086 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987089 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987091 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987094 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987097 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987100 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987103 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987105 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987108 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:05:08.987717 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987111 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987113 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987116 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987118 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987121 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987124 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987127 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987129 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987132 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987135 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987137 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987140 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987142 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987145 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987148 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987150 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987153 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987155 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987158 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987161 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:05:08.988189 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987164 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987167 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987169 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987172 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987174 2574 feature_gate.go:328] unrecognized feature gate: Example May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987177 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987180 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987184 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987186 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987189 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987192 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987194 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987197 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987199 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987202 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987204 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987207 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987209 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987212 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987215 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:05:08.988716 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987217 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.987222 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987334 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987339 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987343 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987358 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987361 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987364 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987367 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987370 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987373 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987376 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987379 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987382 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987384 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 10:05:08.989212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987387 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987390 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987393 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987395 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987398 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987401 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987403 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987406 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987409 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987412 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987414 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987417 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987419 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987422 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987424 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987427 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987429 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987432 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987435 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987437 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 10:05:08.989699 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987439 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987442 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987444 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987447 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987450 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987452 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987455 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987457 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987460 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987462 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987466 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987468 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987471 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987473 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987476 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987479 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987481 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987485 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987487 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 10:05:08.990182 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987490 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987493 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987496 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987498 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987501 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987503 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987506 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987508 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987511 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987513 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987516 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987519 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987521 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987523 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987526 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987528 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987531 2574 feature_gate.go:328] unrecognized feature gate: Example May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987533 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987536 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987538 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 10:05:08.990660 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987541 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987544 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987546 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987549 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987552 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987554 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987557 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987561 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987565 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987569 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987572 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987575 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987578 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:08.987580 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.987584 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 10:05:08.991190 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.988375 2574 server.go:962] "Client rotation is on, will bootstrap in background" May 28 10:05:08.991588 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.990685 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 10:05:08.991815 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.991803 2574 server.go:1019] "Starting client certificate rotation" May 28 10:05:08.991922 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.991906 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 10:05:08.991956 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:08.991942 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 10:05:09.021582 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.021430 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 10:05:09.024144 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.024096 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 10:05:09.039338 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.039314 2574 log.go:25] "Validated CRI v1 runtime API" May 28 10:05:09.045340 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.045324 2574 log.go:25] "Validated CRI v1 image API" May 28 10:05:09.046822 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.046805 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 10:05:09.050136 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.050111 2574 fs.go:135] Filesystem UUIDs: map[0dd99ee4-1c35-4f22-9c85-52c3fda8f6a0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d98494ba-bbd5-476e-b695-6ab6e2797fdd:/dev/nvme0n1p4] May 28 10:05:09.050189 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.050137 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 10:05:09.054728 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.054619 2574 manager.go:217] Machine: {Timestamp:2026-05-28 10:05:09.054124078 +0000 UTC m=+0.448038497 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101037 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bc5a5dcdfbd550aa46634357205da SystemUUID:ec2bc5a5-dcdf-bd55-0aa4-6634357205da BootID:e83cee78-e994-402e-ba86-9935f6fe8733 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:6e:b3:ec:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:6e:b3:ec:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:c4:40:29:7a:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 10:05:09.055513 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.055501 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 10:05:09.055604 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.055592 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 10:05:09.058136 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.058120 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 10:05:09.059508 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.059481 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 10:05:09.059647 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.059512 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-122.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 10:05:09.059701 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.059657 2574 topology_manager.go:138] "Creating topology manager with none policy" May 28 10:05:09.059701 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.059665 2574 container_manager_linux.go:306] "Creating device plugin manager" May 28 10:05:09.059701 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.059672 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 10:05:09.060623 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.060612 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 10:05:09.061719 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.061709 2574 state_mem.go:36] "Initialized new in-memory state store" May 28 10:05:09.061832 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.061823 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 10:05:09.064857 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.064848 2574 kubelet.go:491] "Attempting to sync node with API server" May 28 10:05:09.064896 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.064861 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 10:05:09.064896 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.064874 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 10:05:09.064896 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.064883 2574 kubelet.go:397] "Adding apiserver pod source" May 28 10:05:09.064896 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.064892 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 10:05:09.066192 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.066168 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 10:05:09.066250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.066199 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 10:05:09.069796 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.069774 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 10:05:09.074738 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.074710 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 10:05:09.077015 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.076998 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 10:05:09.077015 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077019 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077027 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077035 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077047 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077056 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077064 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077072 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077083 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077093 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077106 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 10:05:09.077168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.077115 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 10:05:09.078273 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.078261 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 10:05:09.078344 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.078278 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 10:05:09.078569 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.078549 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 10:05:09.078798 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.078779 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 10:05:09.081421 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.081407 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 10:05:09.081484 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.081449 2574 server.go:1295] "Started kubelet" May 28 10:05:09.081526 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.081491 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 10:05:09.081624 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.081574 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 10:05:09.081660 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.081647 2574 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 10:05:09.082310 ip-10-0-129-122 systemd[1]: Started Kubernetes Kubelet. May 28 10:05:09.083230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.083045 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 10:05:09.084205 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.084193 2574 server.go:317] "Adding debug handlers to kubelet server" May 28 10:05:09.091612 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.091590 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 10:05:09.091878 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.091863 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-122.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 10:05:09.092235 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.092221 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 10:05:09.092283 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.092275 2574 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 10:05:09.092326 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.092285 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 10:05:09.092425 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.092407 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 10:05:09.092519 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.092482 2574 reconstruct.go:97] "Volume reconstruction finished" May 28 10:05:09.092519 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.092491 2574 reconciler.go:26] "Reconciler: start to sync state" May 28 10:05:09.093197 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.093177 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.093401 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.091850 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-122.ec2.internal.18b3b2a73c3d728a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-122.ec2.internal,UID:ip-10-0-129-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-122.ec2.internal,},FirstTimestamp:2026-05-28 10:05:09.081420426 +0000 UTC m=+0.475334845,LastTimestamp:2026-05-28 10:05:09.081420426 +0000 UTC m=+0.475334845,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-122.ec2.internal,}" May 28 10:05:09.094109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094087 2574 factory.go:55] Registering systemd factory May 28 10:05:09.094109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094110 2574 factory.go:223] Registration of the systemd container factory successfully May 28 10:05:09.094335 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094322 2574 factory.go:153] Registering CRI-O factory May 28 10:05:09.094335 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094333 2574 factory.go:223] Registration of the crio container factory successfully May 28 10:05:09.094462 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094396 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 10:05:09.094462 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094414 2574 factory.go:103] Registering Raw factory May 28 10:05:09.094462 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094430 2574 manager.go:1196] Started watching for new ooms in manager May 28 10:05:09.094822 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.094807 2574 manager.go:319] Starting recovery of all containers May 28 10:05:09.095320 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.095281 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 10:05:09.098555 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.098525 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 28 10:05:09.098648 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.098586 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 28 10:05:09.107486 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.107469 2574 manager.go:324] Recovery completed May 28 10:05:09.111405 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.111393 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:05:09.113101 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.113079 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientMemory" May 28 10:05:09.113154 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.113115 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:05:09.113154 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.113125 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientPID" May 28 10:05:09.113713 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.113696 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 10:05:09.113713 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.113709 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 10:05:09.113817 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.113733 2574 state_mem.go:36] "Initialized new in-memory state store" May 28 10:05:09.115283 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.115196 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-122.ec2.internal.18b3b2a73e20dd88 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-122.ec2.internal,UID:ip-10-0-129-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-122.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-122.ec2.internal,},FirstTimestamp:2026-05-28 10:05:09.113101704 +0000 UTC m=+0.507016123,LastTimestamp:2026-05-28 10:05:09.113101704 +0000 UTC m=+0.507016123,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-122.ec2.internal,}" May 28 10:05:09.117321 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.117307 2574 policy_none.go:49] "None policy: Start" May 28 10:05:09.117392 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.117324 2574 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 10:05:09.117392 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.117334 2574 state_mem.go:35] "Initializing new in-memory state store" May 28 10:05:09.120126 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.120111 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w74lk" May 28 10:05:09.127221 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.127203 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w74lk" May 28 10:05:09.128110 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.128039 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-122.ec2.internal.18b3b2a73e2123f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-122.ec2.internal,UID:ip-10-0-129-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-122.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-122.ec2.internal,},FirstTimestamp:2026-05-28 10:05:09.113119734 +0000 UTC m=+0.507034153,LastTimestamp:2026-05-28 10:05:09.113119734 +0000 UTC m=+0.507034153,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-122.ec2.internal,}" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.161642 2574 manager.go:341] "Starting Device Plugin manager" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.161677 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.161687 2574 server.go:85] "Starting device plugin registration server" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.161928 2574 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.161940 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.162065 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.162137 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.162144 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.162892 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 10:05:09.169723 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.162931 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.217302 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.217264 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 10:05:09.218490 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.218440 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 10:05:09.218490 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.218459 2574 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 10:05:09.218490 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.218478 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 10:05:09.218490 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.218487 2574 kubelet.go:2451] "Starting kubelet main sync loop" May 28 10:05:09.218752 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.218589 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 10:05:09.221119 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.221099 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:05:09.263321 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.263299 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:05:09.264191 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.264173 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientMemory" May 28 10:05:09.264275 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.264202 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:05:09.264275 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.264214 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientPID" May 28 10:05:09.264275 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.264238 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-122.ec2.internal" May 28 10:05:09.273784 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.273767 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-122.ec2.internal" May 28 10:05:09.273881 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.273794 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-122.ec2.internal\": node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.290016 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.289993 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.318856 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.318817 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal"] May 28 10:05:09.318963 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.318891 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:05:09.319806 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.319791 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientMemory" May 28 10:05:09.319875 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.319821 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:05:09.319875 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.319836 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientPID" May 28 10:05:09.321253 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.321241 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:05:09.321467 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.321454 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" May 28 10:05:09.321509 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.321479 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:05:09.322598 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.322570 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientMemory" May 28 10:05:09.322598 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.322583 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientMemory" May 28 10:05:09.322719 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.322603 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:05:09.322719 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.322633 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientPID" May 28 10:05:09.322719 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.322606 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:05:09.322719 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.322698 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientPID" May 28 10:05:09.323898 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.323883 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.323957 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.323909 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 10:05:09.324567 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.324553 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientMemory" May 28 10:05:09.324645 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.324581 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasNoDiskPressure" May 28 10:05:09.324645 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.324596 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeHasSufficientPID" May 28 10:05:09.338866 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.338848 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-122.ec2.internal\" not found" node="ip-10-0-129-122.ec2.internal" May 28 10:05:09.342160 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.342146 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-122.ec2.internal\" not found" node="ip-10-0-129-122.ec2.internal" May 28 10:05:09.390286 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.390264 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.491131 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.491069 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.494409 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.494391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b6b11312e540b2a6a3f55a82df78564-config\") pod \"kube-apiserver-proxy-ip-10-0-129-122.ec2.internal\" (UID: \"6b6b11312e540b2a6a3f55a82df78564\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" May 28 10:05:09.494465 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.494417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80ccc16ffe728dad843c05440f30e893-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal\" (UID: \"80ccc16ffe728dad843c05440f30e893\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.494465 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.494435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ccc16ffe728dad843c05440f30e893-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal\" (UID: \"80ccc16ffe728dad843c05440f30e893\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.591787 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.591744 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.595021 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.595001 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b6b11312e540b2a6a3f55a82df78564-config\") pod \"kube-apiserver-proxy-ip-10-0-129-122.ec2.internal\" (UID: \"6b6b11312e540b2a6a3f55a82df78564\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" May 28 10:05:09.595069 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.595030 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80ccc16ffe728dad843c05440f30e893-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal\" (UID: \"80ccc16ffe728dad843c05440f30e893\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.595069 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.595046 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ccc16ffe728dad843c05440f30e893-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal\" (UID: \"80ccc16ffe728dad843c05440f30e893\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.595134 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.595072 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/80ccc16ffe728dad843c05440f30e893-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal\" (UID: \"80ccc16ffe728dad843c05440f30e893\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.595134 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.595093 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b6b11312e540b2a6a3f55a82df78564-config\") pod \"kube-apiserver-proxy-ip-10-0-129-122.ec2.internal\" (UID: \"6b6b11312e540b2a6a3f55a82df78564\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" May 28 10:05:09.595134 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.595097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/80ccc16ffe728dad843c05440f30e893-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal\" (UID: \"80ccc16ffe728dad843c05440f30e893\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.642176 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.642149 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" May 28 10:05:09.644642 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.644626 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:09.692269 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.692231 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.792742 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.792673 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.893035 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.892998 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:09.991474 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.991442 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 10:05:09.992168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:09.991618 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 10:05:09.993630 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:09.993597 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:10.092483 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.092396 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 10:05:10.094596 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:10.094577 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:10.114779 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.114757 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 10:05:10.129408 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.129372 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 10:00:09 +0000 UTC" deadline="2027-12-09 05:07:42.180505877 +0000 UTC" May 28 10:05:10.129408 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.129403 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13435h2m32.051107489s" May 28 10:05:10.165007 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.164980 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5b2gj" May 28 10:05:10.175388 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.175367 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5b2gj" May 28 10:05:10.194944 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:10.194914 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:10.295801 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:10.295654 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:10.306173 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:10.306138 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6b11312e540b2a6a3f55a82df78564.slice/crio-05d9899ccc057e9335f48b2f95947e8ba6d1210eea388dbf461dba35ca3b72a8 WatchSource:0}: Error finding container 05d9899ccc057e9335f48b2f95947e8ba6d1210eea388dbf461dba35ca3b72a8: Status 404 returned error can't find the container with id 05d9899ccc057e9335f48b2f95947e8ba6d1210eea388dbf461dba35ca3b72a8 May 28 10:05:10.306419 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:10.306399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ccc16ffe728dad843c05440f30e893.slice/crio-85709825fcdc7093e0d606e36d1202d21ccf26d492a9550f37d881b99539e19a WatchSource:0}: Error finding container 85709825fcdc7093e0d606e36d1202d21ccf26d492a9550f37d881b99539e19a: Status 404 returned error can't find the container with id 85709825fcdc7093e0d606e36d1202d21ccf26d492a9550f37d881b99539e19a May 28 10:05:10.309416 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.309400 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 10:05:10.358764 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.358683 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:05:10.368709 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.368687 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:05:10.396723 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:10.396703 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:10.497219 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:10.497185 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-122.ec2.internal\" not found" May 28 10:05:10.515439 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.515419 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:05:10.592591 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.592557 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" May 28 10:05:10.605402 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.605374 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 10:05:10.606506 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.606493 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" May 28 10:05:10.620665 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:10.620605 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 10:05:11.066802 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.066718 2574 apiserver.go:52] "Watching apiserver" May 28 10:05:11.075522 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.075497 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 10:05:11.077119 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.077090 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-8t8f5","openshift-multus/multus-additional-cni-plugins-g66c4","openshift-multus/network-metrics-daemon-9g65s","kube-system/konnectivity-agent-r5779","kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb","openshift-image-registry/node-ca-pjshq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal","openshift-network-diagnostics/network-check-target-vvh92","openshift-network-operator/iptables-alerter-d5rd2","openshift-ovn-kubernetes/ovnkube-node-2lzsn","openshift-cluster-node-tuning-operator/tuned-sdfsm","openshift-dns/node-resolver-w4tvk"] May 28 10:05:11.079953 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.079826 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.082963 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.082823 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 10:05:11.082963 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.082837 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 10:05:11.082963 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.082875 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qwh27\"" May 28 10:05:11.083184 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.083051 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 10:05:11.085444 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.085425 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.087650 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.087628 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.088107 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.088084 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 10:05:11.088107 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.088101 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 10:05:11.088255 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.088168 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 10:05:11.088628 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.088432 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 10:05:11.088628 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.088491 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cx56m\"" May 28 10:05:11.088628 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.088433 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 10:05:11.089974 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.089745 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:11.089974 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.089808 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:11.090273 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.090252 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 10:05:11.090563 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.090543 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gf9gb\"" May 28 10:05:11.090659 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.090563 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 10:05:11.092037 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.092020 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.092163 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.092146 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8t8f5" May 28 10:05:11.095308 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.094443 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:11.095308 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.094521 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:11.095308 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.094706 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 10:05:11.095308 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.094865 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-58dp7\"" May 28 10:05:11.095308 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.094940 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 10:05:11.095308 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.095069 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 10:05:11.095308 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.095185 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x8lkg\"" May 28 10:05:11.095955 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.095857 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 10:05:11.097298 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.097179 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.100187 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.100138 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 10:05:11.100872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.100853 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 10:05:11.100941 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.100893 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2xbk8\"" May 28 10:05:11.101051 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.101034 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 10:05:11.102676 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102519 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-os-release\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.102676 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-cni-binary-copy\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.102676 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102578 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.102676 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102604 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-etc-selinux\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.102873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102668 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-system-cni-dir\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.102873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.102873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnrct\" (UniqueName: \"kubernetes.io/projected/e425d125-7648-4342-832d-6944cae7c342-kube-api-access-hnrct\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.102873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-socket-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.102873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-registration-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.102873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-device-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.102873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/823c98f1-5b1d-432d-85f6-19211847784a-serviceca\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.103171 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.103171 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-sys-fs\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.103171 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.102962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f10ee62-3f01-4307-b4f4-48dd4d74c481-cni-binary-copy\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103171 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-netns\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103171 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-conf-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103171 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw77d\" (UniqueName: \"kubernetes.io/projected/5f10ee62-3f01-4307-b4f4-48dd4d74c481-kube-api-access-dw77d\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103171 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwsnd\" (UniqueName: \"kubernetes.io/projected/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-kube-api-access-wwsnd\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d5h5\" (UniqueName: \"kubernetes.io/projected/1839ba26-2e7b-45b1-9400-a2802da42bab-kube-api-access-2d5h5\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103211 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-cni-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-cni-bin\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-cnibin\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-cni-multus\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-etc-kubernetes\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103386 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7kjc\" (UniqueName: \"kubernetes.io/projected/823c98f1-5b1d-432d-85f6-19211847784a-kube-api-access-p7kjc\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103409 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4e90b26-34d3-4346-b558-56463479d55a-konnectivity-ca\") pod \"konnectivity-agent-r5779\" (UID: \"c4e90b26-34d3-4346-b558-56463479d55a\") " pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-cnibin\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-os-release\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103486 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.103515 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103504 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-socket-dir-parent\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-hostroot\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103550 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-daemon-config\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/823c98f1-5b1d-432d-85f6-19211847784a-host\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103596 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4e90b26-34d3-4346-b558-56463479d55a-agent-certs\") pod \"konnectivity-agent-r5779\" (UID: \"c4e90b26-34d3-4346-b558-56463479d55a\") " pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-kubelet\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-multus-certs\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-system-cni-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.104109 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.103720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-k8s-cni-cncf-io\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.106099 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.105879 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 10:05:11.106099 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.106029 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.106326 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.106278 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4kg27\"" May 28 10:05:11.106326 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.106305 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.106474 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.106394 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 10:05:11.106474 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.106414 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 10:05:11.107852 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.107015 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 10:05:11.107852 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.107573 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 10:05:11.107852 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.107698 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 10:05:11.108607 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.108591 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 10:05:11.109012 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.108908 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 10:05:11.109140 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.109120 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 10:05:11.109641 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.109615 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vq75v\"" May 28 10:05:11.109743 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.109623 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5f2gn\"" May 28 10:05:11.109806 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.109621 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 10:05:11.176651 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.176617 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:00:10 +0000 UTC" deadline="2027-12-23 18:59:41.672399933 +0000 UTC" May 28 10:05:11.176651 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.176646 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13784h54m30.495758181s" May 28 10:05:11.193374 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.193327 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 10:05:11.204537 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204508 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-system-cni-dir\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.204537 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204541 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204563 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnrct\" (UniqueName: \"kubernetes.io/projected/e425d125-7648-4342-832d-6944cae7c342-kube-api-access-hnrct\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204591 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-registration-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204616 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-device-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-system-cni-dir\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204659 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/823c98f1-5b1d-432d-85f6-19211847784a-serviceca\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204672 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-device-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204686 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f10ee62-3f01-4307-b4f4-48dd4d74c481-cni-binary-copy\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.204712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204710 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-conf-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204733 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwsnd\" (UniqueName: \"kubernetes.io/projected/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-kube-api-access-wwsnd\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-systemd\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204787 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcjpq\" (UniqueName: \"kubernetes.io/projected/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-kube-api-access-rcjpq\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-conf-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204827 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2d5h5\" (UniqueName: \"kubernetes.io/projected/1839ba26-2e7b-45b1-9400-a2802da42bab-kube-api-access-2d5h5\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204852 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-cni-bin\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysctl-conf\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-var-lib-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-log-socket\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204950 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-cnibin\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-registration-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.204976 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-cni-multus\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205001 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-etc-kubernetes\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205026 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7kjc\" (UniqueName: \"kubernetes.io/projected/823c98f1-5b1d-432d-85f6-19211847784a-kube-api-access-p7kjc\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205050 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4e90b26-34d3-4346-b558-56463479d55a-konnectivity-ca\") pod \"konnectivity-agent-r5779\" (UID: \"c4e90b26-34d3-4346-b558-56463479d55a\") " pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.205127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-kubernetes\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205129 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-cnibin\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205154 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205181 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-socket-dir-parent\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205206 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-hostroot\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205230 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/823c98f1-5b1d-432d-85f6-19211847784a-host\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205248 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/823c98f1-5b1d-432d-85f6-19211847784a-serviceca\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-var-lib-kubelet\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ac2621-2c47-4fee-9727-b5048e01525e-tmp-dir\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-ovn\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205324 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-etc-kubernetes\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205335 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-kubelet\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205390 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-multus-certs\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-tmp\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-cni-bin\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.205911 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-cni-netd\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovnkube-script-lib\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205567 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-system-cni-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-systemd-units\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovn-node-metrics-cert\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dmdb\" (UniqueName: \"kubernetes.io/projected/208fa309-7b52-4eb6-b36b-1b90ac0683b7-kube-api-access-9dmdb\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205680 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-os-release\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205740 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-cni-binary-copy\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-host\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205827 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-cni-bin\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205842 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-socket-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-lib-modules\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovnkube-config\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205943 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-socket-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205974 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-sys-fs\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.206683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206002 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-netns\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206042 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dw77d\" (UniqueName: \"kubernetes.io/projected/5f10ee62-3f01-4307-b4f4-48dd4d74c481-kube-api-access-dw77d\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206067 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-cni-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206094 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37ac2621-2c47-4fee-9727-b5048e01525e-hosts-file\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-iptables-alerter-script\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-kubelet\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c4e90b26-34d3-4346-b558-56463479d55a-konnectivity-ca\") pod \"konnectivity-agent-r5779\" (UID: \"c4e90b26-34d3-4346-b558-56463479d55a\") " pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.205507 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f10ee62-3f01-4307-b4f4-48dd4d74c481-cni-binary-copy\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/823c98f1-5b1d-432d-85f6-19211847784a-host\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-var-lib-cni-multus\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-cnibin\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-slash\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-cnibin\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.206530 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-system-cni-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-hostroot\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.207482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e425d125-7648-4342-832d-6944cae7c342-os-release\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.206645 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs podName:38ea32a3-cbf1-45ea-a0bc-0b852e4519e2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:11.706583287 +0000 UTC m=+3.100497717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs") pod "network-metrics-daemon-9g65s" (UID: "38ea32a3-cbf1-45ea-a0bc-0b852e4519e2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-sys-fs\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-multus-certs\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-netns\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206707 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-os-release\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-os-release\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206783 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-daemon-config\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206832 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4e90b26-34d3-4346-b558-56463479d55a-agent-certs\") pod \"konnectivity-agent-r5779\" (UID: \"c4e90b26-34d3-4346-b558-56463479d55a\") " pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysconfig\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-run\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rw9l\" (UniqueName: \"kubernetes.io/projected/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-kube-api-access-8rw9l\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-env-overrides\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-cni-dir\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208229 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.206989 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207039 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-modprobe-d\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207195 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207239 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysctl-d\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207291 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-daemon-config\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-tuned\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtx4l\" (UniqueName: \"kubernetes.io/projected/37ac2621-2c47-4fee-9727-b5048e01525e-kube-api-access-mtx4l\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-run-netns\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-systemd\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-multus-socket-dir-parent\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207541 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207542 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-k8s-cni-cncf-io\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f10ee62-3f01-4307-b4f4-48dd4d74c481-host-run-k8s-cni-cncf-io\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-sys\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-kubelet\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-etc-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-node-log\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.208951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207711 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-etc-selinux\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.209702 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1839ba26-2e7b-45b1-9400-a2802da42bab-etc-selinux\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.209702 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-host-slash\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.209702 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.207900 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.209702 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.208004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e425d125-7648-4342-832d-6944cae7c342-cni-binary-copy\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.211656 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.211630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c4e90b26-34d3-4346-b558-56463479d55a-agent-certs\") pod \"konnectivity-agent-r5779\" (UID: \"c4e90b26-34d3-4346-b558-56463479d55a\") " pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.215067 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.215043 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:05:11.215067 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.215069 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:05:11.215222 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.215081 2574 projected.go:194] Error preparing data for projected volume kube-api-access-xfvbp for pod openshift-network-diagnostics/network-check-target-vvh92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:11.215222 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.215137 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp podName:1240213a-e967-4c0e-abae-8d73a605540d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:11.715120895 +0000 UTC m=+3.109035324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xfvbp" (UniqueName: "kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp") pod "network-check-target-vvh92" (UID: "1240213a-e967-4c0e-abae-8d73a605540d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:11.217334 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.217301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d5h5\" (UniqueName: \"kubernetes.io/projected/1839ba26-2e7b-45b1-9400-a2802da42bab-kube-api-access-2d5h5\") pod \"aws-ebs-csi-driver-node-t78sb\" (UID: \"1839ba26-2e7b-45b1-9400-a2802da42bab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.218222 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.218170 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7kjc\" (UniqueName: \"kubernetes.io/projected/823c98f1-5b1d-432d-85f6-19211847784a-kube-api-access-p7kjc\") pod \"node-ca-pjshq\" (UID: \"823c98f1-5b1d-432d-85f6-19211847784a\") " pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.220309 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.220284 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwsnd\" (UniqueName: \"kubernetes.io/projected/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-kube-api-access-wwsnd\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:11.221693 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.221652 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw77d\" (UniqueName: \"kubernetes.io/projected/5f10ee62-3f01-4307-b4f4-48dd4d74c481-kube-api-access-dw77d\") pod \"multus-8t8f5\" (UID: \"5f10ee62-3f01-4307-b4f4-48dd4d74c481\") " pod="openshift-multus/multus-8t8f5" May 28 10:05:11.221693 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.221660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnrct\" (UniqueName: \"kubernetes.io/projected/e425d125-7648-4342-832d-6944cae7c342-kube-api-access-hnrct\") pod \"multus-additional-cni-plugins-g66c4\" (UID: \"e425d125-7648-4342-832d-6944cae7c342\") " pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.224178 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.224088 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" event={"ID":"80ccc16ffe728dad843c05440f30e893","Type":"ContainerStarted","Data":"85709825fcdc7093e0d606e36d1202d21ccf26d492a9550f37d881b99539e19a"} May 28 10:05:11.225501 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.225459 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" event={"ID":"6b6b11312e540b2a6a3f55a82df78564","Type":"ContainerStarted","Data":"05d9899ccc057e9335f48b2f95947e8ba6d1210eea388dbf461dba35ca3b72a8"} May 28 10:05:11.308538 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308500 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysconfig\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.308714 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308545 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-run\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.308714 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysconfig\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.308714 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308691 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rw9l\" (UniqueName: \"kubernetes.io/projected/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-kube-api-access-8rw9l\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.308872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-run\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.308872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308723 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-env-overrides\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.308872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308761 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-modprobe-d\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.308872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308785 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysctl-d\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.308872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308809 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-tuned\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.308872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308831 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtx4l\" (UniqueName: \"kubernetes.io/projected/37ac2621-2c47-4fee-9727-b5048e01525e-kube-api-access-mtx4l\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.308872 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308870 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-run-netns\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308893 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-systemd\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308916 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-sys\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308952 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-kubelet\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.308976 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-etc-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309001 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-node-log\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309027 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-host-slash\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309060 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-systemd\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309083 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcjpq\" (UniqueName: \"kubernetes.io/projected/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-kube-api-access-rcjpq\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309108 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysctl-conf\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309147 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-var-lib-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309169 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-log-socket\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309193 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309197 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-kubernetes\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309217 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-modprobe-d\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309317 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-var-lib-kubelet\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309339 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ac2621-2c47-4fee-9727-b5048e01525e-tmp-dir\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-env-overrides\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309386 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-ovn\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysctl-d\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309414 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-tmp\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309450 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309477 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-run-netns\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309480 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-cni-bin\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309523 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-cni-netd\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309538 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-node-log\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309551 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovnkube-script-lib\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-host-slash\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309580 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-systemd-units\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-systemd-units\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.309749 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-systemd\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-systemd\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309740 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-cni-bin\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309818 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-sysctl-conf\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-run-ovn\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309900 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-var-lib-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-etc-openvswitch\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-log-socket\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ac2621-2c47-4fee-9727-b5048e01525e-tmp-dir\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310219 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-kubernetes\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-var-lib-kubelet\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.309612 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovn-node-metrics-cert\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310324 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-kubelet\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-sys\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.310560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-cni-netd\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310598 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmdb\" (UniqueName: \"kubernetes.io/projected/208fa309-7b52-4eb6-b36b-1b90ac0683b7-kube-api-access-9dmdb\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310636 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-host\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310664 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-lib-modules\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310689 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovnkube-config\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310731 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37ac2621-2c47-4fee-9727-b5048e01525e-hosts-file\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310757 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-iptables-alerter-script\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310782 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-slash\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310809 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovnkube-script-lib\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.310936 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37ac2621-2c47-4fee-9727-b5048e01525e-hosts-file\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.311250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.311233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-host\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.311914 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.311325 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovnkube-config\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.311914 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.311472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-lib-modules\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.311914 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.311479 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-iptables-alerter-script\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.311914 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.311510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/208fa309-7b52-4eb6-b36b-1b90ac0683b7-host-slash\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.312241 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.312221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-tmp\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.312335 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.312311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/208fa309-7b52-4eb6-b36b-1b90ac0683b7-ovn-node-metrics-cert\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.313776 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.313754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-etc-tuned\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.322020 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.321930 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dmdb\" (UniqueName: \"kubernetes.io/projected/208fa309-7b52-4eb6-b36b-1b90ac0683b7-kube-api-access-9dmdb\") pod \"ovnkube-node-2lzsn\" (UID: \"208fa309-7b52-4eb6-b36b-1b90ac0683b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.322020 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.321931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcjpq\" (UniqueName: \"kubernetes.io/projected/d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0-kube-api-access-rcjpq\") pod \"tuned-sdfsm\" (UID: \"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0\") " pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.322140 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.322103 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rw9l\" (UniqueName: \"kubernetes.io/projected/b5286f16-f39d-4a8e-8b15-0bdd7109ef06-kube-api-access-8rw9l\") pod \"iptables-alerter-d5rd2\" (UID: \"b5286f16-f39d-4a8e-8b15-0bdd7109ef06\") " pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.322342 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.322252 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtx4l\" (UniqueName: \"kubernetes.io/projected/37ac2621-2c47-4fee-9727-b5048e01525e-kube-api-access-mtx4l\") pod \"node-resolver-w4tvk\" (UID: \"37ac2621-2c47-4fee-9727-b5048e01525e\") " pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.392178 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.392144 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pjshq" May 28 10:05:11.400064 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.400037 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g66c4" May 28 10:05:11.410761 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.410739 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r5779" May 28 10:05:11.416091 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.416067 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" May 28 10:05:11.423675 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.423648 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8t8f5" May 28 10:05:11.431219 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.431188 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d5rd2" May 28 10:05:11.441123 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.440842 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:11.451446 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.451419 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4tvk" May 28 10:05:11.458082 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.458062 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" May 28 10:05:11.523225 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.523198 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 10:05:11.713668 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.713585 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:11.713833 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.713758 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:11.713889 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.713857 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs podName:38ea32a3-cbf1-45ea-a0bc-0b852e4519e2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:12.713812516 +0000 UTC m=+4.107726930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs") pod "network-metrics-daemon-9g65s" (UID: "38ea32a3-cbf1-45ea-a0bc-0b852e4519e2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:11.814624 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:11.814585 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:11.814813 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.814748 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:05:11.814813 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.814774 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:05:11.814813 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.814785 2574 projected.go:194] Error preparing data for projected volume kube-api-access-xfvbp for pod openshift-network-diagnostics/network-check-target-vvh92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:11.814952 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:11.814842 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp podName:1240213a-e967-4c0e-abae-8d73a605540d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:12.814825689 +0000 UTC m=+4.208740096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfvbp" (UniqueName: "kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp") pod "network-check-target-vvh92" (UID: "1240213a-e967-4c0e-abae-8d73a605540d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:11.964570 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.964543 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823c98f1_5b1d_432d_85f6_19211847784a.slice/crio-cece4b2b30b63a893e23913f85c609bcb167e2e7fb83f407656e51635bc5dfd9 WatchSource:0}: Error finding container cece4b2b30b63a893e23913f85c609bcb167e2e7fb83f407656e51635bc5dfd9: Status 404 returned error can't find the container with id cece4b2b30b63a893e23913f85c609bcb167e2e7fb83f407656e51635bc5dfd9 May 28 10:05:11.965870 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.965843 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode425d125_7648_4342_832d_6944cae7c342.slice/crio-8c84399d7a9f502bc54206a7322b8e3b02e3642c05d55399a03bb2382a27683c WatchSource:0}: Error finding container 8c84399d7a9f502bc54206a7322b8e3b02e3642c05d55399a03bb2382a27683c: Status 404 returned error can't find the container with id 8c84399d7a9f502bc54206a7322b8e3b02e3642c05d55399a03bb2382a27683c May 28 10:05:11.967213 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.967160 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e90b26_34d3_4346_b558_56463479d55a.slice/crio-92c7f3870cec6fd65556d73e2e607b5d717d6a6a09582d1e95b5c22924f293f2 WatchSource:0}: Error finding container 92c7f3870cec6fd65556d73e2e607b5d717d6a6a09582d1e95b5c22924f293f2: Status 404 returned error can't find the container with id 92c7f3870cec6fd65556d73e2e607b5d717d6a6a09582d1e95b5c22924f293f2 May 28 10:05:11.969695 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.969663 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f10ee62_3f01_4307_b4f4_48dd4d74c481.slice/crio-d2cc93136f7bf690df1422e9ad8f91f1515a692e9ea073946b8108a9f7542555 WatchSource:0}: Error finding container d2cc93136f7bf690df1422e9ad8f91f1515a692e9ea073946b8108a9f7542555: Status 404 returned error can't find the container with id d2cc93136f7bf690df1422e9ad8f91f1515a692e9ea073946b8108a9f7542555 May 28 10:05:11.971883 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.971861 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5286f16_f39d_4a8e_8b15_0bdd7109ef06.slice/crio-6c71d3f852afdf973434bae2e693626c44af2c22f9a8b4bed3c9ee7130f811ab WatchSource:0}: Error finding container 6c71d3f852afdf973434bae2e693626c44af2c22f9a8b4bed3c9ee7130f811ab: Status 404 returned error can't find the container with id 6c71d3f852afdf973434bae2e693626c44af2c22f9a8b4bed3c9ee7130f811ab May 28 10:05:11.973778 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.973748 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ac2621_2c47_4fee_9727_b5048e01525e.slice/crio-0357bf0a2df2101d2cb79666a12f1caf1c95d26dc856ce56ac8138787b37ae11 WatchSource:0}: Error finding container 0357bf0a2df2101d2cb79666a12f1caf1c95d26dc856ce56ac8138787b37ae11: Status 404 returned error can't find the container with id 0357bf0a2df2101d2cb79666a12f1caf1c95d26dc856ce56ac8138787b37ae11 May 28 10:05:11.974610 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.974574 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1839ba26_2e7b_45b1_9400_a2802da42bab.slice/crio-866d850d0a5b12ee84afb5eddaf5fa1df86eed8844006bd79fe4bea11b2a3aaa WatchSource:0}: Error finding container 866d850d0a5b12ee84afb5eddaf5fa1df86eed8844006bd79fe4bea11b2a3aaa: Status 404 returned error can't find the container with id 866d850d0a5b12ee84afb5eddaf5fa1df86eed8844006bd79fe4bea11b2a3aaa May 28 10:05:11.978004 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:11.975738 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62f48b2_7563_4c0f_8cb7_ee8e2c4ceda0.slice/crio-95275ac9a4b8f0f0a525b3251a81d1290d7a63f7c46e4b9b6ad03c4e6853f5c2 WatchSource:0}: Error finding container 95275ac9a4b8f0f0a525b3251a81d1290d7a63f7c46e4b9b6ad03c4e6853f5c2: Status 404 returned error can't find the container with id 95275ac9a4b8f0f0a525b3251a81d1290d7a63f7c46e4b9b6ad03c4e6853f5c2 May 28 10:05:12.177643 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.177600 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:00:10 +0000 UTC" deadline="2028-02-23 09:33:00.175223134 +0000 UTC" May 28 10:05:12.177643 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.177634 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15263h27m47.997592621s" May 28 10:05:12.227849 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.227773 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r5779" event={"ID":"c4e90b26-34d3-4346-b558-56463479d55a","Type":"ContainerStarted","Data":"92c7f3870cec6fd65556d73e2e607b5d717d6a6a09582d1e95b5c22924f293f2"} May 28 10:05:12.228877 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.228853 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" event={"ID":"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0","Type":"ContainerStarted","Data":"95275ac9a4b8f0f0a525b3251a81d1290d7a63f7c46e4b9b6ad03c4e6853f5c2"} May 28 10:05:12.230136 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.230109 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" event={"ID":"1839ba26-2e7b-45b1-9400-a2802da42bab","Type":"ContainerStarted","Data":"866d850d0a5b12ee84afb5eddaf5fa1df86eed8844006bd79fe4bea11b2a3aaa"} May 28 10:05:12.231119 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.231092 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerStarted","Data":"8c84399d7a9f502bc54206a7322b8e3b02e3642c05d55399a03bb2382a27683c"} May 28 10:05:12.232323 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.232297 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pjshq" event={"ID":"823c98f1-5b1d-432d-85f6-19211847784a","Type":"ContainerStarted","Data":"cece4b2b30b63a893e23913f85c609bcb167e2e7fb83f407656e51635bc5dfd9"} May 28 10:05:12.233768 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.233748 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" event={"ID":"6b6b11312e540b2a6a3f55a82df78564","Type":"ContainerStarted","Data":"4e3ab241b461a96ce00b39fd1303186b4580863d18c7e88335620a9442feafdb"} May 28 10:05:12.234807 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.234787 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"f15d4027cf089db1c16f37aa3aa70d45855184d1ea64690baf452c1c2c3e3523"} May 28 10:05:12.235881 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.235863 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4tvk" event={"ID":"37ac2621-2c47-4fee-9727-b5048e01525e","Type":"ContainerStarted","Data":"0357bf0a2df2101d2cb79666a12f1caf1c95d26dc856ce56ac8138787b37ae11"} May 28 10:05:12.236717 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.236697 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5rd2" event={"ID":"b5286f16-f39d-4a8e-8b15-0bdd7109ef06","Type":"ContainerStarted","Data":"6c71d3f852afdf973434bae2e693626c44af2c22f9a8b4bed3c9ee7130f811ab"} May 28 10:05:12.237665 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.237643 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8t8f5" event={"ID":"5f10ee62-3f01-4307-b4f4-48dd4d74c481","Type":"ContainerStarted","Data":"d2cc93136f7bf690df1422e9ad8f91f1515a692e9ea073946b8108a9f7542555"} May 28 10:05:12.721027 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.720942 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:12.721195 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:12.721113 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:12.721255 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:12.721192 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs podName:38ea32a3-cbf1-45ea-a0bc-0b852e4519e2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:14.721171604 +0000 UTC m=+6.115086018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs") pod "network-metrics-daemon-9g65s" (UID: "38ea32a3-cbf1-45ea-a0bc-0b852e4519e2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:12.821912 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:12.821874 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:12.822127 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:12.822109 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:05:12.822184 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:12.822137 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:05:12.822184 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:12.822150 2574 projected.go:194] Error preparing data for projected volume kube-api-access-xfvbp for pod openshift-network-diagnostics/network-check-target-vvh92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:12.822288 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:12.822213 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp podName:1240213a-e967-4c0e-abae-8d73a605540d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:14.822194645 +0000 UTC m=+6.216109067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfvbp" (UniqueName: "kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp") pod "network-check-target-vvh92" (UID: "1240213a-e967-4c0e-abae-8d73a605540d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:13.218863 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:13.218785 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:13.219288 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:13.218917 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:13.221948 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:13.221838 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:13.222060 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:13.221955 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:13.249940 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:13.249907 2574 generic.go:358] "Generic (PLEG): container finished" podID="80ccc16ffe728dad843c05440f30e893" containerID="36026d08950783b25869b9c37b6a52c3a2566ac6a8a38e5451d3b8df6fd71452" exitCode=0 May 28 10:05:13.251134 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:13.251106 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" event={"ID":"80ccc16ffe728dad843c05440f30e893","Type":"ContainerDied","Data":"36026d08950783b25869b9c37b6a52c3a2566ac6a8a38e5451d3b8df6fd71452"} May 28 10:05:13.267881 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:13.267790 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-122.ec2.internal" podStartSLOduration=3.267772615 podStartE2EDuration="3.267772615s" podCreationTimestamp="2026-05-28 10:05:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:05:12.248092848 +0000 UTC m=+3.642007276" watchObservedRunningTime="2026-05-28 10:05:13.267772615 +0000 UTC m=+4.661687049" May 28 10:05:14.291184 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:14.291080 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" event={"ID":"80ccc16ffe728dad843c05440f30e893","Type":"ContainerStarted","Data":"c69685dbb125d9d94c5bbb093e5c9ca507ba9b554b542d970be6d1bb21221f9b"} May 28 10:05:14.738891 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:14.738845 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:14.739090 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:14.739044 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:14.739214 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:14.739111 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs podName:38ea32a3-cbf1-45ea-a0bc-0b852e4519e2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:18.739092833 +0000 UTC m=+10.133007261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs") pod "network-metrics-daemon-9g65s" (UID: "38ea32a3-cbf1-45ea-a0bc-0b852e4519e2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:14.840207 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:14.840166 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:14.840407 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:14.840372 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:05:14.840407 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:14.840392 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:05:14.840407 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:14.840406 2574 projected.go:194] Error preparing data for projected volume kube-api-access-xfvbp for pod openshift-network-diagnostics/network-check-target-vvh92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:14.840577 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:14.840463 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp podName:1240213a-e967-4c0e-abae-8d73a605540d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:18.840445718 +0000 UTC m=+10.234360130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfvbp" (UniqueName: "kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp") pod "network-check-target-vvh92" (UID: "1240213a-e967-4c0e-abae-8d73a605540d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:15.219653 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.219615 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:15.219829 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:15.219755 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:15.219829 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.219791 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:15.219935 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:15.219894 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:15.392118 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.392063 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-122.ec2.internal" podStartSLOduration=5.392042499 podStartE2EDuration="5.392042499s" podCreationTimestamp="2026-05-28 10:05:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:05:14.306304343 +0000 UTC m=+5.700218774" watchObservedRunningTime="2026-05-28 10:05:15.392042499 +0000 UTC m=+6.785956930" May 28 10:05:15.393068 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.393041 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zp9wj"] May 28 10:05:15.396329 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.396306 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.396445 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:15.396400 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:15.445314 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.445274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-kubelet-config\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.445500 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.445327 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.445500 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.445412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-dbus\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.546061 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.545979 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-dbus\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.546213 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.546071 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-kubelet-config\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.546213 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.546101 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.546310 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:15.546222 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 10:05:15.546310 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:15.546283 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret podName:cc5e55c3-76e3-4b60-b420-4aba7dfa5b05 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:16.046265287 +0000 UTC m=+7.440179702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret") pod "global-pull-secret-syncer-zp9wj" (UID: "cc5e55c3-76e3-4b60-b420-4aba7dfa5b05") : object "kube-system"/"original-pull-secret" not registered May 28 10:05:15.546585 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.546566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-dbus\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:15.546647 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:15.546630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-kubelet-config\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:16.051343 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:16.051072 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:16.051343 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:16.051248 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 10:05:16.051343 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:16.051321 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret podName:cc5e55c3-76e3-4b60-b420-4aba7dfa5b05 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:17.051303002 +0000 UTC m=+8.445217422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret") pod "global-pull-secret-syncer-zp9wj" (UID: "cc5e55c3-76e3-4b60-b420-4aba7dfa5b05") : object "kube-system"/"original-pull-secret" not registered May 28 10:05:17.061250 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:17.060644 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:17.061250 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:17.060846 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 10:05:17.061250 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:17.060917 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret podName:cc5e55c3-76e3-4b60-b420-4aba7dfa5b05 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:19.060898799 +0000 UTC m=+10.454813212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret") pod "global-pull-secret-syncer-zp9wj" (UID: "cc5e55c3-76e3-4b60-b420-4aba7dfa5b05") : object "kube-system"/"original-pull-secret" not registered May 28 10:05:17.218951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:17.218916 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:17.219134 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:17.219052 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:17.219190 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:17.219167 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:17.219265 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:17.219245 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:17.219524 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:17.219432 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:17.219524 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:17.219509 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:18.773423 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:18.773390 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:18.773810 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:18.773574 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:18.773810 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:18.773628 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs podName:38ea32a3-cbf1-45ea-a0bc-0b852e4519e2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:26.773613254 +0000 UTC m=+18.167527666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs") pod "network-metrics-daemon-9g65s" (UID: "38ea32a3-cbf1-45ea-a0bc-0b852e4519e2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:18.874194 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:18.874157 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:18.874381 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:18.874332 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:05:18.874381 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:18.874368 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:05:18.874510 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:18.874395 2574 projected.go:194] Error preparing data for projected volume kube-api-access-xfvbp for pod openshift-network-diagnostics/network-check-target-vvh92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:18.874510 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:18.874452 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp podName:1240213a-e967-4c0e-abae-8d73a605540d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:26.874435787 +0000 UTC m=+18.268350212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfvbp" (UniqueName: "kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp") pod "network-check-target-vvh92" (UID: "1240213a-e967-4c0e-abae-8d73a605540d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:19.075884 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:19.075852 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:19.076054 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:19.076021 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 10:05:19.076131 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:19.076087 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret podName:cc5e55c3-76e3-4b60-b420-4aba7dfa5b05 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:23.076067943 +0000 UTC m=+14.469982365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret") pod "global-pull-secret-syncer-zp9wj" (UID: "cc5e55c3-76e3-4b60-b420-4aba7dfa5b05") : object "kube-system"/"original-pull-secret" not registered May 28 10:05:19.220561 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:19.220408 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:19.220561 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:19.220528 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:19.220561 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:19.220417 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:19.220868 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:19.220622 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:19.220868 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:19.220418 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:19.220868 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:19.220702 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:21.219629 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:21.219369 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:21.220079 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:21.219374 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:21.220079 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:21.219730 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:21.220079 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:21.219399 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:21.220079 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:21.219773 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:21.220079 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:21.219882 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:23.108140 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:23.108101 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:23.108615 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:23.108242 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 10:05:23.108615 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:23.108318 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret podName:cc5e55c3-76e3-4b60-b420-4aba7dfa5b05 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:31.108301543 +0000 UTC m=+22.502215949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret") pod "global-pull-secret-syncer-zp9wj" (UID: "cc5e55c3-76e3-4b60-b420-4aba7dfa5b05") : object "kube-system"/"original-pull-secret" not registered May 28 10:05:23.219433 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:23.219397 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:23.219594 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:23.219449 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:23.219594 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:23.219535 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:23.219715 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:23.219610 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:23.219715 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:23.219623 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:23.219794 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:23.219731 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:25.218828 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:25.218789 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:25.218828 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:25.218827 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:25.219324 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:25.218912 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:25.219324 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:25.218973 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:25.219324 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:25.219085 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:25.219324 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:25.219169 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:26.836693 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:26.836657 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:26.837124 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:26.836825 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:26.837124 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:26.836887 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs podName:38ea32a3-cbf1-45ea-a0bc-0b852e4519e2 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:42.836872039 +0000 UTC m=+34.230786446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs") pod "network-metrics-daemon-9g65s" (UID: "38ea32a3-cbf1-45ea-a0bc-0b852e4519e2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:26.937207 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:26.937160 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:26.937408 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:26.937343 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:05:26.937408 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:26.937386 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:05:26.937408 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:26.937399 2574 projected.go:194] Error preparing data for projected volume kube-api-access-xfvbp for pod openshift-network-diagnostics/network-check-target-vvh92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:26.937579 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:26.937460 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp podName:1240213a-e967-4c0e-abae-8d73a605540d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:42.937440973 +0000 UTC m=+34.331355391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfvbp" (UniqueName: "kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp") pod "network-check-target-vvh92" (UID: "1240213a-e967-4c0e-abae-8d73a605540d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:27.218897 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:27.218824 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:27.219042 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:27.218824 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:27.219042 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:27.218959 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:27.219042 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:27.218824 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:27.219042 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:27.219008 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:27.219215 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:27.219098 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:29.219848 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:29.219757 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:29.220376 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:29.219872 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:29.220376 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:29.219897 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:29.220376 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:29.219929 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:29.220376 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:29.220035 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:29.220376 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:29.220120 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:31.171333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.171074 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:31.171939 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:31.171195 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 10:05:31.171939 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:31.171424 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret podName:cc5e55c3-76e3-4b60-b420-4aba7dfa5b05 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.171407364 +0000 UTC m=+38.565321794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret") pod "global-pull-secret-syncer-zp9wj" (UID: "cc5e55c3-76e3-4b60-b420-4aba7dfa5b05") : object "kube-system"/"original-pull-secret" not registered May 28 10:05:31.219562 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.219530 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:31.219744 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.219587 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:31.219744 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:31.219703 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:31.219744 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.219719 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:31.219892 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:31.219839 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:31.219950 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:31.219922 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:31.328892 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.328856 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pjshq" event={"ID":"823c98f1-5b1d-432d-85f6-19211847784a","Type":"ContainerStarted","Data":"42c81be79bada676a6642d652ba24c097178b36010479a2ce76adadeddab82fa"} May 28 10:05:31.331978 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.331951 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:05:31.332365 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.332328 2574 generic.go:358] "Generic (PLEG): container finished" podID="208fa309-7b52-4eb6-b36b-1b90ac0683b7" containerID="7afab9057ed9b4ef41524b0b075401763bc80d43f983fab74f8efe6138117b93" exitCode=1 May 28 10:05:31.332476 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.332385 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"a9c95aaae8f5de17c75371793d3a7e8e38aecd681a5f5fdd148b9eabf3011010"} May 28 10:05:31.332476 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.332417 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"0e6a48425cffda7f378c799623658963f7e7eaaeb5b28fff1c37b4bceb338f81"} May 28 10:05:31.332476 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.332441 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"bf1f7298bbd3a805d7cf73f7124fed2260ea9a727fd52ec1fbebbc4573e9aa31"} May 28 10:05:31.332476 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.332455 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"72c05a2eed4a9b26e57987adec60612eed53d6f39eccdad4320f60a4cf91cc40"} May 28 10:05:31.332476 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.332467 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerDied","Data":"7afab9057ed9b4ef41524b0b075401763bc80d43f983fab74f8efe6138117b93"} May 28 10:05:31.332716 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.332483 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"e1b04753a74337b3f3866e04f0147aa009713b8d9f74c7453d5275cd9340384f"} May 28 10:05:31.333865 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.333840 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4tvk" event={"ID":"37ac2621-2c47-4fee-9727-b5048e01525e","Type":"ContainerStarted","Data":"b0d6772ca8fe639a54786af7137958fb1b3106751d68f79b2dc8a5194c873dc6"} May 28 10:05:31.335252 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.335227 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8t8f5" event={"ID":"5f10ee62-3f01-4307-b4f4-48dd4d74c481","Type":"ContainerStarted","Data":"7987aaccc7c3923fbdc6713447c8c284b729af34611eebf8923625f0440020cf"} May 28 10:05:31.336787 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.336761 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r5779" event={"ID":"c4e90b26-34d3-4346-b558-56463479d55a","Type":"ContainerStarted","Data":"5c13c66288d15df7aad4927b22edf4ef165f05c889a78861fe1b753492f11494"} May 28 10:05:31.338374 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.338334 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" event={"ID":"d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0","Type":"ContainerStarted","Data":"a2e8cfc330a6651799575b7edf3fed23b690c4b0fcae0e67cc24c9082e743250"} May 28 10:05:31.340150 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.340117 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" event={"ID":"1839ba26-2e7b-45b1-9400-a2802da42bab","Type":"ContainerStarted","Data":"ff093a05cfea407d39bc8d3dad5256c2582119fcf9dab3f07e2a232705977026"} May 28 10:05:31.342125 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.342099 2574 generic.go:358] "Generic (PLEG): container finished" podID="e425d125-7648-4342-832d-6944cae7c342" containerID="469695b09ab7670f2f73a66a9bbeded064b578eb2d7f41b797c58a9d7021876a" exitCode=0 May 28 10:05:31.342239 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.342136 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerDied","Data":"469695b09ab7670f2f73a66a9bbeded064b578eb2d7f41b797c58a9d7021876a"} May 28 10:05:31.359483 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.359403 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pjshq" podStartSLOduration=8.745630633 podStartE2EDuration="22.359390201s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.966544639 +0000 UTC m=+3.360459059" lastFinishedPulling="2026-05-28 10:05:25.58030422 +0000 UTC m=+16.974218627" observedRunningTime="2026-05-28 10:05:31.359025862 +0000 UTC m=+22.752940292" watchObservedRunningTime="2026-05-28 10:05:31.359390201 +0000 UTC m=+22.753304630" May 28 10:05:31.432940 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.432888 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sdfsm" podStartSLOduration=4.164346299 podStartE2EDuration="22.432873999s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.979458598 +0000 UTC m=+3.373373017" lastFinishedPulling="2026-05-28 10:05:30.247986301 +0000 UTC m=+21.641900717" observedRunningTime="2026-05-28 10:05:31.413322538 +0000 UTC m=+22.807236963" watchObservedRunningTime="2026-05-28 10:05:31.432873999 +0000 UTC m=+22.826788427" May 28 10:05:31.464497 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.464448 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r5779" podStartSLOduration=12.23408999 podStartE2EDuration="22.464433759s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.969072881 +0000 UTC m=+3.362987291" lastFinishedPulling="2026-05-28 10:05:22.199416635 +0000 UTC m=+13.593331060" observedRunningTime="2026-05-28 10:05:31.433041682 +0000 UTC m=+22.826956110" watchObservedRunningTime="2026-05-28 10:05:31.464433759 +0000 UTC m=+22.858348167" May 28 10:05:31.464943 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.464921 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8t8f5" podStartSLOduration=4.171493447 podStartE2EDuration="22.464916292s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.971448272 +0000 UTC m=+3.365362679" lastFinishedPulling="2026-05-28 10:05:30.264871116 +0000 UTC m=+21.658785524" observedRunningTime="2026-05-28 10:05:31.464565435 +0000 UTC m=+22.858479842" watchObservedRunningTime="2026-05-28 10:05:31.464916292 +0000 UTC m=+22.858830721" May 28 10:05:31.690583 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:31.690407 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 10:05:32.093619 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.093576 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r5779" May 28 10:05:32.094310 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.094289 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r5779" May 28 10:05:32.113389 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.113315 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-w4tvk" podStartSLOduration=4.843258354 podStartE2EDuration="23.113299952s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.976514349 +0000 UTC m=+3.370428757" lastFinishedPulling="2026-05-28 10:05:30.246555933 +0000 UTC m=+21.640470355" observedRunningTime="2026-05-28 10:05:31.507634628 +0000 UTC m=+22.901549054" watchObservedRunningTime="2026-05-28 10:05:32.113299952 +0000 UTC m=+23.507214424" May 28 10:05:32.176190 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.176085 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T10:05:31.690579052Z","UUID":"6b5f94e6-e419-4a3a-b81c-e552dd576bf3","Handler":null,"Name":"","Endpoint":""} May 28 10:05:32.179447 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.179260 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 10:05:32.179447 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.179318 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 10:05:32.344887 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.344804 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d5rd2" event={"ID":"b5286f16-f39d-4a8e-8b15-0bdd7109ef06","Type":"ContainerStarted","Data":"ca816fcfd994a015452462a8766b9ac0c71f27d9a823465f45a4b6f1accc6960"} May 28 10:05:32.346449 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.346418 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" event={"ID":"1839ba26-2e7b-45b1-9400-a2802da42bab","Type":"ContainerStarted","Data":"d1ede28ff61354049dc37a9f290d79019fba11fedc7aaa1a27222896f3cdb251"} May 28 10:05:32.346612 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.346596 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r5779" May 28 10:05:32.347011 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.346993 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r5779" May 28 10:05:32.378928 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:32.378874 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d5rd2" podStartSLOduration=5.105469165 podStartE2EDuration="23.378855894s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.973633033 +0000 UTC m=+3.367547446" lastFinishedPulling="2026-05-28 10:05:30.247019761 +0000 UTC m=+21.640934175" observedRunningTime="2026-05-28 10:05:32.362883976 +0000 UTC m=+23.756798406" watchObservedRunningTime="2026-05-28 10:05:32.378855894 +0000 UTC m=+23.772770323" May 28 10:05:33.218956 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:33.218877 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:33.218956 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:33.218923 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:33.219575 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:33.219006 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:33.219575 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:33.219028 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:33.219575 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:33.219098 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:33.219575 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:33.219207 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:33.350640 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:33.350594 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" event={"ID":"1839ba26-2e7b-45b1-9400-a2802da42bab","Type":"ContainerStarted","Data":"b0402b57335bfd2f396ef510c6dad9f09deffbc8e245a9308b767bda6ab486d2"} May 28 10:05:34.355280 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:34.355249 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:05:34.355999 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:34.355692 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"2f8acc04156abf9aa30951a2f3378c2f0e5ed5379a5842f8714d1a57f946414c"} May 28 10:05:35.219039 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:35.219002 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:35.219234 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:35.219054 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:35.219234 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:35.219054 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:35.219234 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:35.219128 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:35.219380 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:35.219241 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:35.219380 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:35.219336 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:36.362222 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.362045 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:05:36.362813 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.362594 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"50256c5081b30f8fe1d4a14e8b306079757222245cd49376f4dbfed272b8f394"} May 28 10:05:36.362874 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.362845 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:36.363133 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.363116 2574 scope.go:117] "RemoveContainer" containerID="7afab9057ed9b4ef41524b0b075401763bc80d43f983fab74f8efe6138117b93" May 28 10:05:36.365604 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.365577 2574 generic.go:358] "Generic (PLEG): container finished" podID="e425d125-7648-4342-832d-6944cae7c342" containerID="5bd9a51d5d52ce69590836e36f2dffb232350e0a644213882ceb2ca288db781b" exitCode=0 May 28 10:05:36.365704 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.365618 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerDied","Data":"5bd9a51d5d52ce69590836e36f2dffb232350e0a644213882ceb2ca288db781b"} May 28 10:05:36.379365 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.379327 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:36.397039 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:36.396996 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t78sb" podStartSLOduration=6.560067655 podStartE2EDuration="27.396982929s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.977291175 +0000 UTC m=+3.371205596" lastFinishedPulling="2026-05-28 10:05:32.81420645 +0000 UTC m=+24.208120870" observedRunningTime="2026-05-28 10:05:33.372335257 +0000 UTC m=+24.766249686" watchObservedRunningTime="2026-05-28 10:05:36.396982929 +0000 UTC m=+27.790897386" May 28 10:05:37.218983 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.218951 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:37.219154 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.218951 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:37.219154 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:37.219081 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:37.219154 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.218951 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:37.219154 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:37.219138 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:37.219383 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:37.219207 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:37.369462 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.369425 2574 generic.go:358] "Generic (PLEG): container finished" podID="e425d125-7648-4342-832d-6944cae7c342" containerID="b32a92d77c5d2e9674b12e24422e1ff3962338209f82e73c57b4aacbf31a39d3" exitCode=0 May 28 10:05:37.369896 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.369521 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerDied","Data":"b32a92d77c5d2e9674b12e24422e1ff3962338209f82e73c57b4aacbf31a39d3"} May 28 10:05:37.373594 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.373573 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:05:37.374074 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.374046 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" event={"ID":"208fa309-7b52-4eb6-b36b-1b90ac0683b7","Type":"ContainerStarted","Data":"e3bf855c6e6c45a7b8775dc001ee74af577a6ee2cdc6a4f0e26aba1b703adf38"} May 28 10:05:37.374293 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.374258 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 28 10:05:37.374419 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.374391 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:37.391074 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.391052 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:37.656643 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.656546 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" podStartSLOduration=9.978281617 podStartE2EDuration="28.656527518s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.979446949 +0000 UTC m=+3.373361362" lastFinishedPulling="2026-05-28 10:05:30.657692851 +0000 UTC m=+22.051607263" observedRunningTime="2026-05-28 10:05:37.462409038 +0000 UTC m=+28.856323466" watchObservedRunningTime="2026-05-28 10:05:37.656527518 +0000 UTC m=+29.050441948" May 28 10:05:37.657255 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.657236 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zp9wj"] May 28 10:05:37.657374 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.657329 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:37.657458 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:37.657436 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:37.660675 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.660652 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9g65s"] May 28 10:05:37.660797 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.660734 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:37.660852 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:37.660818 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:37.693300 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.693269 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvh92"] May 28 10:05:37.693443 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:37.693404 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:37.693543 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:37.693517 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:38.377655 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:38.377622 2574 generic.go:358] "Generic (PLEG): container finished" podID="e425d125-7648-4342-832d-6944cae7c342" containerID="12f98ffaec4dd01cd1c21a9157ba1617670055838c58e4913768c6b3dbc49369" exitCode=0 May 28 10:05:38.378092 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:38.377704 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerDied","Data":"12f98ffaec4dd01cd1c21a9157ba1617670055838c58e4913768c6b3dbc49369"} May 28 10:05:38.378289 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:38.378257 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 28 10:05:39.011969 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:39.011933 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:05:39.220908 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:39.220873 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:39.221090 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:39.221011 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:39.221090 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:39.221005 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:39.221090 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:39.221033 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:39.221241 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:39.221116 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:39.221241 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:39.221204 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:40.393620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:40.393413 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" podUID="208fa309-7b52-4eb6-b36b-1b90ac0683b7" containerName="ovnkube-controller" probeResult="failure" output="" May 28 10:05:41.219648 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:41.219614 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:41.219833 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:41.219614 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:41.219833 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:41.219729 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:41.219833 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:41.219784 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:41.219833 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:41.219811 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:41.220023 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:41.219900 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:42.866226 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:42.866195 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:42.866703 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:42.866341 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:42.866703 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:42.866429 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs podName:38ea32a3-cbf1-45ea-a0bc-0b852e4519e2 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:14.86640961 +0000 UTC m=+66.260324039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs") pod "network-metrics-daemon-9g65s" (UID: "38ea32a3-cbf1-45ea-a0bc-0b852e4519e2") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 10:05:42.967304 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:42.967270 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:42.967461 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:42.967445 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 10:05:42.967512 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:42.967468 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 10:05:42.967512 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:42.967485 2574 projected.go:194] Error preparing data for projected volume kube-api-access-xfvbp for pod openshift-network-diagnostics/network-check-target-vvh92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:42.967583 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:42.967539 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp podName:1240213a-e967-4c0e-abae-8d73a605540d nodeName:}" failed. No retries permitted until 2026-05-28 10:06:14.967526002 +0000 UTC m=+66.361440413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xfvbp" (UniqueName: "kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp") pod "network-check-target-vvh92" (UID: "1240213a-e967-4c0e-abae-8d73a605540d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 10:05:43.219440 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.219335 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:43.219604 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.219335 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:43.219604 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.219468 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vvh92" podUID="1240213a-e967-4c0e-abae-8d73a605540d" May 28 10:05:43.219604 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.219342 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:43.219604 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.219564 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zp9wj" podUID="cc5e55c3-76e3-4b60-b420-4aba7dfa5b05" May 28 10:05:43.219821 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.219655 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9g65s" podUID="38ea32a3-cbf1-45ea-a0bc-0b852e4519e2" May 28 10:05:43.459670 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.459635 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-122.ec2.internal" event="NodeReady" May 28 10:05:43.459842 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.459801 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 10:05:43.529030 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.528945 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86df7c89f6-x89q9"] May 28 10:05:43.561385 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.561322 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc"] May 28 10:05:43.561554 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.561493 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.567723 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.565604 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 10:05:43.574249 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.574215 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9brr7\"" May 28 10:05:43.575025 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.574505 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 10:05:43.575025 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.574557 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 10:05:43.581237 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.581199 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 10:05:43.585400 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.585376 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q"] May 28 10:05:43.585569 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.585551 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" May 28 10:05:43.590070 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.590048 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gx6lg\"" May 28 10:05:43.590510 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.590495 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 28 10:05:43.595369 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.595331 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 28 10:05:43.605317 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.605291 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b"] May 28 10:05:43.605633 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.605612 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:43.608275 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.608257 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4zzhw\"" May 28 10:05:43.611338 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.610073 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 28 10:05:43.611338 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.610092 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 28 10:05:43.611338 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.610092 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 28 10:05:43.631367 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.631329 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86df7c89f6-x89q9"] May 28 10:05:43.631367 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.631373 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc"] May 28 10:05:43.631557 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.631386 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q"] May 28 10:05:43.631557 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.631400 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs"] May 28 10:05:43.631557 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.631497 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.638498 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.638474 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-smzj6\"" May 28 10:05:43.638604 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.638515 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 28 10:05:43.638604 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.638554 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 28 10:05:43.638672 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.638621 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 28 10:05:43.640766 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.640749 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 28 10:05:43.655542 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.655516 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-hlmjq"] May 28 10:05:43.655699 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.655681 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.659921 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.659526 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 10:05:43.659921 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.659565 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8gnjl\"" May 28 10:05:43.659921 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.659836 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 10:05:43.660445 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.660419 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 10:05:43.670228 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.670202 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 10:05:43.670980 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.670961 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w"] May 28 10:05:43.671139 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.671118 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.673421 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673397 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96p55\" (UniqueName: \"kubernetes.io/projected/6d818a86-d3a3-4d52-ae21-c869e1a01974-kube-api-access-96p55\") pod \"volume-data-source-validator-5cf8c89d64-dp6lc\" (UID: \"6d818a86-d3a3-4d52-ae21-c869e1a01974\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" May 28 10:05:43.673516 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-ca-trust-extracted\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.673516 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-installation-pull-secrets\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.673633 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x8pf\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-kube-api-access-9x8pf\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.673633 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-trusted-ca\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.673732 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-certificates\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.673780 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-image-registry-private-configuration\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.673780 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-bound-sa-token\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.673854 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.673821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.676850 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.676831 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 28 10:05:43.677574 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.677391 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zwh8f\"" May 28 10:05:43.678430 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.678172 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 28 10:05:43.689654 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.689625 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4"] May 28 10:05:43.689804 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.689786 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:43.707920 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.707896 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-66dzt"] May 28 10:05:43.708080 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.708062 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" May 28 10:05:43.721690 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.721665 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p242v"] May 28 10:05:43.721865 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.721833 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.737945 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.737920 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7996fdddb8-6vlrw"] May 28 10:05:43.738057 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.738041 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:43.738424 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.738197 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 28 10:05:43.739373 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.739334 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 28 10:05:43.743609 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.743590 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 28 10:05:43.754011 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.753990 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp"] May 28 10:05:43.754153 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.754139 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.758181 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.758141 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 28 10:05:43.758416 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.758343 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 28 10:05:43.758530 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.758463 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 28 10:05:43.758766 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.758747 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 28 10:05:43.762423 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762405 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wtwc8\"" May 28 10:05:43.762616 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762596 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 28 10:05:43.762711 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762609 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 28 10:05:43.762774 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762707 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z5gl5\"" May 28 10:05:43.762774 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762750 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 10:05:43.762876 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762858 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 28 10:05:43.762930 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762884 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 28 10:05:43.762996 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.762978 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 28 10:05:43.763189 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.763172 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-87ksv\"" May 28 10:05:43.763286 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.763268 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 10:05:43.763413 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.763399 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 28 10:05:43.763461 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.763445 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 10:05:43.764180 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.764130 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 10:05:43.764269 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.764188 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 10:05:43.764269 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.764207 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 10:05:43.764482 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.764464 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49hfj\"" May 28 10:05:43.766379 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.766330 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 10:05:43.770142 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.770125 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v"] May 28 10:05:43.770283 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.770263 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.771463 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.771442 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4zh4p\"" May 28 10:05:43.774094 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774068 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-image-registry-private-configuration\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.774196 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774103 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-bound-sa-token\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.774196 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv98w\" (UniqueName: \"kubernetes.io/projected/4b9d4591-5876-44ed-8c66-239d82f24bbf-kube-api-access-xv98w\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:43.774304 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774217 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7d468ee-468e-4af6-8efe-b754ed40fb58-trusted-ca\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.774304 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcf2\" (UniqueName: \"kubernetes.io/projected/d7d468ee-468e-4af6-8efe-b754ed40fb58-kube-api-access-pxcf2\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.774426 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774312 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.774426 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxn7m\" (UniqueName: \"kubernetes.io/projected/5d729c25-51e6-406c-a8ae-3abdfcd56df3-kube-api-access-rxn7m\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.774426 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774388 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7d468ee-468e-4af6-8efe-b754ed40fb58-serving-cert\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.774426 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774419 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96p55\" (UniqueName: \"kubernetes.io/projected/6d818a86-d3a3-4d52-ae21-c869e1a01974-kube-api-access-96p55\") pod \"volume-data-source-validator-5cf8c89d64-dp6lc\" (UID: \"6d818a86-d3a3-4d52-ae21-c869e1a01974\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0012bd-301e-4ec3-ab81-89f4106552d9-serving-cert\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d729c25-51e6-406c-a8ae-3abdfcd56df3-config\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.774480 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.774495 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86df7c89f6-x89q9: secret "image-registry-tls" not found May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774499 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-ca-trust-extracted\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774516 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-installation-pull-secrets\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7d468ee-468e-4af6-8efe-b754ed40fb58-config\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.774620 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.774558 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls podName:fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.274535824 +0000 UTC m=+35.668450242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls") pod "image-registry-86df7c89f6-x89q9" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d") : secret "image-registry-tls" not found May 28 10:05:43.775003 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774716 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 28 10:05:43.775003 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774835 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9x8pf\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-kube-api-access-9x8pf\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.775003 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774872 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-trusted-ca\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.775003 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a0012bd-301e-4ec3-ab81-89f4106552d9-config\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.775003 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774935 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-certificates\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.775003 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d729c25-51e6-406c-a8ae-3abdfcd56df3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.775003 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.774998 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 28 10:05:43.775313 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.775010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:43.775313 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.775043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkgft\" (UniqueName: \"kubernetes.io/projected/9a0012bd-301e-4ec3-ab81-89f4106552d9-kube-api-access-xkgft\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.775445 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.775316 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 28 10:05:43.775445 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.775408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-ca-trust-extracted\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.775802 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.775784 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 28 10:05:43.775898 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.775861 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-certificates\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.776282 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.776249 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-trusted-ca\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.780227 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.780167 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-installation-pull-secrets\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.780227 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.780176 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-image-registry-private-configuration\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.782404 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.782386 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 28 10:05:43.784427 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.784406 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj"] May 28 10:05:43.784530 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.784512 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:43.792929 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.792424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x8pf\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-kube-api-access-9x8pf\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.793611 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.793587 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 28 10:05:43.796947 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.794815 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l76w9\"" May 28 10:05:43.797096 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.797078 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96p55\" (UniqueName: \"kubernetes.io/projected/6d818a86-d3a3-4d52-ae21-c869e1a01974-kube-api-access-96p55\") pod \"volume-data-source-validator-5cf8c89d64-dp6lc\" (UID: \"6d818a86-d3a3-4d52-ae21-c869e1a01974\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" May 28 10:05:43.798879 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.798860 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh"] May 28 10:05:43.799450 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.799427 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:43.799689 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.799645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-bound-sa-token\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:43.805851 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.805715 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 28 10:05:43.805851 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.805715 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 28 10:05:43.806007 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.805888 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 28 10:05:43.806147 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.806132 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 28 10:05:43.808510 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808490 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808518 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808529 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808537 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7996fdddb8-6vlrw"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808545 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-hlmjq"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808553 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808561 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808571 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-66dzt"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808582 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808599 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj"] May 28 10:05:43.808605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808607 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4"] May 28 10:05:43.809057 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808615 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p242v"] May 28 10:05:43.809057 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808627 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-82p76"] May 28 10:05:43.809057 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.808684 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:43.815544 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.815523 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 10:05:43.815642 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.815565 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 10:05:43.816103 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.816080 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 28 10:05:43.816701 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.816682 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-82p76"] May 28 10:05:43.816818 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.816805 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82p76" May 28 10:05:43.818540 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.818513 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-287k4\"" May 28 10:05:43.818630 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.818584 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 28 10:05:43.820692 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.820677 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 10:05:43.820862 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.820848 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 10:05:43.821501 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.821482 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6fcq\"" May 28 10:05:43.876397 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qn54\" (UniqueName: \"kubernetes.io/projected/fa490257-b0d2-42da-9a59-ef02aaf70408-kube-api-access-6qn54\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65a9c421-6dda-4c5d-b607-b652fc352f31-tmp\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h6pj\" (UniqueName: \"kubernetes.io/projected/0a730c79-2532-4842-9cf0-3c77ebf591c4-kube-api-access-2h6pj\") pod \"managed-serviceaccount-addon-agent-5c69544fb6-plt8v\" (UID: \"0a730c79-2532-4842-9cf0-3c77ebf591c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876538 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876590 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkgft\" (UniqueName: \"kubernetes.io/projected/9a0012bd-301e-4ec3-ab81-89f4106552d9-kube-api-access-xkgft\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa490257-b0d2-42da-9a59-ef02aaf70408-snapshots\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.876653 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876698 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxn7m\" (UniqueName: \"kubernetes.io/projected/5d729c25-51e6-406c-a8ae-3abdfcd56df3-kube-api-access-rxn7m\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.876725 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls podName:4b9d4591-5876-44ed-8c66-239d82f24bbf nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.376705395 +0000 UTC m=+35.770619803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls") pod "cluster-samples-operator-697587599-pbd4q" (UID: "4b9d4591-5876-44ed-8c66-239d82f24bbf") : secret "samples-operator-tls" not found May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876839 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7d468ee-468e-4af6-8efe-b754ed40fb58-serving-cert\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxm8\" (UniqueName: \"kubernetes.io/projected/26c4ae9d-c163-4e59-91c9-b81ba132435c-kube-api-access-wdxm8\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876922 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7d468ee-468e-4af6-8efe-b754ed40fb58-config\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876959 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0012bd-301e-4ec3-ab81-89f4106552d9-serving-cert\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.877004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.876983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/65a9c421-6dda-4c5d-b607-b652fc352f31-klusterlet-config\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a730c79-2532-4842-9cf0-3c77ebf591c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c69544fb6-plt8v\" (UID: \"0a730c79-2532-4842-9cf0-3c77ebf591c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa490257-b0d2-42da-9a59-ef02aaf70408-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbhp\" (UniqueName: \"kubernetes.io/projected/37134723-cd3c-4e6c-bf14-47af5a5435b4-kube-api-access-5zbhp\") pod \"network-check-source-7f44b6dd87-dzkx4\" (UID: \"37134723-cd3c-4e6c-bf14-47af5a5435b4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877110 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d729c25-51e6-406c-a8ae-3abdfcd56df3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-default-certificate\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877186 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv98w\" (UniqueName: \"kubernetes.io/projected/4b9d4591-5876-44ed-8c66-239d82f24bbf-kube-api-access-xv98w\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa490257-b0d2-42da-9a59-ef02aaf70408-serving-cert\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877299 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7d468ee-468e-4af6-8efe-b754ed40fb58-trusted-ca\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa490257-b0d2-42da-9a59-ef02aaf70408-service-ca-bundle\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-stats-auth\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877429 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcf2\" (UniqueName: \"kubernetes.io/projected/d7d468ee-468e-4af6-8efe-b754ed40fb58-kube-api-access-pxcf2\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ced184b-c565-4d07-92e6-50c8fc00783f-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:43.877771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877627 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d729c25-51e6-406c-a8ae-3abdfcd56df3-config\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.878512 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5zg\" (UniqueName: \"kubernetes.io/projected/8b0c85eb-53d5-4057-bb60-07537fa1b99f-kube-api-access-9l5zg\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:43.878512 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7d468ee-468e-4af6-8efe-b754ed40fb58-config\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.878512 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa490257-b0d2-42da-9a59-ef02aaf70408-tmp\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.878512 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpnqq\" (UniqueName: \"kubernetes.io/projected/65a9c421-6dda-4c5d-b607-b652fc352f31-kube-api-access-hpnqq\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.878512 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.877771 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a0012bd-301e-4ec3-ab81-89f4106552d9-config\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.878512 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.878066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d729c25-51e6-406c-a8ae-3abdfcd56df3-config\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.878512 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.878232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7d468ee-468e-4af6-8efe-b754ed40fb58-trusted-ca\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.878852 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.878513 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a0012bd-301e-4ec3-ab81-89f4106552d9-config\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.879665 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.879644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0012bd-301e-4ec3-ab81-89f4106552d9-serving-cert\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.879762 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.879710 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7d468ee-468e-4af6-8efe-b754ed40fb58-serving-cert\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.879762 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.879744 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d729c25-51e6-406c-a8ae-3abdfcd56df3-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.892805 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.892775 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxn7m\" (UniqueName: \"kubernetes.io/projected/5d729c25-51e6-406c-a8ae-3abdfcd56df3-kube-api-access-rxn7m\") pod \"kube-storage-version-migrator-operator-565644f49-x5n2b\" (UID: \"5d729c25-51e6-406c-a8ae-3abdfcd56df3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.895603 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.895579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkgft\" (UniqueName: \"kubernetes.io/projected/9a0012bd-301e-4ec3-ab81-89f4106552d9-kube-api-access-xkgft\") pod \"service-ca-operator-57b5b68b8-l7vfs\" (UID: \"9a0012bd-301e-4ec3-ab81-89f4106552d9\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.895914 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.895891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcf2\" (UniqueName: \"kubernetes.io/projected/d7d468ee-468e-4af6-8efe-b754ed40fb58-kube-api-access-pxcf2\") pod \"console-operator-76dff48d59-hlmjq\" (UID: \"d7d468ee-468e-4af6-8efe-b754ed40fb58\") " pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.896052 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.896032 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" May 28 10:05:43.896509 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.896486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv98w\" (UniqueName: \"kubernetes.io/projected/4b9d4591-5876-44ed-8c66-239d82f24bbf-kube-api-access-xv98w\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:43.941457 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.941429 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" May 28 10:05:43.968096 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.968063 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" May 28 10:05:43.978456 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/65a9c421-6dda-4c5d-b607-b652fc352f31-klusterlet-config\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.978580 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978489 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnc2p\" (UniqueName: \"kubernetes.io/projected/886045c0-aeae-41ce-a285-256104554af2-kube-api-access-nnc2p\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:43.978580 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978525 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a730c79-2532-4842-9cf0-3c77ebf591c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c69544fb6-plt8v\" (UID: \"0a730c79-2532-4842-9cf0-3c77ebf591c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:43.978580 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978578 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a1aea0-2d88-4672-8e97-7ab84fde6123-tmp-dir\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfls8\" (UniqueName: \"kubernetes.io/projected/97a1aea0-2d88-4672-8e97-7ab84fde6123-kube-api-access-qfls8\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978635 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa490257-b0d2-42da-9a59-ef02aaf70408-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978662 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbhp\" (UniqueName: \"kubernetes.io/projected/37134723-cd3c-4e6c-bf14-47af5a5435b4-kube-api-access-5zbhp\") pod \"network-check-source-7f44b6dd87-dzkx4\" (UID: \"37134723-cd3c-4e6c-bf14-47af5a5435b4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978698 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-default-certificate\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978764 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa490257-b0d2-42da-9a59-ef02aaf70408-serving-cert\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978788 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978820 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa490257-b0d2-42da-9a59-ef02aaf70408-service-ca-bundle\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978873 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-stats-auth\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978934 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ced184b-c565-4d07-92e6-50c8fc00783f-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.978971 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979030 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5zg\" (UniqueName: \"kubernetes.io/projected/8b0c85eb-53d5-4057-bb60-07537fa1b99f-kube-api-access-9l5zg\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:43.979158 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979063 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa490257-b0d2-42da-9a59-ef02aaf70408-tmp\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979095 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpnqq\" (UniqueName: \"kubernetes.io/projected/65a9c421-6dda-4c5d-b607-b652fc352f31-kube-api-access-hpnqq\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979126 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qn54\" (UniqueName: \"kubernetes.io/projected/fa490257-b0d2-42da-9a59-ef02aaf70408-kube-api-access-6qn54\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppv8l\" (UniqueName: \"kubernetes.io/projected/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-kube-api-access-ppv8l\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/886045c0-aeae-41ce-a285-256104554af2-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979205 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65a9c421-6dda-4c5d-b607-b652fc352f31-tmp\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979232 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6pj\" (UniqueName: \"kubernetes.io/projected/0a730c79-2532-4842-9cf0-3c77ebf591c4-kube-api-access-2h6pj\") pod \"managed-serviceaccount-addon-agent-5c69544fb6-plt8v\" (UID: \"0a730c79-2532-4842-9cf0-3c77ebf591c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979285 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-ca\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979378 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979430 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa490257-b0d2-42da-9a59-ef02aaf70408-snapshots\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa490257-b0d2-42da-9a59-ef02aaf70408-service-ca-bundle\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979458 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-hub\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979540 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa490257-b0d2-42da-9a59-ef02aaf70408-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65a9c421-6dda-4c5d-b607-b652fc352f31-tmp\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.979987 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.979841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa490257-b0d2-42da-9a59-ef02aaf70408-tmp\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.980822 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.980144 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxm8\" (UniqueName: \"kubernetes.io/projected/26c4ae9d-c163-4e59-91c9-b81ba132435c-kube-api-access-wdxm8\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.980822 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.980179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97a1aea0-2d88-4672-8e97-7ab84fde6123-config-volume\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:43.980822 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.980250 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:05:43.980822 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.980314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert podName:4ced184b-c565-4d07-92e6-50c8fc00783f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.480296767 +0000 UTC m=+35.874211191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-99b6w" (UID: "4ced184b-c565-4d07-92e6-50c8fc00783f") : secret "networking-console-plugin-cert" not found May 28 10:05:43.980822 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.980678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4ced184b-c565-4d07-92e6-50c8fc00783f-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:43.980822 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.980754 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.480737037 +0000 UTC m=+35.874651465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : configmap references non-existent config key: service-ca.crt May 28 10:05:43.980822 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.980814 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:05:43.981177 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.980851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.48083923 +0000 UTC m=+35.874753640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : secret "router-metrics-certs-default" not found May 28 10:05:43.981240 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.981191 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:05:43.981294 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:43.981279 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert podName:8b0c85eb-53d5-4057-bb60-07537fa1b99f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.481263644 +0000 UTC m=+35.875178054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert") pod "ingress-canary-p242v" (UID: "8b0c85eb-53d5-4057-bb60-07537fa1b99f") : secret "canary-serving-cert" not found May 28 10:05:43.981494 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.981399 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:05:43.981575 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.981499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa490257-b0d2-42da-9a59-ef02aaf70408-snapshots\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.981840 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.981817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-default-certificate\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:43.982189 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.982171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a730c79-2532-4842-9cf0-3c77ebf591c4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c69544fb6-plt8v\" (UID: \"0a730c79-2532-4842-9cf0-3c77ebf591c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:43.982256 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.982233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/65a9c421-6dda-4c5d-b607-b652fc352f31-klusterlet-config\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:43.982427 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.982385 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa490257-b0d2-42da-9a59-ef02aaf70408-serving-cert\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:43.983556 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:43.983534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-stats-auth\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:44.009402 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.009370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qn54\" (UniqueName: \"kubernetes.io/projected/fa490257-b0d2-42da-9a59-ef02aaf70408-kube-api-access-6qn54\") pod \"insights-operator-78bdfb888c-66dzt\" (UID: \"fa490257-b0d2-42da-9a59-ef02aaf70408\") " pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:44.009775 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.009747 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h6pj\" (UniqueName: \"kubernetes.io/projected/0a730c79-2532-4842-9cf0-3c77ebf591c4-kube-api-access-2h6pj\") pod \"managed-serviceaccount-addon-agent-5c69544fb6-plt8v\" (UID: \"0a730c79-2532-4842-9cf0-3c77ebf591c4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:44.010236 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.010207 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5zg\" (UniqueName: \"kubernetes.io/projected/8b0c85eb-53d5-4057-bb60-07537fa1b99f-kube-api-access-9l5zg\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:44.010339 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.010322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpnqq\" (UniqueName: \"kubernetes.io/projected/65a9c421-6dda-4c5d-b607-b652fc352f31-kube-api-access-hpnqq\") pod \"klusterlet-addon-workmgr-545b9ff6d-m7ghp\" (UID: \"65a9c421-6dda-4c5d-b607-b652fc352f31\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:44.011233 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.011211 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxm8\" (UniqueName: \"kubernetes.io/projected/26c4ae9d-c163-4e59-91c9-b81ba132435c-kube-api-access-wdxm8\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:44.011518 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.011499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbhp\" (UniqueName: \"kubernetes.io/projected/37134723-cd3c-4e6c-bf14-47af5a5435b4-kube-api-access-5zbhp\") pod \"network-check-source-7f44b6dd87-dzkx4\" (UID: \"37134723-cd3c-4e6c-bf14-47af5a5435b4\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" May 28 10:05:44.016795 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.016776 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" May 28 10:05:44.038602 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.038540 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-66dzt" May 28 10:05:44.081736 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.081702 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:44.082029 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082005 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ppv8l\" (UniqueName: \"kubernetes.io/projected/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-kube-api-access-ppv8l\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:44.082127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082044 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/886045c0-aeae-41ce-a285-256104554af2-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.082127 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082109 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-ca\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.082238 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082143 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.082238 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082181 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-hub\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.082333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082255 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97a1aea0-2d88-4672-8e97-7ab84fde6123-config-volume\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.082333 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.082263 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:05:44.082333 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.082333 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls podName:97a1aea0-2d88-4672-8e97-7ab84fde6123 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.582312356 +0000 UTC m=+35.976226768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls") pod "dns-default-82p76" (UID: "97a1aea0-2d88-4672-8e97-7ab84fde6123") : secret "dns-default-metrics-tls" not found May 28 10:05:44.082641 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082434 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnc2p\" (UniqueName: \"kubernetes.io/projected/886045c0-aeae-41ce-a285-256104554af2-kube-api-access-nnc2p\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.082641 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082478 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:44.082641 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082504 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a1aea0-2d88-4672-8e97-7ab84fde6123-tmp-dir\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.082641 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082530 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfls8\" (UniqueName: \"kubernetes.io/projected/97a1aea0-2d88-4672-8e97-7ab84fde6123-kube-api-access-qfls8\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.082641 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082571 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:44.082641 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082626 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.082916 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082669 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.082916 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/886045c0-aeae-41ce-a285-256104554af2-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.082916 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.082873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97a1aea0-2d88-4672-8e97-7ab84fde6123-tmp-dir\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.083089 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.083006 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:05:44.083089 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.083049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/97a1aea0-2d88-4672-8e97-7ab84fde6123-config-volume\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.083089 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.083059 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls podName:b12b4cf2-be9a-4b6e-bb09-6377fcb01b80 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:44.583040622 +0000 UTC m=+35.976955054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-z2hfh" (UID: "b12b4cf2-be9a-4b6e-bb09-6377fcb01b80") : secret "cluster-monitoring-operator-tls" not found May 28 10:05:44.083553 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.083527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:44.085578 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.085559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.085667 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.085608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-hub\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.085733 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.085720 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.085905 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.085882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/886045c0-aeae-41ce-a285-256104554af2-ca\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.094700 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.094656 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfls8\" (UniqueName: \"kubernetes.io/projected/97a1aea0-2d88-4672-8e97-7ab84fde6123-kube-api-access-qfls8\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.095142 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.095124 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppv8l\" (UniqueName: \"kubernetes.io/projected/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-kube-api-access-ppv8l\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:44.095338 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.095322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnc2p\" (UniqueName: \"kubernetes.io/projected/886045c0-aeae-41ce-a285-256104554af2-kube-api-access-nnc2p\") pod \"cluster-proxy-proxy-agent-56cf6c7994-hptxj\" (UID: \"886045c0-aeae-41ce-a285-256104554af2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.120747 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.120721 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" May 28 10:05:44.139545 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.139520 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:05:44.285365 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.285305 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:44.285579 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.285492 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:05:44.285579 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.285511 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86df7c89f6-x89q9: secret "image-registry-tls" not found May 28 10:05:44.285687 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.285584 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls podName:fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.285566066 +0000 UTC m=+36.679480494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls") pod "image-registry-86df7c89f6-x89q9" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d") : secret "image-registry-tls" not found May 28 10:05:44.386830 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.386567 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:44.387016 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.386750 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:05:44.387076 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.387049 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls podName:4b9d4591-5876-44ed-8c66-239d82f24bbf nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.387029146 +0000 UTC m=+36.780943569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls") pod "cluster-samples-operator-697587599-pbd4q" (UID: "4b9d4591-5876-44ed-8c66-239d82f24bbf") : secret "samples-operator-tls" not found May 28 10:05:44.490449 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.489808 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:44.490449 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.489902 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:44.490449 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.489994 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:44.490449 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.490027 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:44.490449 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.490306 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.490287947 +0000 UTC m=+36.884202356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : configmap references non-existent config key: service-ca.crt May 28 10:05:44.490786 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.490582 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:05:44.490786 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.490679 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert podName:4ced184b-c565-4d07-92e6-50c8fc00783f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.490660921 +0000 UTC m=+36.884575349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-99b6w" (UID: "4ced184b-c565-4d07-92e6-50c8fc00783f") : secret "networking-console-plugin-cert" not found May 28 10:05:44.490786 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.490740 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:05:44.490786 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.490773 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert podName:8b0c85eb-53d5-4057-bb60-07537fa1b99f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.490762139 +0000 UTC m=+36.884676553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert") pod "ingress-canary-p242v" (UID: "8b0c85eb-53d5-4057-bb60-07537fa1b99f") : secret "canary-serving-cert" not found May 28 10:05:44.491029 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.490826 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:05:44.491029 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.490857 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.490847252 +0000 UTC m=+36.884761674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : secret "router-metrics-certs-default" not found May 28 10:05:44.595633 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.592932 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:44.595633 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.593053 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:44.595633 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.593212 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:05:44.595633 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.593272 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls podName:b12b4cf2-be9a-4b6e-bb09-6377fcb01b80 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.59325458 +0000 UTC m=+36.987168991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-z2hfh" (UID: "b12b4cf2-be9a-4b6e-bb09-6377fcb01b80") : secret "cluster-monitoring-operator-tls" not found May 28 10:05:44.595633 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.593710 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:05:44.595633 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:44.593754 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls podName:97a1aea0-2d88-4672-8e97-7ab84fde6123 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:45.593739629 +0000 UTC m=+36.987654042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls") pod "dns-default-82p76" (UID: "97a1aea0-2d88-4672-8e97-7ab84fde6123") : secret "dns-default-metrics-tls" not found May 28 10:05:44.651657 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.651573 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b"] May 28 10:05:44.657656 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.654848 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp"] May 28 10:05:44.669302 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.668334 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4"] May 28 10:05:44.669302 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.669024 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a9c421_6dda_4c5d_b607_b652fc352f31.slice/crio-369058fe17c8696f1c2e82caf6bf17aa69225c5d3bb9f3bd5813d8e3f76b0a5c WatchSource:0}: Error finding container 369058fe17c8696f1c2e82caf6bf17aa69225c5d3bb9f3bd5813d8e3f76b0a5c: Status 404 returned error can't find the container with id 369058fe17c8696f1c2e82caf6bf17aa69225c5d3bb9f3bd5813d8e3f76b0a5c May 28 10:05:44.673617 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.673333 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37134723_cd3c_4e6c_bf14_47af5a5435b4.slice/crio-e2ceaade89c8b9286d782392a4b6186514827cfb32d3c83cdb11a68fe0e4b4c9 WatchSource:0}: Error finding container e2ceaade89c8b9286d782392a4b6186514827cfb32d3c83cdb11a68fe0e4b4c9: Status 404 returned error can't find the container with id e2ceaade89c8b9286d782392a4b6186514827cfb32d3c83cdb11a68fe0e4b4c9 May 28 10:05:44.675814 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.675766 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-66dzt"] May 28 10:05:44.681332 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.680412 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc"] May 28 10:05:44.681332 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.681199 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj"] May 28 10:05:44.681534 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.681311 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa490257_b0d2_42da_9a59_ef02aaf70408.slice/crio-518f9b6631d77cb3b67ba91ebfc601a0346837f9d4803120b914f871074e08e8 WatchSource:0}: Error finding container 518f9b6631d77cb3b67ba91ebfc601a0346837f9d4803120b914f871074e08e8: Status 404 returned error can't find the container with id 518f9b6631d77cb3b67ba91ebfc601a0346837f9d4803120b914f871074e08e8 May 28 10:05:44.684227 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.684172 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod886045c0_aeae_41ce_a285_256104554af2.slice/crio-796c4853c7e4ee62cec2152dd8e985d58e969c3b66ab063fec5c142a0789a4b9 WatchSource:0}: Error finding container 796c4853c7e4ee62cec2152dd8e985d58e969c3b66ab063fec5c142a0789a4b9: Status 404 returned error can't find the container with id 796c4853c7e4ee62cec2152dd8e985d58e969c3b66ab063fec5c142a0789a4b9 May 28 10:05:44.685810 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.685787 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d818a86_d3a3_4d52_ae21_c869e1a01974.slice/crio-49b9e278e3a10e5b521a93edeb947ff356dd937c3c77858b37e859a4a0909d38 WatchSource:0}: Error finding container 49b9e278e3a10e5b521a93edeb947ff356dd937c3c77858b37e859a4a0909d38: Status 404 returned error can't find the container with id 49b9e278e3a10e5b521a93edeb947ff356dd937c3c77858b37e859a4a0909d38 May 28 10:05:44.694411 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.694333 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v"] May 28 10:05:44.698102 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.698073 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a730c79_2532_4842_9cf0_3c77ebf591c4.slice/crio-1c83cdc6084ff9179a2e59962a3e71f261d99b74a1ace3de58f2cc5c0b57e7d8 WatchSource:0}: Error finding container 1c83cdc6084ff9179a2e59962a3e71f261d99b74a1ace3de58f2cc5c0b57e7d8: Status 404 returned error can't find the container with id 1c83cdc6084ff9179a2e59962a3e71f261d99b74a1ace3de58f2cc5c0b57e7d8 May 28 10:05:44.698796 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.698454 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs"] May 28 10:05:44.699698 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:44.699676 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-hlmjq"] May 28 10:05:44.702779 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.702746 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0012bd_301e_4ec3_ab81_89f4106552d9.slice/crio-ceb358951d6ef3095e35c9d669cbe3f27df5acba4101c63697a74eff4fcf40b6 WatchSource:0}: Error finding container ceb358951d6ef3095e35c9d669cbe3f27df5acba4101c63697a74eff4fcf40b6: Status 404 returned error can't find the container with id ceb358951d6ef3095e35c9d669cbe3f27df5acba4101c63697a74eff4fcf40b6 May 28 10:05:44.703510 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:05:44.703488 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d468ee_468e_4af6_8efe_b754ed40fb58.slice/crio-823811c0ab07d255f9ccd07a52aa26e22936206c4f636b4bde95c9cb1c045956 WatchSource:0}: Error finding container 823811c0ab07d255f9ccd07a52aa26e22936206c4f636b4bde95c9cb1c045956: Status 404 returned error can't find the container with id 823811c0ab07d255f9ccd07a52aa26e22936206c4f636b4bde95c9cb1c045956 May 28 10:05:45.218978 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.218907 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:05:45.219451 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.218907 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:45.219451 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.218909 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:05:45.222887 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.222865 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpsql\"" May 28 10:05:45.223013 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.222913 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 10:05:45.223013 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.222931 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 10:05:45.223013 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.222988 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-99c9d\"" May 28 10:05:45.299336 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.299309 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:45.299512 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.299480 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:05:45.299512 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.299498 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86df7c89f6-x89q9: secret "image-registry-tls" not found May 28 10:05:45.299620 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.299577 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls podName:fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.299555817 +0000 UTC m=+38.693470229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls") pod "image-registry-86df7c89f6-x89q9" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d") : secret "image-registry-tls" not found May 28 10:05:45.397313 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.397272 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" event={"ID":"65a9c421-6dda-4c5d-b607-b652fc352f31","Type":"ContainerStarted","Data":"369058fe17c8696f1c2e82caf6bf17aa69225c5d3bb9f3bd5813d8e3f76b0a5c"} May 28 10:05:45.399852 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.399809 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" event={"ID":"d7d468ee-468e-4af6-8efe-b754ed40fb58","Type":"ContainerStarted","Data":"823811c0ab07d255f9ccd07a52aa26e22936206c4f636b4bde95c9cb1c045956"} May 28 10:05:45.400005 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.399899 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:45.400535 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.400091 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:05:45.400535 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.400159 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls podName:4b9d4591-5876-44ed-8c66-239d82f24bbf nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.400139092 +0000 UTC m=+38.794053515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls") pod "cluster-samples-operator-697587599-pbd4q" (UID: "4b9d4591-5876-44ed-8c66-239d82f24bbf") : secret "samples-operator-tls" not found May 28 10:05:45.403838 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.403794 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" event={"ID":"5d729c25-51e6-406c-a8ae-3abdfcd56df3","Type":"ContainerStarted","Data":"b0115152802b9d16b1d1d2f27358fb3fb80dbc588ceb240a31f722a37c2857f9"} May 28 10:05:45.408435 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.408309 2574 generic.go:358] "Generic (PLEG): container finished" podID="e425d125-7648-4342-832d-6944cae7c342" containerID="b6b19f15dba87aeb011f5a727abdb39d3dfbc043adeb5ffdf532438e6042c5cf" exitCode=0 May 28 10:05:45.408435 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.408402 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerDied","Data":"b6b19f15dba87aeb011f5a727abdb39d3dfbc043adeb5ffdf532438e6042c5cf"} May 28 10:05:45.410487 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.410465 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" event={"ID":"6d818a86-d3a3-4d52-ae21-c869e1a01974","Type":"ContainerStarted","Data":"49b9e278e3a10e5b521a93edeb947ff356dd937c3c77858b37e859a4a0909d38"} May 28 10:05:45.414228 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.412799 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66dzt" event={"ID":"fa490257-b0d2-42da-9a59-ef02aaf70408","Type":"ContainerStarted","Data":"518f9b6631d77cb3b67ba91ebfc601a0346837f9d4803120b914f871074e08e8"} May 28 10:05:45.414228 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.414175 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" event={"ID":"0a730c79-2532-4842-9cf0-3c77ebf591c4","Type":"ContainerStarted","Data":"1c83cdc6084ff9179a2e59962a3e71f261d99b74a1ace3de58f2cc5c0b57e7d8"} May 28 10:05:45.416393 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.416369 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" event={"ID":"37134723-cd3c-4e6c-bf14-47af5a5435b4","Type":"ContainerStarted","Data":"e2ceaade89c8b9286d782392a4b6186514827cfb32d3c83cdb11a68fe0e4b4c9"} May 28 10:05:45.417712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.417674 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" event={"ID":"9a0012bd-301e-4ec3-ab81-89f4106552d9","Type":"ContainerStarted","Data":"ceb358951d6ef3095e35c9d669cbe3f27df5acba4101c63697a74eff4fcf40b6"} May 28 10:05:45.418913 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.418871 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" event={"ID":"886045c0-aeae-41ce-a285-256104554af2","Type":"ContainerStarted","Data":"796c4853c7e4ee62cec2152dd8e985d58e969c3b66ab063fec5c142a0789a4b9"} May 28 10:05:45.501811 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.501528 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:45.501811 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.501577 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:45.501811 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.501688 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:05:45.501811 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.501718 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:45.501811 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.501762 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.501742601 +0000 UTC m=+38.895657032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : secret "router-metrics-certs-default" not found May 28 10:05:45.501811 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.501806 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:45.501811 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.501818 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:05:45.502240 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.501863 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert podName:8b0c85eb-53d5-4057-bb60-07537fa1b99f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.50184857 +0000 UTC m=+38.895762981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert") pod "ingress-canary-p242v" (UID: "8b0c85eb-53d5-4057-bb60-07537fa1b99f") : secret "canary-serving-cert" not found May 28 10:05:45.502240 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.501903 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:05:45.502240 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.501942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert podName:4ced184b-c565-4d07-92e6-50c8fc00783f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.501930067 +0000 UTC m=+38.895844475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-99b6w" (UID: "4ced184b-c565-4d07-92e6-50c8fc00783f") : secret "networking-console-plugin-cert" not found May 28 10:05:45.502240 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.501962 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.50195149 +0000 UTC m=+38.895865903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : configmap references non-existent config key: service-ca.crt May 28 10:05:45.604331 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.603165 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:45.604331 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.603473 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:05:45.604331 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.603542 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls podName:b12b4cf2-be9a-4b6e-bb09-6377fcb01b80 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.603521825 +0000 UTC m=+38.997436235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-z2hfh" (UID: "b12b4cf2-be9a-4b6e-bb09-6377fcb01b80") : secret "cluster-monitoring-operator-tls" not found May 28 10:05:45.604331 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:45.603677 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:45.604331 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.603783 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:05:45.604331 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:45.603818 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls podName:97a1aea0-2d88-4672-8e97-7ab84fde6123 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:47.603806745 +0000 UTC m=+38.997721159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls") pod "dns-default-82p76" (UID: "97a1aea0-2d88-4672-8e97-7ab84fde6123") : secret "dns-default-metrics-tls" not found May 28 10:05:46.444290 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:46.444246 2574 generic.go:358] "Generic (PLEG): container finished" podID="e425d125-7648-4342-832d-6944cae7c342" containerID="893226ad3c0eeeab87fd7fdebd8bd1b0c7d324cfac8ad064bdc51db401759862" exitCode=0 May 28 10:05:46.445009 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:46.444312 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerDied","Data":"893226ad3c0eeeab87fd7fdebd8bd1b0c7d324cfac8ad064bdc51db401759862"} May 28 10:05:47.224188 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.223725 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:47.239698 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.239624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cc5e55c3-76e3-4b60-b420-4aba7dfa5b05-original-pull-secret\") pod \"global-pull-secret-syncer-zp9wj\" (UID: \"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05\") " pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:47.325634 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.325158 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:47.325634 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.325445 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:05:47.325634 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.325463 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86df7c89f6-x89q9: secret "image-registry-tls" not found May 28 10:05:47.325634 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.325523 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls podName:fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.325503161 +0000 UTC m=+42.719417571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls") pod "image-registry-86df7c89f6-x89q9" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d") : secret "image-registry-tls" not found May 28 10:05:47.336464 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.335781 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zp9wj" May 28 10:05:47.426470 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.426433 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:47.427161 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.426755 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:05:47.427161 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.426821 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls podName:4b9d4591-5876-44ed-8c66-239d82f24bbf nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.426803551 +0000 UTC m=+42.820717963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls") pod "cluster-samples-operator-697587599-pbd4q" (UID: "4b9d4591-5876-44ed-8c66-239d82f24bbf") : secret "samples-operator-tls" not found May 28 10:05:47.480007 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.479137 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g66c4" event={"ID":"e425d125-7648-4342-832d-6944cae7c342","Type":"ContainerStarted","Data":"155ca71a7d286dbaeade01583236a3c81ad1aaf38598e01c16480095c1142af4"} May 28 10:05:47.509683 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.509622 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g66c4" podStartSLOduration=5.854175753 podStartE2EDuration="38.509604735s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:05:11.968905286 +0000 UTC m=+3.362819696" lastFinishedPulling="2026-05-28 10:05:44.624334255 +0000 UTC m=+36.018248678" observedRunningTime="2026-05-28 10:05:47.508233131 +0000 UTC m=+38.902147572" watchObservedRunningTime="2026-05-28 10:05:47.509604735 +0000 UTC m=+38.903519165" May 28 10:05:47.527918 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.527882 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:47.528101 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.527981 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:47.528101 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.528090 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:47.528230 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.528125 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:47.528659 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.528635 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:05:47.528788 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.528700 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert podName:8b0c85eb-53d5-4057-bb60-07537fa1b99f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.528682486 +0000 UTC m=+42.922596899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert") pod "ingress-canary-p242v" (UID: "8b0c85eb-53d5-4057-bb60-07537fa1b99f") : secret "canary-serving-cert" not found May 28 10:05:47.529632 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.529610 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:05:47.529762 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.529666 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert podName:4ced184b-c565-4d07-92e6-50c8fc00783f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.529649639 +0000 UTC m=+42.923564051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-99b6w" (UID: "4ced184b-c565-4d07-92e6-50c8fc00783f") : secret "networking-console-plugin-cert" not found May 28 10:05:47.530040 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.530021 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:05:47.530134 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.530071 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.530056765 +0000 UTC m=+42.923971179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : secret "router-metrics-certs-default" not found May 28 10:05:47.530199 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.530135 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.530124528 +0000 UTC m=+42.924038937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : configmap references non-existent config key: service-ca.crt May 28 10:05:47.629587 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.629548 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:47.629771 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:47.629674 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:47.629887 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.629842 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:05:47.629946 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.629910 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls podName:b12b4cf2-be9a-4b6e-bb09-6377fcb01b80 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.629890918 +0000 UTC m=+43.023805341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-z2hfh" (UID: "b12b4cf2-be9a-4b6e-bb09-6377fcb01b80") : secret "cluster-monitoring-operator-tls" not found May 28 10:05:47.630010 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.629992 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:05:47.630063 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:47.630032 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls podName:97a1aea0-2d88-4672-8e97-7ab84fde6123 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:51.630019 +0000 UTC m=+43.023933410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls") pod "dns-default-82p76" (UID: "97a1aea0-2d88-4672-8e97-7ab84fde6123") : secret "dns-default-metrics-tls" not found May 28 10:05:51.367936 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.367886 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:51.368398 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.368050 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:05:51.368398 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.368071 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86df7c89f6-x89q9: secret "image-registry-tls" not found May 28 10:05:51.368398 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.368126 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls podName:fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.368111294 +0000 UTC m=+50.762025701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls") pod "image-registry-86df7c89f6-x89q9" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d") : secret "image-registry-tls" not found May 28 10:05:51.469386 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.469329 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:51.469647 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.469484 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:05:51.469647 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.469543 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls podName:4b9d4591-5876-44ed-8c66-239d82f24bbf nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.469527812 +0000 UTC m=+50.863442236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls") pod "cluster-samples-operator-697587599-pbd4q" (UID: "4b9d4591-5876-44ed-8c66-239d82f24bbf") : secret "samples-operator-tls" not found May 28 10:05:51.569799 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.569764 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:51.569988 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.569808 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:51.569988 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.569852 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:51.569988 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.569872 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:51.569988 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.569930 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:05:51.569988 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.569970 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:05:51.569988 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.569977 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:05:51.570202 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.570001 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.569981968 +0000 UTC m=+50.963896377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : configmap references non-existent config key: service-ca.crt May 28 10:05:51.570202 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.570023 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert podName:4ced184b-c565-4d07-92e6-50c8fc00783f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.570010432 +0000 UTC m=+50.963924839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-99b6w" (UID: "4ced184b-c565-4d07-92e6-50c8fc00783f") : secret "networking-console-plugin-cert" not found May 28 10:05:51.570202 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.570036 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert podName:8b0c85eb-53d5-4057-bb60-07537fa1b99f nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.570030048 +0000 UTC m=+50.963944455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert") pod "ingress-canary-p242v" (UID: "8b0c85eb-53d5-4057-bb60-07537fa1b99f") : secret "canary-serving-cert" not found May 28 10:05:51.570202 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.570049 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.57004187 +0000 UTC m=+50.963956277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : secret "router-metrics-certs-default" not found May 28 10:05:51.671156 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.671072 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:51.671368 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:51.671183 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:51.671368 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.671225 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:05:51.671368 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.671265 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:05:51.671368 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.671289 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls podName:b12b4cf2-be9a-4b6e-bb09-6377fcb01b80 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.671274311 +0000 UTC m=+51.065188717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-z2hfh" (UID: "b12b4cf2-be9a-4b6e-bb09-6377fcb01b80") : secret "cluster-monitoring-operator-tls" not found May 28 10:05:51.671368 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:51.671310 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls podName:97a1aea0-2d88-4672-8e97-7ab84fde6123 nodeName:}" failed. No retries permitted until 2026-05-28 10:05:59.671300001 +0000 UTC m=+51.065214408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls") pod "dns-default-82p76" (UID: "97a1aea0-2d88-4672-8e97-7ab84fde6123") : secret "dns-default-metrics-tls" not found May 28 10:05:58.125745 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.125724 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zp9wj"] May 28 10:05:58.507687 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.507107 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" event={"ID":"6d818a86-d3a3-4d52-ae21-c869e1a01974","Type":"ContainerStarted","Data":"5252bfc1b24ea949bbc8f65fef0091cef5d63381f895de3f2670e9b3e69a5102"} May 28 10:05:58.508689 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.508658 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66dzt" event={"ID":"fa490257-b0d2-42da-9a59-ef02aaf70408","Type":"ContainerStarted","Data":"04ee6bd0f8e07a02c73b3cdc84ce47b556dd13e70ed4ab14949fd35a56dec7d2"} May 28 10:05:58.510701 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.510557 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" event={"ID":"37134723-cd3c-4e6c-bf14-47af5a5435b4","Type":"ContainerStarted","Data":"dd3d50d9996602d1bafd30c35431fb283985d3b90fe015d16c5ba99a4b3ef76e"} May 28 10:05:58.512299 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.512253 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" event={"ID":"886045c0-aeae-41ce-a285-256104554af2","Type":"ContainerStarted","Data":"cd3c354ba92a99afd91bba92567dedf51c8ea2375283177676d25df7ce87f535"} May 28 10:05:58.513219 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.513159 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zp9wj" event={"ID":"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05","Type":"ContainerStarted","Data":"b6032d8ca655a5e02dcee8e3e545b8cc4c19022007b43fe0b8c65881101312b5"} May 28 10:05:58.518859 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.516540 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/0.log" May 28 10:05:58.518859 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.516576 2574 generic.go:358] "Generic (PLEG): container finished" podID="d7d468ee-468e-4af6-8efe-b754ed40fb58" containerID="c6bab75e11ea56b9aa89780e2d3114034e2adcaee4302b427e65fd5517c2aeae" exitCode=255 May 28 10:05:58.518859 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.516634 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" event={"ID":"d7d468ee-468e-4af6-8efe-b754ed40fb58","Type":"ContainerDied","Data":"c6bab75e11ea56b9aa89780e2d3114034e2adcaee4302b427e65fd5517c2aeae"} May 28 10:05:58.518859 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.516851 2574 scope.go:117] "RemoveContainer" containerID="c6bab75e11ea56b9aa89780e2d3114034e2adcaee4302b427e65fd5517c2aeae" May 28 10:05:58.521428 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.521211 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" event={"ID":"5d729c25-51e6-406c-a8ae-3abdfcd56df3","Type":"ContainerStarted","Data":"ed0564189738a86b401f62b56affd02dd12cf8f2faac24cc78b64e335c99f6fe"} May 28 10:05:58.532563 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.532210 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-dp6lc" podStartSLOduration=27.22099809 podStartE2EDuration="40.53219327s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.687725486 +0000 UTC m=+36.081639902" lastFinishedPulling="2026-05-28 10:05:57.998920673 +0000 UTC m=+49.392835082" observedRunningTime="2026-05-28 10:05:58.531267031 +0000 UTC m=+49.925181460" watchObservedRunningTime="2026-05-28 10:05:58.53219327 +0000 UTC m=+49.926107701" May 28 10:05:58.554468 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.554419 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-66dzt" podStartSLOduration=27.237938959 podStartE2EDuration="40.55440053s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.683664304 +0000 UTC m=+36.077578714" lastFinishedPulling="2026-05-28 10:05:58.000125845 +0000 UTC m=+49.394040285" observedRunningTime="2026-05-28 10:05:58.554088062 +0000 UTC m=+49.948002491" watchObservedRunningTime="2026-05-28 10:05:58.55440053 +0000 UTC m=+49.948314959" May 28 10:05:58.634839 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.634493 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" podStartSLOduration=27.248624373 podStartE2EDuration="40.634472603s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.660794725 +0000 UTC m=+36.054709146" lastFinishedPulling="2026-05-28 10:05:58.046642968 +0000 UTC m=+49.440557376" observedRunningTime="2026-05-28 10:05:58.587363109 +0000 UTC m=+49.981277531" watchObservedRunningTime="2026-05-28 10:05:58.634472603 +0000 UTC m=+50.028387029" May 28 10:05:58.673791 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:58.673725 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-dzkx4" podStartSLOduration=27.309180153 podStartE2EDuration="40.673706503s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.681575692 +0000 UTC m=+36.075490098" lastFinishedPulling="2026-05-28 10:05:58.046102039 +0000 UTC m=+49.440016448" observedRunningTime="2026-05-28 10:05:58.63667098 +0000 UTC m=+50.030585409" watchObservedRunningTime="2026-05-28 10:05:58.673706503 +0000 UTC m=+50.067620934" May 28 10:05:59.446644 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.445880 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:05:59.446644 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.446090 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 28 10:05:59.446644 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.446106 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86df7c89f6-x89q9: secret "image-registry-tls" not found May 28 10:05:59.446644 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.446163 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls podName:fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.446144869 +0000 UTC m=+66.840059291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls") pod "image-registry-86df7c89f6-x89q9" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d") : secret "image-registry-tls" not found May 28 10:05:59.528609 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.528317 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" event={"ID":"0a730c79-2532-4842-9cf0-3c77ebf591c4","Type":"ContainerStarted","Data":"59cf98f6445d1b6d77d19240d14ae2082c307b0776fc16ced04e56931e445dea"} May 28 10:05:59.532068 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.531622 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" event={"ID":"9a0012bd-301e-4ec3-ab81-89f4106552d9","Type":"ContainerStarted","Data":"a8f257d220a198d6dd7a645576ae5d249f5336bb3b8a9a80ac3a6cb9ba4ea516"} May 28 10:05:59.533802 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.533775 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" event={"ID":"65a9c421-6dda-4c5d-b607-b652fc352f31","Type":"ContainerStarted","Data":"2ce90927cdb9d738dd462dbefba346e05ba2d904e53637ac105928c92f75af09"} May 28 10:05:59.534491 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.534458 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:59.535986 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.535688 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" May 28 10:05:59.536886 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.536813 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:05:59.537863 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.537846 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/0.log" May 28 10:05:59.537955 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.537879 2574 generic.go:358] "Generic (PLEG): container finished" podID="d7d468ee-468e-4af6-8efe-b754ed40fb58" containerID="99999dd99e5d52cbf9ff8826ca20969bda4096ae885514cb88915b6a6737e20b" exitCode=255 May 28 10:05:59.539334 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.538644 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" event={"ID":"d7d468ee-468e-4af6-8efe-b754ed40fb58","Type":"ContainerDied","Data":"99999dd99e5d52cbf9ff8826ca20969bda4096ae885514cb88915b6a6737e20b"} May 28 10:05:59.539334 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.538693 2574 scope.go:117] "RemoveContainer" containerID="c6bab75e11ea56b9aa89780e2d3114034e2adcaee4302b427e65fd5517c2aeae" May 28 10:05:59.539334 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.539094 2574 scope.go:117] "RemoveContainer" containerID="99999dd99e5d52cbf9ff8826ca20969bda4096ae885514cb88915b6a6737e20b" May 28 10:05:59.539334 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.539267 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-hlmjq_openshift-console-operator(d7d468ee-468e-4af6-8efe-b754ed40fb58)\"" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" podUID="d7d468ee-468e-4af6-8efe-b754ed40fb58" May 28 10:05:59.546504 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.546461 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:05:59.546867 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.546767 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 28 10:05:59.546867 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.546845 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls podName:4b9d4591-5876-44ed-8c66-239d82f24bbf nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.546825332 +0000 UTC m=+66.940739756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls") pod "cluster-samples-operator-697587599-pbd4q" (UID: "4b9d4591-5876-44ed-8c66-239d82f24bbf") : secret "samples-operator-tls" not found May 28 10:05:59.547781 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.547739 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c69544fb6-plt8v" podStartSLOduration=23.188532841 podStartE2EDuration="36.547716135s" podCreationTimestamp="2026-05-28 10:05:23 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.701004891 +0000 UTC m=+36.094919304" lastFinishedPulling="2026-05-28 10:05:58.060188182 +0000 UTC m=+49.454102598" observedRunningTime="2026-05-28 10:05:59.546261133 +0000 UTC m=+50.940175564" watchObservedRunningTime="2026-05-28 10:05:59.547716135 +0000 UTC m=+50.941630566" May 28 10:05:59.570819 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.570762 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" podStartSLOduration=27.229445847 podStartE2EDuration="40.570742923s" podCreationTimestamp="2026-05-28 10:05:19 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.70480339 +0000 UTC m=+36.098717802" lastFinishedPulling="2026-05-28 10:05:58.046100454 +0000 UTC m=+49.440014878" observedRunningTime="2026-05-28 10:05:59.568854252 +0000 UTC m=+50.962768684" watchObservedRunningTime="2026-05-28 10:05:59.570742923 +0000 UTC m=+50.964657359" May 28 10:05:59.593873 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.593722 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-545b9ff6d-m7ghp" podStartSLOduration=22.809811924 podStartE2EDuration="36.593672464s" podCreationTimestamp="2026-05-28 10:05:23 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.67271444 +0000 UTC m=+36.066628847" lastFinishedPulling="2026-05-28 10:05:58.456574972 +0000 UTC m=+49.850489387" observedRunningTime="2026-05-28 10:05:59.59266143 +0000 UTC m=+50.986575860" watchObservedRunningTime="2026-05-28 10:05:59.593672464 +0000 UTC m=+50.987586894" May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.647824 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.647926 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.648106 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.648154 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.648301 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.648281412 +0000 UTC m=+67.042195824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : configmap references non-existent config key: service-ca.crt May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.648998 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.649042 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert podName:8b0c85eb-53d5-4057-bb60-07537fa1b99f nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.649028626 +0000 UTC m=+67.042943037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert") pod "ingress-canary-p242v" (UID: "8b0c85eb-53d5-4057-bb60-07537fa1b99f") : secret "canary-serving-cert" not found May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.649612 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.649660 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs podName:26c4ae9d-c163-4e59-91c9-b81ba132435c nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.649644613 +0000 UTC m=+67.043559026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs") pod "router-default-7996fdddb8-6vlrw" (UID: "26c4ae9d-c163-4e59-91c9-b81ba132435c") : secret "router-metrics-certs-default" not found May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.649766 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:05:59.649933 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.649808 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert podName:4ced184b-c565-4d07-92e6-50c8fc00783f nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.649795108 +0000 UTC m=+67.043709519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-99b6w" (UID: "4ced184b-c565-4d07-92e6-50c8fc00783f") : secret "networking-console-plugin-cert" not found May 28 10:05:59.750520 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.749776 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:05:59.750520 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:05:59.749917 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:05:59.750520 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.750052 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 10:05:59.750520 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.750110 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls podName:97a1aea0-2d88-4672-8e97-7ab84fde6123 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.750093491 +0000 UTC m=+67.144007901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls") pod "dns-default-82p76" (UID: "97a1aea0-2d88-4672-8e97-7ab84fde6123") : secret "dns-default-metrics-tls" not found May 28 10:05:59.750520 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.750461 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 28 10:05:59.750899 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:05:59.750545 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls podName:b12b4cf2-be9a-4b6e-bb09-6377fcb01b80 nodeName:}" failed. No retries permitted until 2026-05-28 10:06:15.750528384 +0000 UTC m=+67.144442794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-z2hfh" (UID: "b12b4cf2-be9a-4b6e-bb09-6377fcb01b80") : secret "cluster-monitoring-operator-tls" not found May 28 10:06:00.543541 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:00.543511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:06:00.544011 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:00.543924 2574 scope.go:117] "RemoveContainer" containerID="99999dd99e5d52cbf9ff8826ca20969bda4096ae885514cb88915b6a6737e20b" May 28 10:06:00.544151 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:06:00.544128 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-hlmjq_openshift-console-operator(d7d468ee-468e-4af6-8efe-b754ed40fb58)\"" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" podUID="d7d468ee-468e-4af6-8efe-b754ed40fb58" May 28 10:06:02.537266 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:02.537238 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4tvk_37ac2621-2c47-4fee-9727-b5048e01525e/dns-node-resolver/0.log" May 28 10:06:03.539326 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.539293 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pjshq_823c98f1-5b1d-432d-85f6-19211847784a/node-ca/0.log" May 28 10:06:03.554566 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.554531 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" event={"ID":"886045c0-aeae-41ce-a285-256104554af2","Type":"ContainerStarted","Data":"3a64a7e5139937bde77768d98eae632a98dd5e94cc0a4befa193fe68481d76e2"} May 28 10:06:03.554732 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.554571 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" event={"ID":"886045c0-aeae-41ce-a285-256104554af2","Type":"ContainerStarted","Data":"c25482797ea2d061acd22f234d557990eefbe321e73d079ba36ec66cd150b04f"} May 28 10:06:03.556412 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.555909 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zp9wj" event={"ID":"cc5e55c3-76e3-4b60-b420-4aba7dfa5b05","Type":"ContainerStarted","Data":"c38ff1b876b34a9840c1712342bebbbcbe870e4b0928478cca6307296ef1d254"} May 28 10:06:03.637600 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.637512 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zp9wj" podStartSLOduration=43.395184134 podStartE2EDuration="48.637499258s" podCreationTimestamp="2026-05-28 10:05:15 +0000 UTC" firstStartedPulling="2026-05-28 10:05:58.131601516 +0000 UTC m=+49.525515928" lastFinishedPulling="2026-05-28 10:06:03.373916642 +0000 UTC m=+54.767831052" observedRunningTime="2026-05-28 10:06:03.636670178 +0000 UTC m=+55.030584607" watchObservedRunningTime="2026-05-28 10:06:03.637499258 +0000 UTC m=+55.031413687" May 28 10:06:03.638114 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.638092 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" podStartSLOduration=22.374510084 podStartE2EDuration="40.638084808s" podCreationTimestamp="2026-05-28 10:05:23 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.686566844 +0000 UTC m=+36.080481264" lastFinishedPulling="2026-05-28 10:06:02.950141578 +0000 UTC m=+54.344055988" observedRunningTime="2026-05-28 10:06:03.605658295 +0000 UTC m=+54.999572725" watchObservedRunningTime="2026-05-28 10:06:03.638084808 +0000 UTC m=+55.031999314" May 28 10:06:03.982577 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.982482 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:06:03.982577 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.982537 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:06:03.982902 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:03.982889 2574 scope.go:117] "RemoveContainer" containerID="99999dd99e5d52cbf9ff8826ca20969bda4096ae885514cb88915b6a6737e20b" May 28 10:06:03.983082 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:06:03.983066 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-hlmjq_openshift-console-operator(d7d468ee-468e-4af6-8efe-b754ed40fb58)\"" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" podUID="d7d468ee-468e-4af6-8efe-b754ed40fb58" May 28 10:06:10.391464 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:10.391432 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lzsn" May 28 10:06:14.897211 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:14.897178 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:06:14.900433 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:14.900413 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 10:06:14.910417 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:14.910394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38ea32a3-cbf1-45ea-a0bc-0b852e4519e2-metrics-certs\") pod \"network-metrics-daemon-9g65s\" (UID: \"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2\") " pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:06:14.943363 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:14.943319 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-99c9d\"" May 28 10:06:14.951043 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:14.951021 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9g65s" May 28 10:06:14.998840 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:14.998811 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:06:15.001406 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.001380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfvbp\" (UniqueName: \"kubernetes.io/projected/1240213a-e967-4c0e-abae-8d73a605540d-kube-api-access-xfvbp\") pod \"network-check-target-vvh92\" (UID: \"1240213a-e967-4c0e-abae-8d73a605540d\") " pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:06:15.078788 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.078766 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9g65s"] May 28 10:06:15.080936 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:15.080909 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ea32a3_cbf1_45ea_a0bc_0b852e4519e2.slice/crio-eb13d70840e25534933cd8a2c8a3d4d7877991b15a3a5a01f16bd0b28983923f WatchSource:0}: Error finding container eb13d70840e25534933cd8a2c8a3d4d7877991b15a3a5a01f16bd0b28983923f: Status 404 returned error can't find the container with id eb13d70840e25534933cd8a2c8a3d4d7877991b15a3a5a01f16bd0b28983923f May 28 10:06:15.233162 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.233085 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpsql\"" May 28 10:06:15.239656 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.239639 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:06:15.365085 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.365053 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vvh92"] May 28 10:06:15.367762 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:15.367733 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1240213a_e967_4c0e_abae_8d73a605540d.slice/crio-556e6fb6c4826f39969cdcb7e658668d706fa0f9f422a077edba3d7c03d4e808 WatchSource:0}: Error finding container 556e6fb6c4826f39969cdcb7e658668d706fa0f9f422a077edba3d7c03d4e808: Status 404 returned error can't find the container with id 556e6fb6c4826f39969cdcb7e658668d706fa0f9f422a077edba3d7c03d4e808 May 28 10:06:15.504092 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.504021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:06:15.506206 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.506185 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"image-registry-86df7c89f6-x89q9\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:06:15.591383 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.591336 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9g65s" event={"ID":"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2","Type":"ContainerStarted","Data":"eb13d70840e25534933cd8a2c8a3d4d7877991b15a3a5a01f16bd0b28983923f"} May 28 10:06:15.592384 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.592346 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvh92" event={"ID":"1240213a-e967-4c0e-abae-8d73a605540d","Type":"ContainerStarted","Data":"227d07047f15f4e345e632bb03ddc5e813f6156f88e16d5c08a9e1f00a5808a0"} May 28 10:06:15.592503 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.592393 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vvh92" event={"ID":"1240213a-e967-4c0e-abae-8d73a605540d","Type":"ContainerStarted","Data":"556e6fb6c4826f39969cdcb7e658668d706fa0f9f422a077edba3d7c03d4e808"} May 28 10:06:15.592503 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.592488 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:06:15.604974 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.604947 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:06:15.607436 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.607412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b9d4591-5876-44ed-8c66-239d82f24bbf-samples-operator-tls\") pod \"cluster-samples-operator-697587599-pbd4q\" (UID: \"4b9d4591-5876-44ed-8c66-239d82f24bbf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:06:15.613964 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.613928 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vvh92" podStartSLOduration=66.613918437 podStartE2EDuration="1m6.613918437s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:06:15.613254423 +0000 UTC m=+67.007168854" watchObservedRunningTime="2026-05-28 10:06:15.613918437 +0000 UTC m=+67.007832866" May 28 10:06:15.681159 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.681129 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9brr7\"" May 28 10:06:15.687450 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.687434 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:06:15.705471 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.705442 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:06:15.705620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.705501 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:06:15.705620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.705568 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:15.705620 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.705597 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:15.705780 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:06:15.705699 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 28 10:06:15.705780 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:06:15.705769 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert podName:4ced184b-c565-4d07-92e6-50c8fc00783f nodeName:}" failed. No retries permitted until 2026-05-28 10:06:47.70574952 +0000 UTC m=+99.099663930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-99b6w" (UID: "4ced184b-c565-4d07-92e6-50c8fc00783f") : secret "networking-console-plugin-cert" not found May 28 10:06:15.706371 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.706316 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26c4ae9d-c163-4e59-91c9-b81ba132435c-service-ca-bundle\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:15.708064 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.708040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26c4ae9d-c163-4e59-91c9-b81ba132435c-metrics-certs\") pod \"router-default-7996fdddb8-6vlrw\" (UID: \"26c4ae9d-c163-4e59-91c9-b81ba132435c\") " pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:15.708214 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.708078 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b0c85eb-53d5-4057-bb60-07537fa1b99f-cert\") pod \"ingress-canary-p242v\" (UID: \"8b0c85eb-53d5-4057-bb60-07537fa1b99f\") " pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:06:15.720661 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.720639 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4zzhw\"" May 28 10:06:15.728757 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.728731 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" May 28 10:06:15.806840 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.806335 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:06:15.806840 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.806416 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:06:15.809471 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.809440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/97a1aea0-2d88-4672-8e97-7ab84fde6123-metrics-tls\") pod \"dns-default-82p76\" (UID: \"97a1aea0-2d88-4672-8e97-7ab84fde6123\") " pod="openshift-dns/dns-default-82p76" May 28 10:06:15.809597 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.809505 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b12b4cf2-be9a-4b6e-bb09-6377fcb01b80-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-z2hfh\" (UID: \"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:06:15.835912 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.835796 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86df7c89f6-x89q9"] May 28 10:06:15.838509 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:15.838474 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd27a0d_5cdd_4230_8e6e_2a9e8b51da3d.slice/crio-3993bd8e2324e5040f4dda6fd56d550fba206a63f866a341ef47907354f5e8c2 WatchSource:0}: Error finding container 3993bd8e2324e5040f4dda6fd56d550fba206a63f866a341ef47907354f5e8c2: Status 404 returned error can't find the container with id 3993bd8e2324e5040f4dda6fd56d550fba206a63f866a341ef47907354f5e8c2 May 28 10:06:15.850320 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.850297 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49hfj\"" May 28 10:06:15.857961 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.857912 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p242v" May 28 10:06:15.866517 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.866492 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z5gl5\"" May 28 10:06:15.874539 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.874513 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:15.896329 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.896298 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q"] May 28 10:06:15.952964 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.952102 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-287k4\"" May 28 10:06:15.955021 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.954998 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d6fcq\"" May 28 10:06:15.958495 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.958473 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" May 28 10:06:15.963474 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:15.963406 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-82p76" May 28 10:06:16.050988 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.050540 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p242v"] May 28 10:06:16.064688 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:16.064630 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0c85eb_53d5_4057_bb60_07537fa1b99f.slice/crio-5b8f583926fdd7c96201f9edfe6f2e5e24e459a4c99fd28b2951ce51545db91a WatchSource:0}: Error finding container 5b8f583926fdd7c96201f9edfe6f2e5e24e459a4c99fd28b2951ce51545db91a: Status 404 returned error can't find the container with id 5b8f583926fdd7c96201f9edfe6f2e5e24e459a4c99fd28b2951ce51545db91a May 28 10:06:16.087837 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.087790 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7996fdddb8-6vlrw"] May 28 10:06:16.098844 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:16.098744 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c4ae9d_c163_4e59_91c9_b81ba132435c.slice/crio-5af2a5bf0be64927d9235a455b94d407d8fbf83ad831974f69f20c52b31cb1b8 WatchSource:0}: Error finding container 5af2a5bf0be64927d9235a455b94d407d8fbf83ad831974f69f20c52b31cb1b8: Status 404 returned error can't find the container with id 5af2a5bf0be64927d9235a455b94d407d8fbf83ad831974f69f20c52b31cb1b8 May 28 10:06:16.147059 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.147022 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh"] May 28 10:06:16.151863 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:16.151832 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12b4cf2_be9a_4b6e_bb09_6377fcb01b80.slice/crio-d93a893a5dfc7b62f6583ae170259537c098e2eb90eae7053c64c45149599d26 WatchSource:0}: Error finding container d93a893a5dfc7b62f6583ae170259537c098e2eb90eae7053c64c45149599d26: Status 404 returned error can't find the container with id d93a893a5dfc7b62f6583ae170259537c098e2eb90eae7053c64c45149599d26 May 28 10:06:16.177403 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.177378 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-82p76"] May 28 10:06:16.180811 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:16.180782 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a1aea0_2d88_4672_8e97_7ab84fde6123.slice/crio-9daed63b5a60de594497a9fc2d601abd79eba71768b2079f42abc7e8a2fbbbdd WatchSource:0}: Error finding container 9daed63b5a60de594497a9fc2d601abd79eba71768b2079f42abc7e8a2fbbbdd: Status 404 returned error can't find the container with id 9daed63b5a60de594497a9fc2d601abd79eba71768b2079f42abc7e8a2fbbbdd May 28 10:06:16.595865 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.595825 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" event={"ID":"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80","Type":"ContainerStarted","Data":"d93a893a5dfc7b62f6583ae170259537c098e2eb90eae7053c64c45149599d26"} May 28 10:06:16.596809 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.596776 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82p76" event={"ID":"97a1aea0-2d88-4672-8e97-7ab84fde6123","Type":"ContainerStarted","Data":"9daed63b5a60de594497a9fc2d601abd79eba71768b2079f42abc7e8a2fbbbdd"} May 28 10:06:16.597709 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.597672 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" event={"ID":"4b9d4591-5876-44ed-8c66-239d82f24bbf","Type":"ContainerStarted","Data":"15e0938a5691529e2f2c149ef5d9d9c7dbdc75424a074008f8c89c5672d5f98f"} May 28 10:06:16.598609 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.598584 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p242v" event={"ID":"8b0c85eb-53d5-4057-bb60-07537fa1b99f","Type":"ContainerStarted","Data":"5b8f583926fdd7c96201f9edfe6f2e5e24e459a4c99fd28b2951ce51545db91a"} May 28 10:06:16.599815 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.599795 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" event={"ID":"26c4ae9d-c163-4e59-91c9-b81ba132435c","Type":"ContainerStarted","Data":"f25688d41b23020e29418f917932ab60360360deec2f5c3c7cfc65b441a64c11"} May 28 10:06:16.599913 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.599819 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" event={"ID":"26c4ae9d-c163-4e59-91c9-b81ba132435c","Type":"ContainerStarted","Data":"5af2a5bf0be64927d9235a455b94d407d8fbf83ad831974f69f20c52b31cb1b8"} May 28 10:06:16.601047 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.601025 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" event={"ID":"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d","Type":"ContainerStarted","Data":"6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a"} May 28 10:06:16.601123 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.601055 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" event={"ID":"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d","Type":"ContainerStarted","Data":"3993bd8e2324e5040f4dda6fd56d550fba206a63f866a341ef47907354f5e8c2"} May 28 10:06:16.626876 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.626797 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" podStartSLOduration=57.626781101 podStartE2EDuration="57.626781101s" podCreationTimestamp="2026-05-28 10:05:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:06:16.626179365 +0000 UTC m=+68.020093808" watchObservedRunningTime="2026-05-28 10:06:16.626781101 +0000 UTC m=+68.020695527" May 28 10:06:16.652522 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.652478 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" podStartSLOduration=67.652463091 podStartE2EDuration="1m7.652463091s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:06:16.651540571 +0000 UTC m=+68.045455000" watchObservedRunningTime="2026-05-28 10:06:16.652463091 +0000 UTC m=+68.046377519" May 28 10:06:16.875296 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.875220 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:16.877632 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:16.877611 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:17.220422 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.220085 2574 scope.go:117] "RemoveContainer" containerID="99999dd99e5d52cbf9ff8826ca20969bda4096ae885514cb88915b6a6737e20b" May 28 10:06:17.608375 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.608269 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:06:17.608654 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.608566 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" event={"ID":"d7d468ee-468e-4af6-8efe-b754ed40fb58","Type":"ContainerStarted","Data":"39660fc99a7b62300ba3fbe0678eee5aad29ceb0ea608e1c79653d585ca85654"} May 28 10:06:17.609983 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.609073 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:06:17.615320 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.614690 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9g65s" event={"ID":"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2","Type":"ContainerStarted","Data":"ae52a6b4402ce679b9a650e7b3f09cb34957e79409f20a300e879d95234e4eff"} May 28 10:06:17.615320 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.614721 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9g65s" event={"ID":"38ea32a3-cbf1-45ea-a0bc-0b852e4519e2","Type":"ContainerStarted","Data":"1ac3e98b7765708f1e9cbc4f3ee9d9f7c1d274a49d59cecd001fb64d9d59be08"} May 28 10:06:17.615320 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.614740 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:17.615320 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.615223 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:06:17.617271 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.617227 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7996fdddb8-6vlrw" May 28 10:06:17.632866 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.632807 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" podStartSLOduration=45.338403123 podStartE2EDuration="58.632788949s" podCreationTimestamp="2026-05-28 10:05:19 +0000 UTC" firstStartedPulling="2026-05-28 10:05:44.705557637 +0000 UTC m=+36.099472044" lastFinishedPulling="2026-05-28 10:05:57.999943452 +0000 UTC m=+49.393857870" observedRunningTime="2026-05-28 10:06:17.631968001 +0000 UTC m=+69.025882430" watchObservedRunningTime="2026-05-28 10:06:17.632788949 +0000 UTC m=+69.026703380" May 28 10:06:17.652188 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:17.652105 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9g65s" podStartSLOduration=66.811738294 podStartE2EDuration="1m8.652070035s" podCreationTimestamp="2026-05-28 10:05:09 +0000 UTC" firstStartedPulling="2026-05-28 10:06:15.082804896 +0000 UTC m=+66.476719302" lastFinishedPulling="2026-05-28 10:06:16.923136627 +0000 UTC m=+68.317051043" observedRunningTime="2026-05-28 10:06:17.651457494 +0000 UTC m=+69.045371956" watchObservedRunningTime="2026-05-28 10:06:17.652070035 +0000 UTC m=+69.045984466" May 28 10:06:18.269436 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:18.269404 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-hlmjq" May 28 10:06:21.627646 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.627603 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82p76" event={"ID":"97a1aea0-2d88-4672-8e97-7ab84fde6123","Type":"ContainerStarted","Data":"bad238a5e03073d75dc845edd75df23bf3977bd02eed2be7ec088c1b96c878e4"} May 28 10:06:21.627646 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.627647 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-82p76" event={"ID":"97a1aea0-2d88-4672-8e97-7ab84fde6123","Type":"ContainerStarted","Data":"5ccde9ec0a2168ae4e8dc620545baa72b525795e3767907e481e6e8bd089437e"} May 28 10:06:21.628212 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.627727 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-82p76" May 28 10:06:21.629329 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.629301 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" event={"ID":"4b9d4591-5876-44ed-8c66-239d82f24bbf","Type":"ContainerStarted","Data":"7a0e5c68f1d65068cd355b5ace3cbff6e47a88a4a2bb0e625c352d6510bf3223"} May 28 10:06:21.629484 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.629342 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" event={"ID":"4b9d4591-5876-44ed-8c66-239d82f24bbf","Type":"ContainerStarted","Data":"d1fa498d5324ba1abb8811f7245b196781603ef66e7bf66f8d449b0cc5b65a0d"} May 28 10:06:21.630616 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.630591 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p242v" event={"ID":"8b0c85eb-53d5-4057-bb60-07537fa1b99f","Type":"ContainerStarted","Data":"2c7c3f1cc1395de89e78af56e49afa76095ddd78bf3690dbb3bcba2d361b2f76"} May 28 10:06:21.631938 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.631915 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" event={"ID":"b12b4cf2-be9a-4b6e-bb09-6377fcb01b80","Type":"ContainerStarted","Data":"b401b38645696ee15568c563f93cea0e92f10826a259e628da217421fa821647"} May 28 10:06:21.651056 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.651006 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-82p76" podStartSLOduration=34.073709205 podStartE2EDuration="38.650990706s" podCreationTimestamp="2026-05-28 10:05:43 +0000 UTC" firstStartedPulling="2026-05-28 10:06:16.183115531 +0000 UTC m=+67.577029945" lastFinishedPulling="2026-05-28 10:06:20.760397028 +0000 UTC m=+72.154311446" observedRunningTime="2026-05-28 10:06:21.64849093 +0000 UTC m=+73.042405361" watchObservedRunningTime="2026-05-28 10:06:21.650990706 +0000 UTC m=+73.044905138" May 28 10:06:21.667497 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.667431 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p242v" podStartSLOduration=33.970834616 podStartE2EDuration="38.667414015s" podCreationTimestamp="2026-05-28 10:05:43 +0000 UTC" firstStartedPulling="2026-05-28 10:06:16.068144987 +0000 UTC m=+67.462059401" lastFinishedPulling="2026-05-28 10:06:20.764724381 +0000 UTC m=+72.158638800" observedRunningTime="2026-05-28 10:06:21.666848122 +0000 UTC m=+73.060762548" watchObservedRunningTime="2026-05-28 10:06:21.667414015 +0000 UTC m=+73.061328446" May 28 10:06:21.689231 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.689180 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-z2hfh" podStartSLOduration=58.083193311 podStartE2EDuration="1m2.689167377s" podCreationTimestamp="2026-05-28 10:05:19 +0000 UTC" firstStartedPulling="2026-05-28 10:06:16.154428303 +0000 UTC m=+67.548342711" lastFinishedPulling="2026-05-28 10:06:20.76040237 +0000 UTC m=+72.154316777" observedRunningTime="2026-05-28 10:06:21.687504149 +0000 UTC m=+73.081418578" watchObservedRunningTime="2026-05-28 10:06:21.689167377 +0000 UTC m=+73.083081806" May 28 10:06:21.710560 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:21.710510 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-pbd4q" podStartSLOduration=58.96328571 podStartE2EDuration="1m3.710498163s" podCreationTimestamp="2026-05-28 10:05:18 +0000 UTC" firstStartedPulling="2026-05-28 10:06:16.013286201 +0000 UTC m=+67.407200609" lastFinishedPulling="2026-05-28 10:06:20.760498652 +0000 UTC m=+72.154413062" observedRunningTime="2026-05-28 10:06:21.709279605 +0000 UTC m=+73.103194035" watchObservedRunningTime="2026-05-28 10:06:21.710498163 +0000 UTC m=+73.104412591" May 28 10:06:26.356951 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.356860 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zgnjq"] May 28 10:06:26.365930 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.365898 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.390399 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.390367 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 10:06:26.390825 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.390806 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zl88p\"" May 28 10:06:26.390964 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.390939 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 10:06:26.393864 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.393832 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94e6ee06-f3d3-4b34-a25a-312f00b3b623-crio-socket\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.394077 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.393899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e6ee06-f3d3-4b34-a25a-312f00b3b623-data-volume\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.394077 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.393940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6d6m\" (UniqueName: \"kubernetes.io/projected/94e6ee06-f3d3-4b34-a25a-312f00b3b623-kube-api-access-f6d6m\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.394077 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.393984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94e6ee06-f3d3-4b34-a25a-312f00b3b623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.394077 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.394059 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94e6ee06-f3d3-4b34-a25a-312f00b3b623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.395508 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.395477 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zgnjq"] May 28 10:06:26.495375 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495322 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94e6ee06-f3d3-4b34-a25a-312f00b3b623-crio-socket\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.495552 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495385 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e6ee06-f3d3-4b34-a25a-312f00b3b623-data-volume\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.495552 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495408 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6d6m\" (UniqueName: \"kubernetes.io/projected/94e6ee06-f3d3-4b34-a25a-312f00b3b623-kube-api-access-f6d6m\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.495552 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495433 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94e6ee06-f3d3-4b34-a25a-312f00b3b623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.495552 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/94e6ee06-f3d3-4b34-a25a-312f00b3b623-crio-socket\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.495552 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495474 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94e6ee06-f3d3-4b34-a25a-312f00b3b623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.495788 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495760 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e6ee06-f3d3-4b34-a25a-312f00b3b623-data-volume\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.495996 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.495954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/94e6ee06-f3d3-4b34-a25a-312f00b3b623-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.497802 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.497781 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/94e6ee06-f3d3-4b34-a25a-312f00b3b623-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.515115 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.515083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6d6m\" (UniqueName: \"kubernetes.io/projected/94e6ee06-f3d3-4b34-a25a-312f00b3b623-kube-api-access-f6d6m\") pod \"insights-runtime-extractor-zgnjq\" (UID: \"94e6ee06-f3d3-4b34-a25a-312f00b3b623\") " pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.676773 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.676694 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zgnjq" May 28 10:06:26.821498 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:26.821296 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zgnjq"] May 28 10:06:26.824212 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:26.824185 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e6ee06_f3d3_4b34_a25a_312f00b3b623.slice/crio-386f4cc7dbd07d3f03d3ba2646312341f113c757c097bc61db2d1a8361487545 WatchSource:0}: Error finding container 386f4cc7dbd07d3f03d3ba2646312341f113c757c097bc61db2d1a8361487545: Status 404 returned error can't find the container with id 386f4cc7dbd07d3f03d3ba2646312341f113c757c097bc61db2d1a8361487545 May 28 10:06:27.656010 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:27.655970 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgnjq" event={"ID":"94e6ee06-f3d3-4b34-a25a-312f00b3b623","Type":"ContainerStarted","Data":"a3db5ed1a0e8309619adade9d543ddcbc90bb7f8960283d649cc6edbdce5e62b"} May 28 10:06:27.656484 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:27.656021 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgnjq" event={"ID":"94e6ee06-f3d3-4b34-a25a-312f00b3b623","Type":"ContainerStarted","Data":"386f4cc7dbd07d3f03d3ba2646312341f113c757c097bc61db2d1a8361487545"} May 28 10:06:28.660804 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:28.660757 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgnjq" event={"ID":"94e6ee06-f3d3-4b34-a25a-312f00b3b623","Type":"ContainerStarted","Data":"bc4348a6b1382d801780f18d87ec974ac1324dce27f75a757430a6d68527363d"} May 28 10:06:29.665342 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:29.665257 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgnjq" event={"ID":"94e6ee06-f3d3-4b34-a25a-312f00b3b623","Type":"ContainerStarted","Data":"8c39bfc67acf58680e17d0f45c4db8f4598a63c4a55cdc2926599f8d0a883ca3"} May 28 10:06:29.692065 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:29.692015 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zgnjq" podStartSLOduration=1.20634391 podStartE2EDuration="3.692000914s" podCreationTimestamp="2026-05-28 10:06:26 +0000 UTC" firstStartedPulling="2026-05-28 10:06:26.928950315 +0000 UTC m=+78.322864722" lastFinishedPulling="2026-05-28 10:06:29.414607316 +0000 UTC m=+80.808521726" observedRunningTime="2026-05-28 10:06:29.691066023 +0000 UTC m=+81.084980453" watchObservedRunningTime="2026-05-28 10:06:29.692000914 +0000 UTC m=+81.085915343" May 28 10:06:31.637472 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:31.637436 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-82p76" May 28 10:06:35.692226 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:35.692170 2574 patch_prober.go:28] interesting pod/image-registry-86df7c89f6-x89q9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 10:06:35.692737 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:35.692258 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" podUID="fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 10:06:36.039955 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.039876 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tzbjp"] May 28 10:06:36.043004 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.042985 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.045634 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.045592 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 10:06:36.045634 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.045631 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 10:06:36.045823 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.045592 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t9x7r\"" May 28 10:06:36.046797 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.046776 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 10:06:36.046904 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.046798 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 10:06:36.176750 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.176717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fwls\" (UniqueName: \"kubernetes.io/projected/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-kube-api-access-9fwls\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.176964 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.176765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-sys\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.176964 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.176875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-metrics-client-ca\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.177087 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.176983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.177087 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.177025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-root\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.177087 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.177053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-textfile\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.177232 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.177167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.177232 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.177197 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-tls\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.177232 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.177218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-wtmp\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277696 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277660 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277696 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277702 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-root\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277926 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277723 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-textfile\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277926 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277760 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277926 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277781 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-tls\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277926 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277786 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-root\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277926 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277800 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-wtmp\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.277926 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277878 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwls\" (UniqueName: \"kubernetes.io/projected/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-kube-api-access-9fwls\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.278177 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277932 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-sys\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.278177 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-wtmp\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.278177 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:06:36.277966 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 28 10:06:36.278177 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-sys\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.278177 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.277989 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-metrics-client-ca\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.278177 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:06:36.278032 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-tls podName:bae44f50-72a9-4eeb-94e9-a6c2cd895abd nodeName:}" failed. No retries permitted until 2026-05-28 10:06:36.77800905 +0000 UTC m=+88.171923474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-tls") pod "node-exporter-tzbjp" (UID: "bae44f50-72a9-4eeb-94e9-a6c2cd895abd") : secret "node-exporter-tls" not found May 28 10:06:36.278177 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.278139 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-textfile\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.278554 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.278537 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-metrics-client-ca\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.278602 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.278583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.279927 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.279908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.287231 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.287210 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fwls\" (UniqueName: \"kubernetes.io/projected/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-kube-api-access-9fwls\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.783160 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.783122 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-tls\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.785364 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.785322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bae44f50-72a9-4eeb-94e9-a6c2cd895abd-node-exporter-tls\") pod \"node-exporter-tzbjp\" (UID: \"bae44f50-72a9-4eeb-94e9-a6c2cd895abd\") " pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.952056 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:36.952027 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzbjp" May 28 10:06:36.962269 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:36.962237 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae44f50_72a9_4eeb_94e9_a6c2cd895abd.slice/crio-4e4f56a3cde52ca4a56bcbfb6580676dca844f1bea8614040e1aa7d3d4392868 WatchSource:0}: Error finding container 4e4f56a3cde52ca4a56bcbfb6580676dca844f1bea8614040e1aa7d3d4392868: Status 404 returned error can't find the container with id 4e4f56a3cde52ca4a56bcbfb6580676dca844f1bea8614040e1aa7d3d4392868 May 28 10:06:37.688313 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:37.688281 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzbjp" event={"ID":"bae44f50-72a9-4eeb-94e9-a6c2cd895abd","Type":"ContainerStarted","Data":"4e4f56a3cde52ca4a56bcbfb6580676dca844f1bea8614040e1aa7d3d4392868"} May 28 10:06:38.622321 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:38.622283 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:06:38.692874 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:38.692836 2574 generic.go:358] "Generic (PLEG): container finished" podID="bae44f50-72a9-4eeb-94e9-a6c2cd895abd" containerID="78aa5108114187ed90f611d163e3e5f680d39d4ca855173981609de76412ecfb" exitCode=0 May 28 10:06:38.693024 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:38.692886 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzbjp" event={"ID":"bae44f50-72a9-4eeb-94e9-a6c2cd895abd","Type":"ContainerDied","Data":"78aa5108114187ed90f611d163e3e5f680d39d4ca855173981609de76412ecfb"} May 28 10:06:39.697431 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:39.697386 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzbjp" event={"ID":"bae44f50-72a9-4eeb-94e9-a6c2cd895abd","Type":"ContainerStarted","Data":"40f31bdbcdf88eb83e075986cbc1b9a580efd1165a494e2bbf319c8752c9a51a"} May 28 10:06:39.697431 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:39.697432 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzbjp" event={"ID":"bae44f50-72a9-4eeb-94e9-a6c2cd895abd","Type":"ContainerStarted","Data":"d6d10fb291ffab8402bbd3af4a01a42ac87de6222206b3f2868900fe4224110d"} May 28 10:06:39.730195 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:39.730141 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tzbjp" podStartSLOduration=2.79001491 podStartE2EDuration="3.730126375s" podCreationTimestamp="2026-05-28 10:06:36 +0000 UTC" firstStartedPulling="2026-05-28 10:06:36.964177665 +0000 UTC m=+88.358092072" lastFinishedPulling="2026-05-28 10:06:37.904289115 +0000 UTC m=+89.298203537" observedRunningTime="2026-05-28 10:06:39.72772495 +0000 UTC m=+91.121639405" watchObservedRunningTime="2026-05-28 10:06:39.730126375 +0000 UTC m=+91.124040833" May 28 10:06:46.603161 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:46.603125 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vvh92" May 28 10:06:47.780605 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:47.780564 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:06:47.782996 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:47.782971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4ced184b-c565-4d07-92e6-50c8fc00783f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-99b6w\" (UID: \"4ced184b-c565-4d07-92e6-50c8fc00783f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:06:47.902217 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:47.902178 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wtwc8\"" May 28 10:06:47.909788 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:47.909761 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" May 28 10:06:48.042002 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:48.041926 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w"] May 28 10:06:48.045184 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:06:48.045156 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ced184b_c565_4d07_92e6_50c8fc00783f.slice/crio-a064d47a9ea1bcec859ee2f1e8f7aa9f0c7a6d97a7f782efd379056edf53eb6c WatchSource:0}: Error finding container a064d47a9ea1bcec859ee2f1e8f7aa9f0c7a6d97a7f782efd379056edf53eb6c: Status 404 returned error can't find the container with id a064d47a9ea1bcec859ee2f1e8f7aa9f0c7a6d97a7f782efd379056edf53eb6c May 28 10:06:48.723582 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:48.723539 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" event={"ID":"4ced184b-c565-4d07-92e6-50c8fc00783f","Type":"ContainerStarted","Data":"a064d47a9ea1bcec859ee2f1e8f7aa9f0c7a6d97a7f782efd379056edf53eb6c"} May 28 10:06:49.129392 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:49.129337 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86df7c89f6-x89q9"] May 28 10:06:49.727803 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:06:49.727717 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" event={"ID":"4ced184b-c565-4d07-92e6-50c8fc00783f","Type":"ContainerStarted","Data":"9fa821126ea441332630b4f2aac3b8ed9e4021b92a296d9573bb2ee8ed4e82a8"} May 28 10:07:14.155131 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.155067 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" podUID="fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" containerName="registry" containerID="cri-o://6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a" gracePeriod=30 May 28 10:07:14.391773 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.391748 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:07:14.403177 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403128 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-certificates\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.404333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403402 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-ca-trust-extracted\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.404333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403444 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-installation-pull-secrets\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.404333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403484 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-image-registry-private-configuration\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.404333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403518 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-bound-sa-token\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.404333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403580 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-trusted-ca\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.404333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403628 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x8pf\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-kube-api-access-9x8pf\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.404333 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.403671 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") pod \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\" (UID: \"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d\") " May 28 10:07:14.407580 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.407269 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:07:14.408051 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.408013 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 10:07:14.408165 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.408106 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 10:07:14.410150 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.410118 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:07:14.410150 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.410126 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 10:07:14.410411 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.410255 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-kube-api-access-9x8pf" (OuterVolumeSpecName: "kube-api-access-9x8pf") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "kube-api-access-9x8pf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 10:07:14.410559 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.410516 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 10:07:14.417454 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.417423 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" (UID: "fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 28 10:07:14.418302 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.418252 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-99b6w" podStartSLOduration=95.102184656 podStartE2EDuration="1m36.418235131s" podCreationTimestamp="2026-05-28 10:05:38 +0000 UTC" firstStartedPulling="2026-05-28 10:06:48.047519486 +0000 UTC m=+99.441433893" lastFinishedPulling="2026-05-28 10:06:49.363569946 +0000 UTC m=+100.757484368" observedRunningTime="2026-05-28 10:06:49.755583518 +0000 UTC m=+101.149497948" watchObservedRunningTime="2026-05-28 10:07:14.418235131 +0000 UTC m=+125.812149561" May 28 10:07:14.505163 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505129 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-image-registry-private-configuration\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.505163 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505157 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-bound-sa-token\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.505163 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505167 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-trusted-ca\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.505420 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505176 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x8pf\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-kube-api-access-9x8pf\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.505420 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505186 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-tls\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.505420 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505195 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-registry-certificates\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.505420 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505204 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-ca-trust-extracted\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.505420 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.505213 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d-installation-pull-secrets\") on node \"ip-10-0-129-122.ec2.internal\" DevicePath \"\"" May 28 10:07:14.797840 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.797746 2574 generic.go:358] "Generic (PLEG): container finished" podID="fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" containerID="6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a" exitCode=0 May 28 10:07:14.797840 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.797829 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" event={"ID":"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d","Type":"ContainerDied","Data":"6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a"} May 28 10:07:14.798057 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.797845 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" May 28 10:07:14.798057 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.797871 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86df7c89f6-x89q9" event={"ID":"fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d","Type":"ContainerDied","Data":"3993bd8e2324e5040f4dda6fd56d550fba206a63f866a341ef47907354f5e8c2"} May 28 10:07:14.798057 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.797888 2574 scope.go:117] "RemoveContainer" containerID="6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a" May 28 10:07:14.805660 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.805578 2574 scope.go:117] "RemoveContainer" containerID="6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a" May 28 10:07:14.805929 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:07:14.805905 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a\": container with ID starting with 6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a not found: ID does not exist" containerID="6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a" May 28 10:07:14.806010 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.805936 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a"} err="failed to get container status \"6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a\": rpc error: code = NotFound desc = could not find container \"6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a\": container with ID starting with 6a3accc56786ae4adb11756319c8582ec118feb1bb0a4dc2fbafb9a78282b57a not found: ID does not exist" May 28 10:07:14.819556 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.819526 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86df7c89f6-x89q9"] May 28 10:07:14.825705 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:14.825678 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86df7c89f6-x89q9"] May 28 10:07:15.223251 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:15.223217 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" path="/var/lib/kubelet/pods/fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d/volumes" May 28 10:07:15.802662 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:15.802628 2574 generic.go:358] "Generic (PLEG): container finished" podID="5d729c25-51e6-406c-a8ae-3abdfcd56df3" containerID="ed0564189738a86b401f62b56affd02dd12cf8f2faac24cc78b64e335c99f6fe" exitCode=0 May 28 10:07:15.802835 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:15.802704 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" event={"ID":"5d729c25-51e6-406c-a8ae-3abdfcd56df3","Type":"ContainerDied","Data":"ed0564189738a86b401f62b56affd02dd12cf8f2faac24cc78b64e335c99f6fe"} May 28 10:07:15.803098 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:15.803073 2574 scope.go:117] "RemoveContainer" containerID="ed0564189738a86b401f62b56affd02dd12cf8f2faac24cc78b64e335c99f6fe" May 28 10:07:16.807763 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:16.807726 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-x5n2b" event={"ID":"5d729c25-51e6-406c-a8ae-3abdfcd56df3","Type":"ContainerStarted","Data":"cfaceaf7bd74188519ed2a363bf473b4b3e4c6903df70c5b84903efa7c0a0b08"} May 28 10:07:19.817594 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:19.817556 2574 generic.go:358] "Generic (PLEG): container finished" podID="fa490257-b0d2-42da-9a59-ef02aaf70408" containerID="04ee6bd0f8e07a02c73b3cdc84ce47b556dd13e70ed4ab14949fd35a56dec7d2" exitCode=0 May 28 10:07:19.817972 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:19.817628 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66dzt" event={"ID":"fa490257-b0d2-42da-9a59-ef02aaf70408","Type":"ContainerDied","Data":"04ee6bd0f8e07a02c73b3cdc84ce47b556dd13e70ed4ab14949fd35a56dec7d2"} May 28 10:07:19.818017 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:19.817985 2574 scope.go:117] "RemoveContainer" containerID="04ee6bd0f8e07a02c73b3cdc84ce47b556dd13e70ed4ab14949fd35a56dec7d2" May 28 10:07:20.822413 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:20.822379 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-66dzt" event={"ID":"fa490257-b0d2-42da-9a59-ef02aaf70408","Type":"ContainerStarted","Data":"cafbd7862c886388e8ebb035fddbf679d968a9e417b4c72007143eeb99acf2ad"} May 28 10:07:29.568628 ip-10-0-129-122 kubenswrapper[2574]: E0528 10:07:29.568592 2574 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0012bd_301e_4ec3_ab81_89f4106552d9.slice/crio-conmon-a8f257d220a198d6dd7a645576ae5d249f5336bb3b8a9a80ac3a6cb9ba4ea516.scope\": RecentStats: unable to find data in memory cache]" May 28 10:07:29.851728 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:29.851693 2574 generic.go:358] "Generic (PLEG): container finished" podID="9a0012bd-301e-4ec3-ab81-89f4106552d9" containerID="a8f257d220a198d6dd7a645576ae5d249f5336bb3b8a9a80ac3a6cb9ba4ea516" exitCode=0 May 28 10:07:29.851926 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:29.851775 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" event={"ID":"9a0012bd-301e-4ec3-ab81-89f4106552d9","Type":"ContainerDied","Data":"a8f257d220a198d6dd7a645576ae5d249f5336bb3b8a9a80ac3a6cb9ba4ea516"} May 28 10:07:29.852183 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:29.852168 2574 scope.go:117] "RemoveContainer" containerID="a8f257d220a198d6dd7a645576ae5d249f5336bb3b8a9a80ac3a6cb9ba4ea516" May 28 10:07:30.856049 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:30.856014 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-l7vfs" event={"ID":"9a0012bd-301e-4ec3-ab81-89f4106552d9","Type":"ContainerStarted","Data":"bb5f72fde8ef9760986288ef7b78893ecab92c6e3ca7b676cc671a61f5c4f1b9"} May 28 10:07:34.141299 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:34.141256 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" podUID="886045c0-aeae-41ce-a285-256104554af2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 10:07:44.141548 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:44.141498 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" podUID="886045c0-aeae-41ce-a285-256104554af2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 10:07:54.141049 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:54.141005 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" podUID="886045c0-aeae-41ce-a285-256104554af2" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 10:07:54.141609 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:54.141090 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" May 28 10:07:54.141756 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:54.141734 2574 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"3a64a7e5139937bde77768d98eae632a98dd5e94cc0a4befa193fe68481d76e2"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 28 10:07:54.141818 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:54.141787 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" podUID="886045c0-aeae-41ce-a285-256104554af2" containerName="service-proxy" containerID="cri-o://3a64a7e5139937bde77768d98eae632a98dd5e94cc0a4befa193fe68481d76e2" gracePeriod=30 May 28 10:07:54.928838 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:54.928806 2574 generic.go:358] "Generic (PLEG): container finished" podID="886045c0-aeae-41ce-a285-256104554af2" containerID="3a64a7e5139937bde77768d98eae632a98dd5e94cc0a4befa193fe68481d76e2" exitCode=2 May 28 10:07:54.929011 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:54.928852 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" event={"ID":"886045c0-aeae-41ce-a285-256104554af2","Type":"ContainerDied","Data":"3a64a7e5139937bde77768d98eae632a98dd5e94cc0a4befa193fe68481d76e2"} May 28 10:07:54.929011 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:07:54.928881 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-56cf6c7994-hptxj" event={"ID":"886045c0-aeae-41ce-a285-256104554af2","Type":"ContainerStarted","Data":"14caca7b1f1d418eeb345efc330effd96734d2247d798ec6d600cfdca35bed6e"} May 28 10:10:09.106283 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:10:09.106257 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:10:09.106283 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:10:09.106278 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:10:09.110179 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:10:09.110157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:10:09.110564 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:10:09.110535 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:10:09.117277 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:10:09.117258 2574 kubelet.go:1628] "Image garbage collection succeeded" May 28 10:15:09.129714 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:15:09.129685 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:15:09.130203 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:15:09.129733 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:15:09.133388 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:15:09.133367 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:15:09.133535 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:15:09.133426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:20:09.153339 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:20:09.153262 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:20:09.155061 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:20:09.155035 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:20:09.157432 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:20:09.157413 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:20:09.158884 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:20:09.158868 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:25:09.173397 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:25:09.173364 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:25:09.176166 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:25:09.176145 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:25:09.177206 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:25:09.177187 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:25:09.179868 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:25:09.179852 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:30:09.192927 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:30:09.192895 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:30:09.196166 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:30:09.196140 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:30:09.196783 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:30:09.196763 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:30:09.200025 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:30:09.200005 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:33:48.007936 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:48.007902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zp9wj_cc5e55c3-76e3-4b60-b420-4aba7dfa5b05/global-pull-secret-syncer/0.log" May 28 10:33:48.125843 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:48.125812 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r5779_c4e90b26-34d3-4346-b558-56463479d55a/konnectivity-agent/0.log" May 28 10:33:48.176041 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:48.176018 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-122.ec2.internal_6b6b11312e540b2a6a3f55a82df78564/haproxy/0.log" May 28 10:33:51.303098 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:51.303059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-z2hfh_b12b4cf2-be9a-4b6e-bb09-6377fcb01b80/cluster-monitoring-operator/0.log" May 28 10:33:51.787168 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:51.787132 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzbjp_bae44f50-72a9-4eeb-94e9-a6c2cd895abd/node-exporter/0.log" May 28 10:33:51.834419 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:51.834390 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzbjp_bae44f50-72a9-4eeb-94e9-a6c2cd895abd/kube-rbac-proxy/0.log" May 28 10:33:51.874483 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:51.874454 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzbjp_bae44f50-72a9-4eeb-94e9-a6c2cd895abd/init-textfile/0.log" May 28 10:33:53.864369 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.864314 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd"] May 28 10:33:53.864820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.864721 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" containerName="registry" May 28 10:33:53.864820 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.864738 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" containerName="registry" May 28 10:33:53.864927 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.864830 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcd27a0d-5cdd-4230-8e6e-2a9e8b51da3d" containerName="registry" May 28 10:33:53.866727 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.866702 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.869313 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.869288 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sg2z8\"/\"openshift-service-ca.crt\"" May 28 10:33:53.870463 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.870446 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sg2z8\"/\"default-dockercfg-vq5rc\"" May 28 10:33:53.870561 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.870504 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sg2z8\"/\"kube-root-ca.crt\"" May 28 10:33:53.876413 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.876386 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd"] May 28 10:33:53.887861 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.887814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-podres\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.887861 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.887862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-proc\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.888142 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.887902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-lib-modules\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.888142 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.887953 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjgmj\" (UniqueName: \"kubernetes.io/projected/7626ef39-5954-4b53-8dd3-a3a51906912d-kube-api-access-gjgmj\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.888142 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.887993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-sys\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.983280 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.983255 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-99b6w_4ced184b-c565-4d07-92e6-50c8fc00783f/networking-console-plugin/0.log" May 28 10:33:53.988343 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988321 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-podres\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988484 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988379 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-proc\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988484 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988424 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-lib-modules\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988484 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988448 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-proc\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988581 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988483 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjgmj\" (UniqueName: \"kubernetes.io/projected/7626ef39-5954-4b53-8dd3-a3a51906912d-kube-api-access-gjgmj\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988581 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-podres\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988581 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988536 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-sys\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988581 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988574 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-lib-modules\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.988699 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.988618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7626ef39-5954-4b53-8dd3-a3a51906912d-sys\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:53.997293 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:53.997271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjgmj\" (UniqueName: \"kubernetes.io/projected/7626ef39-5954-4b53-8dd3-a3a51906912d-kube-api-access-gjgmj\") pod \"perf-node-gather-daemonset-422sd\" (UID: \"7626ef39-5954-4b53-8dd3-a3a51906912d\") " pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:54.177513 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:54.177419 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:54.305848 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:54.305808 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd"] May 28 10:33:54.308901 ip-10-0-129-122 kubenswrapper[2574]: W0528 10:33:54.308871 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7626ef39_5954_4b53_8dd3_a3a51906912d.slice/crio-250e69c019549d23c27677c46149fd197035f604c603c54f4f6d9c61fd3e0e3f WatchSource:0}: Error finding container 250e69c019549d23c27677c46149fd197035f604c603c54f4f6d9c61fd3e0e3f: Status 404 returned error can't find the container with id 250e69c019549d23c27677c46149fd197035f604c603c54f4f6d9c61fd3e0e3f May 28 10:33:54.310790 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:54.310773 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 10:33:54.375779 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:54.375750 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/1.log" May 28 10:33:54.380328 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:54.380310 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-hlmjq_d7d468ee-468e-4af6-8efe-b754ed40fb58/console-operator/2.log" May 28 10:33:55.159661 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:55.159633 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-dp6lc_6d818a86-d3a3-4d52-ae21-c869e1a01974/volume-data-source-validator/0.log" May 28 10:33:55.257343 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:55.257312 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" event={"ID":"7626ef39-5954-4b53-8dd3-a3a51906912d","Type":"ContainerStarted","Data":"8930cc79a72894241c10d1233eb1aea766be659dd84b8b1d18446563f54e6918"} May 28 10:33:55.257343 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:55.257345 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" event={"ID":"7626ef39-5954-4b53-8dd3-a3a51906912d","Type":"ContainerStarted","Data":"250e69c019549d23c27677c46149fd197035f604c603c54f4f6d9c61fd3e0e3f"} May 28 10:33:55.257559 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:55.257386 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:33:55.278699 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:55.278654 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" podStartSLOduration=2.278639892 podStartE2EDuration="2.278639892s" podCreationTimestamp="2026-05-28 10:33:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:33:55.276447757 +0000 UTC m=+1726.670362187" watchObservedRunningTime="2026-05-28 10:33:55.278639892 +0000 UTC m=+1726.672554320" May 28 10:33:55.828909 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:55.828881 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-82p76_97a1aea0-2d88-4672-8e97-7ab84fde6123/dns/0.log" May 28 10:33:55.852431 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:55.852406 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-82p76_97a1aea0-2d88-4672-8e97-7ab84fde6123/kube-rbac-proxy/0.log" May 28 10:33:56.021418 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:56.021385 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4tvk_37ac2621-2c47-4fee-9727-b5048e01525e/dns-node-resolver/0.log" May 28 10:33:56.525297 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:56.525270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pjshq_823c98f1-5b1d-432d-85f6-19211847784a/node-ca/0.log" May 28 10:33:57.295068 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:57.295041 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7996fdddb8-6vlrw_26c4ae9d-c163-4e59-91c9-b81ba132435c/router/0.log" May 28 10:33:57.685632 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:57.685602 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p242v_8b0c85eb-53d5-4057-bb60-07537fa1b99f/serve-healthcheck-canary/0.log" May 28 10:33:58.063385 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:58.063339 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-66dzt_fa490257-b0d2-42da-9a59-ef02aaf70408/insights-operator/0.log" May 28 10:33:58.063768 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:58.063741 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-66dzt_fa490257-b0d2-42da-9a59-ef02aaf70408/insights-operator/1.log" May 28 10:33:58.333799 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:58.333709 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgnjq_94e6ee06-f3d3-4b34-a25a-312f00b3b623/kube-rbac-proxy/0.log" May 28 10:33:58.357933 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:58.357908 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgnjq_94e6ee06-f3d3-4b34-a25a-312f00b3b623/exporter/0.log" May 28 10:33:58.383288 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:33:58.383264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgnjq_94e6ee06-f3d3-4b34-a25a-312f00b3b623/extractor/0.log" May 28 10:34:01.270249 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:01.270225 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sg2z8/perf-node-gather-daemonset-422sd" May 28 10:34:03.230455 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:03.230426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-x5n2b_5d729c25-51e6-406c-a8ae-3abdfcd56df3/kube-storage-version-migrator-operator/1.log" May 28 10:34:03.231246 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:03.231220 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-x5n2b_5d729c25-51e6-406c-a8ae-3abdfcd56df3/kube-storage-version-migrator-operator/0.log" May 28 10:34:04.134408 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.134382 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8t8f5_5f10ee62-3f01-4307-b4f4-48dd4d74c481/kube-multus/0.log" May 28 10:34:04.584469 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.584436 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g66c4_e425d125-7648-4342-832d-6944cae7c342/kube-multus-additional-cni-plugins/0.log" May 28 10:34:04.615890 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.615868 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g66c4_e425d125-7648-4342-832d-6944cae7c342/egress-router-binary-copy/0.log" May 28 10:34:04.645852 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.645823 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g66c4_e425d125-7648-4342-832d-6944cae7c342/cni-plugins/0.log" May 28 10:34:04.685682 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.685657 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g66c4_e425d125-7648-4342-832d-6944cae7c342/bond-cni-plugin/0.log" May 28 10:34:04.719886 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.719816 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g66c4_e425d125-7648-4342-832d-6944cae7c342/routeoverride-cni/0.log" May 28 10:34:04.751837 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.751815 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g66c4_e425d125-7648-4342-832d-6944cae7c342/whereabouts-cni-bincopy/0.log" May 28 10:34:04.785957 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.785938 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g66c4_e425d125-7648-4342-832d-6944cae7c342/whereabouts-cni/0.log" May 28 10:34:04.920461 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.920434 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9g65s_38ea32a3-cbf1-45ea-a0bc-0b852e4519e2/network-metrics-daemon/0.log" May 28 10:34:04.962335 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:04.962303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9g65s_38ea32a3-cbf1-45ea-a0bc-0b852e4519e2/kube-rbac-proxy/0.log" May 28 10:34:05.838942 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:05.838901 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-controller/0.log" May 28 10:34:05.873653 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:05.873618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/0.log" May 28 10:34:05.881246 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:05.881219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovn-acl-logging/1.log" May 28 10:34:05.902153 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:05.902120 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/kube-rbac-proxy-node/0.log" May 28 10:34:05.931342 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:05.931315 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/kube-rbac-proxy-ovn-metrics/0.log" May 28 10:34:05.953343 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:05.953319 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/northd/0.log" May 28 10:34:05.975712 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:05.975683 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/nbdb/0.log" May 28 10:34:06.001582 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:06.001557 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/sbdb/0.log" May 28 10:34:06.091070 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:06.090986 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lzsn_208fa309-7b52-4eb6-b36b-1b90ac0683b7/ovnkube-controller/0.log" May 28 10:34:07.744388 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:07.744361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-dzkx4_37134723-cd3c-4e6c-bf14-47af5a5435b4/check-endpoints/0.log" May 28 10:34:07.829019 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:07.828993 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vvh92_1240213a-e967-4c0e-abae-8d73a605540d/network-check-target-container/0.log" May 28 10:34:08.770460 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:08.770433 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-d5rd2_b5286f16-f39d-4a8e-8b15-0bdd7109ef06/iptables-alerter/0.log" May 28 10:34:09.496040 ip-10-0-129-122 kubenswrapper[2574]: I0528 10:34:09.496012 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sdfsm_d62f48b2-7563-4c0f-8cb7-ee8e2c4ceda0/tuned/0.log"