Jun 12 16:37:58.740790 ip-10-0-128-123 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 16:37:58.740800 ip-10-0-128-123 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 16:37:58.740808 ip-10-0-128-123 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 16:37:58.741041 ip-10-0-128-123 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 16:38:08.907411 ip-10-0-128-123 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 16:38:08.907429 ip-10-0-128-123 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5c136839c9b14d2faf39f7cab783bfca -- Jun 12 16:40:22.987311 ip-10-0-128-123 systemd[1]: Starting Kubernetes Kubelet... Jun 12 16:40:23.410461 ip-10-0-128-123 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 16:40:23.410461 ip-10-0-128-123 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 16:40:23.410461 ip-10-0-128-123 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 16:40:23.410461 ip-10-0-128-123 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 16:40:23.410461 ip-10-0-128-123 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 16:40:23.412479 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.412387 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 16:40:23.420908 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420881 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 16:40:23.420908 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420904 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 16:40:23.420908 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420909 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 16:40:23.420908 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420913 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 16:40:23.420908 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420916 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420919 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420923 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420926 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420929 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420932 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420934 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420937 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420939 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420942 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420945 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420948 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420950 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420953 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420956 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420959 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420961 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420964 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420966 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420969 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 16:40:23.421149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420971 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420977 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420980 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420982 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420985 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.420987 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421013 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421017 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421020 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421023 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421025 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421028 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421031 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421033 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421036 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421039 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421042 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421044 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421048 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421051 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 16:40:23.421627 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421053 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421056 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421059 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421062 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421064 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421067 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421070 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421072 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421075 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421077 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421080 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421082 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421085 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421088 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421090 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421094 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421098 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421101 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421103 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 16:40:23.422118 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421106 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421109 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421111 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421113 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421116 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421125 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421130 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421134 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421136 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421139 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421142 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421144 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421147 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421149 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421153 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421156 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421158 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421161 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421164 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421166 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 16:40:23.422574 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421170 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421172 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421175 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421178 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421181 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421184 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421186 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421189 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421191 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421194 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421198 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421201 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421204 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421207 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421210 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421213 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421940 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421946 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421950 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421954 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 16:40:23.423056 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421957 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421960 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421962 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421965 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421968 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421971 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421973 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421976 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421978 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421981 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421983 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.421986 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422005 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422009 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422012 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422015 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422018 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422021 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422024 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 16:40:23.423535 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422027 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422029 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422032 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422034 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422037 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422039 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422042 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422045 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422047 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422050 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422052 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422055 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422058 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422061 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422064 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422067 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422069 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422072 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422074 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422077 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 16:40:23.424016 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422079 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422082 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422084 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422087 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422089 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422092 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422094 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422098 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422101 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422103 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422106 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422108 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422110 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422115 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422120 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422124 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422127 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422130 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422133 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 16:40:23.424502 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422136 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422139 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422142 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422145 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422148 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422151 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422153 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422156 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422159 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422161 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422164 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422167 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422170 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422174 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422176 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422179 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422182 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422184 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422187 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 16:40:23.424962 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422190 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422193 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422196 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422199 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422202 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422204 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422207 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422209 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422212 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422214 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422217 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422219 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422222 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422225 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422227 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422231 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422235 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422238 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422649 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422655 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 16:40:23.425454 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422658 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422662 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422666 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422669 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422672 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422676 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422679 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422682 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422685 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422688 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422691 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422693 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422697 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422701 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422704 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422707 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422709 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422712 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422715 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422717 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 16:40:23.425939 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422721 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422723 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422726 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422728 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422731 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422734 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422737 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422739 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422742 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422745 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422747 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422750 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422752 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422755 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422757 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422760 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422762 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422765 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422768 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422770 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 16:40:23.426468 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422773 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422775 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422779 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422781 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422784 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422786 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422788 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422793 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422796 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422799 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422801 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422803 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422806 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422808 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422811 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422813 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422815 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422821 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422823 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422826 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 16:40:23.426949 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422828 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422831 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422833 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422836 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422838 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422841 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422844 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422846 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422848 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422851 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422854 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422856 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422860 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422863 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422866 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422869 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422871 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422874 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422877 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 16:40:23.427544 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422879 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422882 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422885 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422887 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422890 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422892 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422894 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422897 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422899 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422902 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422906 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422908 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422911 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422914 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422916 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422919 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422921 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.422923 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423018 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423033 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423039 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 16:40:23.428063 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423044 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423048 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423052 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423056 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423061 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423064 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423067 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423071 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423074 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423077 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423080 2581 flags.go:64] FLAG: --cgroup-root="" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423082 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423085 2581 flags.go:64] FLAG: --client-ca-file="" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423089 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423092 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423097 2581 flags.go:64] FLAG: --cluster-domain="" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423100 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423103 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423106 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423109 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423113 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423117 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423120 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 16:40:23.428566 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423124 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423127 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423130 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423132 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423136 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423139 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423142 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423145 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423148 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423153 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423156 2581 flags.go:64] FLAG: --enable-server="true" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423159 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423163 2581 flags.go:64] FLAG: --event-burst="100" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423166 2581 flags.go:64] FLAG: --event-qps="50" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423169 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423172 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423175 2581 flags.go:64] FLAG: --eviction-hard="" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423179 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423181 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423184 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423187 2581 flags.go:64] FLAG: --eviction-soft="" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423190 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423193 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423197 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423200 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 16:40:23.429130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423203 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423206 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423208 2581 flags.go:64] FLAG: --feature-gates="" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423212 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423215 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423219 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423222 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423225 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423228 2581 flags.go:64] FLAG: --help="false" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423231 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423234 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423237 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423240 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423243 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423246 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423249 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423253 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423256 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423259 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423261 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423264 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423267 2581 flags.go:64] FLAG: --kube-reserved="" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423270 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423273 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 16:40:23.429777 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423276 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423278 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423281 2581 flags.go:64] FLAG: --lock-file="" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423284 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423287 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423290 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423295 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423298 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423301 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423304 2581 flags.go:64] FLAG: --logging-format="text" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423307 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423310 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423312 2581 flags.go:64] FLAG: --manifest-url="" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423317 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423321 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423324 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423328 2581 flags.go:64] FLAG: --max-pods="110" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423331 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423334 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423336 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423339 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423342 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423345 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423348 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423361 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 16:40:23.430410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423364 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423367 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423370 2581 flags.go:64] FLAG: --pod-cidr="" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423372 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423378 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423381 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423384 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423387 2581 flags.go:64] FLAG: --port="10250" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423390 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423393 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-069293249ee48b006" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423396 2581 flags.go:64] FLAG: --qos-reserved="" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423399 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423402 2581 flags.go:64] FLAG: --register-node="true" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423405 2581 flags.go:64] FLAG: --register-with-taints="" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423408 2581 flags.go:64] FLAG: --registry-burst="10" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423412 2581 flags.go:64] FLAG: --registry-qps="5" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423414 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423417 2581 flags.go:64] FLAG: --reserved-memory="" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423421 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423424 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423427 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423432 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423434 2581 flags.go:64] FLAG: --runonce="false" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423437 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423440 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 16:40:23.431051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423443 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423446 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423449 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423452 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423455 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423458 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423463 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423465 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423468 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423471 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423474 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423477 2581 flags.go:64] FLAG: --system-cgroups="" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423480 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423485 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423488 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423491 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423496 2581 flags.go:64] FLAG: --tls-min-version="" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423498 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423501 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423504 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423507 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423510 2581 flags.go:64] FLAG: --v="2" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423514 2581 flags.go:64] FLAG: --version="false" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423519 2581 flags.go:64] FLAG: --vmodule="" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423522 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 16:40:23.431670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423525 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423647 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423651 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423655 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423658 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423661 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423663 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423667 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423671 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423674 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423677 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423680 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423683 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423687 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423689 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423692 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423694 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423697 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423700 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423702 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 16:40:23.432275 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423705 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423707 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423709 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423712 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423714 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423717 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423719 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423722 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423725 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423727 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423729 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423732 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423735 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423737 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423740 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423744 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423746 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423749 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423751 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423754 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 16:40:23.432799 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423756 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423759 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423762 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423764 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423767 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423771 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423773 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423776 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423778 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423781 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423783 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423786 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423788 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423790 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423793 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423795 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423798 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423800 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423803 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423806 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 16:40:23.433353 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423808 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423811 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423813 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423816 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423819 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423822 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423824 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423828 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423831 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423833 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423836 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423838 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423842 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423846 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423849 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423853 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423856 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423861 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423864 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423867 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 16:40:23.433837 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423869 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423872 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423874 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423877 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423880 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423883 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423885 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423888 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423890 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423893 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423895 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423898 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423900 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423903 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423905 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423908 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423910 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423913 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423916 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 16:40:23.434340 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.423920 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.423925 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.431421 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.431437 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.431452 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.431461 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431518 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431523 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431526 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431529 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431532 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431535 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431538 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431541 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431544 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 16:40:23.434835 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431547 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431549 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431552 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431554 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431557 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431560 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431562 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431565 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431567 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431570 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431573 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431575 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431578 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431580 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431583 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431585 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431588 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431591 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431593 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431597 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 16:40:23.435245 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431601 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431604 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431608 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431612 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431615 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431618 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431620 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431623 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431626 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431629 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431632 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431634 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431637 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431639 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431642 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431644 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431646 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431649 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431651 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 16:40:23.435730 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431654 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431657 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431660 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431662 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431665 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431667 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431670 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431672 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431675 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431677 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431680 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431683 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431685 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431688 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431691 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431694 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431697 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431700 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431702 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431705 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 16:40:23.436231 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431707 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431710 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431712 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431715 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431717 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431720 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431722 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431724 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431727 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431730 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431732 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431735 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431737 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431740 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431742 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431746 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431749 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431752 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431754 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431757 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 16:40:23.436726 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431759 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431762 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431765 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431768 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431770 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431773 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431776 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431779 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431781 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431784 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431786 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.431791 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431901 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431905 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 16:40:23.437370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431908 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431911 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431914 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431917 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431920 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431923 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431926 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431929 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431931 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431934 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431937 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431940 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431942 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431945 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431947 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431950 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431953 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431955 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431958 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431960 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 16:40:23.437716 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431962 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431965 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431968 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431970 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431973 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431975 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431978 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431981 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431983 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.431986 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432004 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432010 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432013 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432016 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432019 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432022 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432024 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432027 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432029 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 16:40:23.438210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432032 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432034 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432037 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432039 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432042 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432044 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432047 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432050 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432052 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432054 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432057 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432059 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432062 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432064 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432067 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432069 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432072 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432074 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432077 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 16:40:23.438670 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432080 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432083 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432086 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432088 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432090 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432095 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432098 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432101 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432104 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432106 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432109 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432111 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432114 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432116 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432118 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432121 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432124 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432126 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432129 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 16:40:23.439139 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432131 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432133 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432136 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432138 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432141 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432143 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432146 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432148 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432151 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432153 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432156 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432158 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432161 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432164 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432168 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432175 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432178 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432180 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432183 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 16:40:23.439592 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:23.432185 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 16:40:23.440076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.432190 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 16:40:23.440076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.432299 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 16:40:23.440076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.434636 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 16:40:23.440076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.436367 2581 server.go:1019] "Starting client certificate rotation" Jun 12 16:40:23.440076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.436467 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 16:40:23.440076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.437326 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 16:40:23.440076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.440048 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 16:40:23.450296 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.450273 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 16:40:23.460489 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.460467 2581 log.go:25] "Validated CRI v1 runtime API" Jun 12 16:40:23.464282 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.464269 2581 log.go:25] "Validated CRI v1 image API" Jun 12 16:40:23.465146 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.465131 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 16:40:23.467784 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.467765 2581 fs.go:135] Filesystem UUIDs: map[73566b4d-32c6-4a3b-929c-38c06948de97:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f49f5751-c49b-4d87-909d-23d138dd7dcd:/dev/nvme0n1p4] Jun 12 16:40:23.467854 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.467784 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 16:40:23.472382 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.472364 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 16:40:23.473114 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.473008 2581 manager.go:216] Machine: {Timestamp:2026-06-12 16:40:23.471563889 +0000 UTC m=+0.379217775 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104647 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29df7256c0cbbff48990e6eb99dc31 SystemUUID:ec29df72-56c0-cbbf-f489-90e6eb99dc31 BootID:5c136839-c9b1-4d2f-af39-f7cab783bfca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:54:80:66:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:54:80:66:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:cf:98:c2:15:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 16:40:23.473114 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.473112 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 16:40:23.473249 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.473238 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 16:40:23.476864 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.476836 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 16:40:23.477021 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.476869 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 16:40:23.478607 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.478586 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 16:40:23.478607 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.478610 2581 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 16:40:23.478681 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.478618 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 16:40:23.479438 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.479428 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 16:40:23.481232 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.481221 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 16:40:23.485923 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.485911 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 12 16:40:23.486237 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486227 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 16:40:23.486274 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486263 2581 kubelet.go:486] "Attempting to sync node with API server" Jun 12 16:40:23.486302 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486286 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 16:40:23.486329 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486304 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 16:40:23.486329 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486317 2581 kubelet.go:398] "Adding apiserver pod source" Jun 12 16:40:23.486329 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486327 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 16:40:23.486697 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486685 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 16:40:23.486745 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.486703 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 16:40:23.489457 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.489440 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 16:40:23.491199 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491186 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 16:40:23.491236 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491217 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 16:40:23.491410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491393 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 16:40:23.491446 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491428 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 16:40:23.491477 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491446 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 16:40:23.491477 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491461 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 16:40:23.491534 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491483 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 16:40:23.491534 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.491496 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 16:40:23.492073 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492064 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 16:40:23.492107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492074 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 16:40:23.492107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492082 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 16:40:23.492107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492088 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 16:40:23.492107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492103 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 16:40:23.492210 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492112 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 16:40:23.492210 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492137 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 16:40:23.492210 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.492146 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 16:40:23.495497 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.495481 2581 server.go:1268] "Started kubelet" Jun 12 16:40:23.495964 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.495574 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 16:40:23.495964 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.495756 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 16:40:23.496263 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.496120 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 16:40:23.496501 ip-10-0-128-123 systemd[1]: Started Kubernetes Kubelet. Jun 12 16:40:23.500178 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.500155 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 16:40:23.501725 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.501706 2581 server.go:310] "Adding debug handlers to kubelet server" Jun 12 16:40:23.504437 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.504400 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 16:40:23.505452 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.505434 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 16:40:23.505521 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.505479 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 16:40:23.505576 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.505559 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 16:40:23.506570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.506550 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 16:40:23.506668 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.505436 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-123.ec2.internal.18b862ed3117e31d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-123.ec2.internal,UID:ip-10-0-128-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-123.ec2.internal,},FirstTimestamp:2026-06-12 16:40:23.495451421 +0000 UTC m=+0.403105287,LastTimestamp:2026-06-12 16:40:23.495451421 +0000 UTC m=+0.403105287,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-123.ec2.internal,}" Jun 12 16:40:23.506668 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.506557 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 16:40:23.506816 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.506688 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:23.507410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.507388 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 16:40:23.507410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.507389 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 16:40:23.507549 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.507419 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 16:40:23.507549 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.507507 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 12 16:40:23.507549 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.507518 2581 reconciler.go:29] "Reconciler: start to sync state" Jun 12 16:40:23.508659 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.508645 2581 factory.go:55] Registering systemd factory Jun 12 16:40:23.508741 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.508662 2581 factory.go:223] Registration of the systemd container factory successfully Jun 12 16:40:23.508879 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.508864 2581 factory.go:153] Registering CRI-O factory Jun 12 16:40:23.508942 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.508883 2581 factory.go:223] Registration of the crio container factory successfully Jun 12 16:40:23.508974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.508954 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 16:40:23.509044 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.508973 2581 factory.go:103] Registering Raw factory Jun 12 16:40:23.509044 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.508985 2581 manager.go:1196] Started watching for new ooms in manager Jun 12 16:40:23.509476 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.509461 2581 manager.go:349] Starting recovery of all containers Jun 12 16:40:23.509476 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.509466 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 16:40:23.512820 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.512763 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 16:40:23.516404 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.516368 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 16:40:23.521369 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.521353 2581 manager.go:354] Recovery completed Jun 12 16:40:23.525872 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.525861 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:23.527582 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.527562 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:23.527647 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.527604 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:23.527647 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.527618 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:23.528209 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.528194 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 16:40:23.528209 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.528207 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 16:40:23.528332 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.528222 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 12 16:40:23.528332 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.528259 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:23.529051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.529036 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:23.529130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.529065 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:23.529130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.529076 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:23.530116 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.530049 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-123.ec2.internal.18b862ed33022ef3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-123.ec2.internal,UID:ip-10-0-128-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-123.ec2.internal,},FirstTimestamp:2026-06-12 16:40:23.527583475 +0000 UTC m=+0.435237343,LastTimestamp:2026-06-12 16:40:23.527583475 +0000 UTC m=+0.435237343,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-123.ec2.internal,}" Jun 12 16:40:23.530457 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.530444 2581 policy_none.go:49] "None policy: Start" Jun 12 16:40:23.530509 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.530463 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 16:40:23.530509 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.530477 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 16:40:23.532410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.532399 2581 policy_none.go:47] "Start" Jun 12 16:40:23.535701 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.535677 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6slsw" Jun 12 16:40:23.542163 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.542085 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-123.ec2.internal.18b862ed33029d35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-123.ec2.internal,UID:ip-10-0-128-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-123.ec2.internal,},FirstTimestamp:2026-06-12 16:40:23.527611701 +0000 UTC m=+0.435265567,LastTimestamp:2026-06-12 16:40:23.527611701 +0000 UTC m=+0.435265567,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-123.ec2.internal,}" Jun 12 16:40:23.547466 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.547446 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6slsw" Jun 12 16:40:23.568596 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.568579 2581 manager.go:337] "Starting Device Plugin manager" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.568611 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.568621 2581 server.go:87] "Starting device plugin registration server" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.568891 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.568903 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.569023 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.569109 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.569117 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.569677 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.569720 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.576738 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.576771 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.576789 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.576818 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 16:40:23.592046 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.579688 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 16:40:23.669916 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.669832 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:23.671120 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.671100 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:23.671231 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.671132 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:23.671231 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.671143 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:23.671231 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.671166 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.677789 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.677767 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal"] Jun 12 16:40:23.677892 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.677843 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:23.678672 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.678657 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:23.678755 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.678681 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:23.678755 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.678691 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:23.680657 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.680640 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.680746 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.680664 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-123.ec2.internal\": node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:23.681075 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681063 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:23.681198 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.681245 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681212 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:23.681856 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681841 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:23.681927 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681860 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:23.681927 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681868 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:23.681927 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681900 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:23.681927 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681917 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:23.682097 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.681930 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:23.684296 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.684273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.684374 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.684306 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:23.685117 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.685100 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:23.685204 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.685134 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:23.685204 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.685145 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:23.701137 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.701110 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:23.716662 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.716641 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-123.ec2.internal\" not found" node="ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.721114 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.721099 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-123.ec2.internal\" not found" node="ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.801984 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.801942 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:23.808818 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.808766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45572964cd7696b48b0469a3fb46e9c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"45572964cd7696b48b0469a3fb46e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.808880 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.808823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45572964cd7696b48b0469a3fb46e9c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"45572964cd7696b48b0469a3fb46e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.808880 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.808854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ae03d5083e42c17555e461b06baba72d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-123.ec2.internal\" (UID: \"ae03d5083e42c17555e461b06baba72d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.902444 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:23.902410 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:23.909297 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.909214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ae03d5083e42c17555e461b06baba72d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-123.ec2.internal\" (UID: \"ae03d5083e42c17555e461b06baba72d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.909367 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.909331 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45572964cd7696b48b0469a3fb46e9c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"45572964cd7696b48b0469a3fb46e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.909367 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.909350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45572964cd7696b48b0469a3fb46e9c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"45572964cd7696b48b0469a3fb46e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.909367 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.909281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ae03d5083e42c17555e461b06baba72d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-123.ec2.internal\" (UID: \"ae03d5083e42c17555e461b06baba72d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.909479 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.909390 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45572964cd7696b48b0469a3fb46e9c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"45572964cd7696b48b0469a3fb46e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:23.909479 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:23.909411 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45572964cd7696b48b0469a3fb46e9c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal\" (UID: \"45572964cd7696b48b0469a3fb46e9c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:24.003063 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:24.003029 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:24.019556 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.019529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:24.025819 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.025800 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 12 16:40:24.103197 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:24.103148 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:24.203771 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:24.203735 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:24.304249 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:24.304188 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:24.404816 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:24.404783 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:24.435257 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.435231 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 16:40:24.435828 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.435381 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 16:40:24.505727 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:24.505696 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:24.548513 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.548482 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 16:40:24.549678 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.549657 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientMemory" Jun 12 16:40:24.549787 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.549687 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 16:40:24.549787 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.549705 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeHasSufficientPID" Jun 12 16:40:24.553907 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.553880 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 16:35:23 +0000 UTC" deadline="2027-11-24 21:36:44.692197911 +0000 UTC" Jun 12 16:40:24.553907 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.553906 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12724h56m20.138295185s" Jun 12 16:40:24.606682 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:24.606660 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-123.ec2.internal\" not found" Jun 12 16:40:24.613289 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:24.613247 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45572964cd7696b48b0469a3fb46e9c3.slice/crio-9b1440bfcfef35322ca34ea90146540bcdfa5805c5f76ba567fd3d37e66eff45 WatchSource:0}: Error finding container 9b1440bfcfef35322ca34ea90146540bcdfa5805c5f76ba567fd3d37e66eff45: Status 404 returned error can't find the container with id 9b1440bfcfef35322ca34ea90146540bcdfa5805c5f76ba567fd3d37e66eff45 Jun 12 16:40:24.613870 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:24.613851 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae03d5083e42c17555e461b06baba72d.slice/crio-14d24ae3e2038ebd6ee7bf3b19973773dbe952eca5726706a6c24de3c27e2173 WatchSource:0}: Error finding container 14d24ae3e2038ebd6ee7bf3b19973773dbe952eca5726706a6c24de3c27e2173: Status 404 returned error can't find the container with id 14d24ae3e2038ebd6ee7bf3b19973773dbe952eca5726706a6c24de3c27e2173 Jun 12 16:40:24.619018 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.618979 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 16:40:24.681385 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.681360 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 16:40:24.707735 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.707707 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" Jun 12 16:40:24.719971 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.719946 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 16:40:24.722009 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.721982 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" Jun 12 16:40:24.729130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.729109 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 16:40:24.826413 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.826392 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 16:40:24.917541 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:24.917467 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 16:40:25.366314 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.366279 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 16:40:25.487615 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.487584 2581 apiserver.go:52] "Watching apiserver" Jun 12 16:40:25.496625 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.496595 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 16:40:25.496953 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.496920 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d","openshift-dns/node-resolver-kcmt4","openshift-multus/multus-additional-cni-plugins-7rh8n","openshift-multus/multus-g6k6k","openshift-multus/network-metrics-daemon-6xxnl","openshift-network-diagnostics/network-check-target-rxzhf","kube-system/global-pull-secret-syncer-2pzsz","kube-system/konnectivity-agent-55zpk","kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vblqc","openshift-image-registry/node-ca-8zx6d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal","openshift-network-operator/iptables-alerter-dcf6t","openshift-ovn-kubernetes/ovnkube-node-fnx24"] Jun 12 16:40:25.499432 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.499414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.499533 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.499479 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:25.501607 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.501589 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.503786 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.503768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.504271 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.504244 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 16:40:25.504368 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.504332 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lvrd8\"" Jun 12 16:40:25.504425 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.504404 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 16:40:25.504494 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.504477 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 16:40:25.505892 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.505875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.506180 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.506163 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 16:40:25.506331 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.506308 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 16:40:25.506578 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.506561 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v92h2\"" Jun 12 16:40:25.506673 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.506594 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 16:40:25.506921 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.506896 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 16:40:25.507012 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.506983 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 16:40:25.508009 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.507974 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 16:40:25.508095 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.508072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:25.508621 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.508151 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:25.508621 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.508435 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-92dck\"" Jun 12 16:40:25.508621 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.508506 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 16:40:25.510227 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.510210 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:25.510303 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.510266 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:25.512675 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.512657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.515052 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.515034 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.515653 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.515631 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 16:40:25.515653 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.515645 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 16:40:25.515787 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.515653 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 16:40:25.515787 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.515707 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 16:40:25.515787 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.515721 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 16:40:25.516247 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.516234 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 16:40:25.516313 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.516236 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkxzr\"" Jun 12 16:40:25.517628 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.517520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.517701 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.517684 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518061 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-etc-kubernetes\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm5sg\" (UniqueName: \"kubernetes.io/projected/197c065b-4015-44eb-b755-4ea3ef1699a9-kube-api-access-dm5sg\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518161 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518164 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-snl6x\"" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-cnibin\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-cni-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-kubelet\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-os-release\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-system-cni-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/197c065b-4015-44eb-b755-4ea3ef1699a9-cni-binary-copy\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-daemon-config\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-multus-certs\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.518506 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-cni-bin\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2l9k\" (UniqueName: \"kubernetes.io/projected/03f380ca-e643-4b86-b4e3-12a5594247d3-kube-api-access-n2l9k\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3791ad77-0aed-408a-89ed-a52849f73523-kubelet-config\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/448c9b26-7d4f-4c0a-be83-0c494f22390d-iptables-alerter-script\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/448c9b26-7d4f-4c0a-be83-0c494f22390d-host-slash\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-system-cni-dir\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-cnibin\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-k8s-cni-cncf-io\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-hostroot\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518782 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtw7\" (UniqueName: \"kubernetes.io/projected/448c9b26-7d4f-4c0a-be83-0c494f22390d-kube-api-access-fqtw7\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-os-release\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-conf-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.518978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-cni-multus\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.519019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3791ad77-0aed-408a-89ed-a52849f73523-dbus\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.519721 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.519035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.519721 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.519049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htxgh\" (UniqueName: \"kubernetes.io/projected/1c4629f7-7da1-472d-a049-956ac377d391-kube-api-access-htxgh\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.519721 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.519063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-socket-dir-parent\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.519721 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.519079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-netns\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.520318 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.520294 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 16:40:25.520318 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.520312 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 16:40:25.520471 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.520387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ndc7f\"" Jun 12 16:40:25.520607 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.520590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.523083 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.522710 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.523860 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.523840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 16:40:25.524274 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.524256 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kbl9j\"" Jun 12 16:40:25.529334 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.524525 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 16:40:25.529334 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.524573 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 16:40:25.529334 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.525828 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:25.529442 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.529411 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 16:40:25.529576 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.529561 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 16:40:25.529794 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.529776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 16:40:25.532197 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.532174 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 16:40:25.532289 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.532247 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f9qwz\"" Jun 12 16:40:25.532536 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.532522 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4gpgk\"" Jun 12 16:40:25.532694 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.532683 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 16:40:25.544845 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.544821 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9qnv" Jun 12 16:40:25.552271 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.552250 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f9qnv" Jun 12 16:40:25.581058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.580982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" event={"ID":"ae03d5083e42c17555e461b06baba72d","Type":"ContainerStarted","Data":"14d24ae3e2038ebd6ee7bf3b19973773dbe952eca5726706a6c24de3c27e2173"} Jun 12 16:40:25.582086 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.582058 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" event={"ID":"45572964cd7696b48b0469a3fb46e9c3","Type":"ContainerStarted","Data":"9b1440bfcfef35322ca34ea90146540bcdfa5805c5f76ba567fd3d37e66eff45"} Jun 12 16:40:25.608528 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.608501 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 16:40:25.620171 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-conf-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.620171 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-registration-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.620171 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-kubernetes\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-host\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-lib-modules\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-systemd-units\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-run-netns\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-ovn\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-host\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-netns\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-etc-kubernetes\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:25.620410 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-cni-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-socket-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-run\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-var-lib-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-env-overrides\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-os-release\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/197c065b-4015-44eb-b755-4ea3ef1699a9-cni-binary-copy\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-daemon-config\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-var-lib-kubelet\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-slash\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-etc-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-cni-bin\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.620913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85jm\" (UniqueName: \"kubernetes.io/projected/bc20facf-4830-4904-9b5f-9822847f8f83-kube-api-access-n85jm\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620900 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.620973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-multus-certs\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h88g\" (UniqueName: \"kubernetes.io/projected/bc37f869-dbb7-4783-9585-b26792ad94fb-kube-api-access-9h88g\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysctl-conf\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621097 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-tuned\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2l9k\" (UniqueName: \"kubernetes.io/projected/03f380ca-e643-4b86-b4e3-12a5594247d3-kube-api-access-n2l9k\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-sys\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9krw\" (UniqueName: \"kubernetes.io/projected/72b4a92e-1b7b-4277-8501-8e9e7e78f148-kube-api-access-r9krw\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-log-socket\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-ovnkube-config\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-ovnkube-script-lib\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/448c9b26-7d4f-4c0a-be83-0c494f22390d-host-slash\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-k8s-cni-cncf-io\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621369 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.621723 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-kubelet\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621418 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-systemd\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc20facf-4830-4904-9b5f-9822847f8f83-ovn-node-metrics-cert\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtw7\" (UniqueName: \"kubernetes.io/projected/448c9b26-7d4f-4c0a-be83-0c494f22390d-kube-api-access-fqtw7\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-cni-multus\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysctl-d\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621627 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-systemd\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-cni-netd\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3791ad77-0aed-408a-89ed-a52849f73523-dbus\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htxgh\" (UniqueName: \"kubernetes.io/projected/1c4629f7-7da1-472d-a049-956ac377d391-kube-api-access-htxgh\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-socket-dir-parent\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm5sg\" (UniqueName: \"kubernetes.io/projected/197c065b-4015-44eb-b755-4ea3ef1699a9-kube-api-access-dm5sg\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc37f869-dbb7-4783-9585-b26792ad94fb-hosts-file\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-cnibin\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621835 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-kubelet\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.622478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-node-log\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80da6e59-1545-4801-b76f-f4fbf3cc3750-agent-certs\") pod \"konnectivity-agent-55zpk\" (UID: \"80da6e59-1545-4801-b76f-f4fbf3cc3750\") " pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621911 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-system-cni-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-device-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.621961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-sys-fs\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysconfig\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80da6e59-1545-4801-b76f-f4fbf3cc3750-konnectivity-ca\") pod \"konnectivity-agent-55zpk\" (UID: \"80da6e59-1545-4801-b76f-f4fbf3cc3750\") " pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622103 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-cni-bin\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622117 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-conf-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72b4a92e-1b7b-4277-8501-8e9e7e78f148-tmp\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-serviceca\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622241 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lthfw\" (UniqueName: \"kubernetes.io/projected/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-kube-api-access-lthfw\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3791ad77-0aed-408a-89ed-a52849f73523-kubelet-config\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/448c9b26-7d4f-4c0a-be83-0c494f22390d-iptables-alerter-script\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-system-cni-dir\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.623256 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622363 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-cnibin\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-hostroot\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622420 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh79b\" (UniqueName: \"kubernetes.io/projected/d552df25-8865-43b8-b16e-f07226f6ffd0-kube-api-access-gh79b\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-netns\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622514 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-etc-kubernetes\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc37f869-dbb7-4783-9585-b26792ad94fb-tmp-dir\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.622630 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.622730 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:26.122700041 +0000 UTC m=+3.030353910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622940 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/448c9b26-7d4f-4c0a-be83-0c494f22390d-host-slash\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.623064 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-cni-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.623146 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-k8s-cni-cncf-io\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.623543 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.623607 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret podName:3791ad77-0aed-408a-89ed-a52849f73523 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:26.123589743 +0000 UTC m=+3.031243615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret") pod "global-pull-secret-syncer-2pzsz" (UID: "3791ad77-0aed-408a-89ed-a52849f73523") : object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.623712 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.623782 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-run-multus-certs\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.622637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-modprobe-d\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.624107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.623885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:25.624889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.623931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-os-release\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.624053 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-os-release\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.624122 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.624889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.624281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-cni-multus\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.624889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.624486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3791ad77-0aed-408a-89ed-a52849f73523-dbus\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-cnibin\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c4629f7-7da1-472d-a049-956ac377d391-cni-binary-copy\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-hostroot\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625281 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3791ad77-0aed-408a-89ed-a52849f73523-kubelet-config\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625286 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-kubelet\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625323 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-host-var-lib-cni-bin\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-system-cni-dir\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625307 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-socket-dir-parent\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625372 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/197c065b-4015-44eb-b755-4ea3ef1699a9-system-cni-dir\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.625666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625461 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-os-release\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.626167 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c4629f7-7da1-472d-a049-956ac377d391-cnibin\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.626167 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625725 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/448c9b26-7d4f-4c0a-be83-0c494f22390d-iptables-alerter-script\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.626167 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625869 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/197c065b-4015-44eb-b755-4ea3ef1699a9-multus-daemon-config\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.626167 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.625971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/197c065b-4015-44eb-b755-4ea3ef1699a9-cni-binary-copy\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.630708 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.630674 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 16:40:25.630803 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.630718 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 16:40:25.630803 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.630741 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cghc8 for pod openshift-network-diagnostics/network-check-target-rxzhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:25.630907 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:25.630805 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8 podName:27dc5b49-5875-41c8-ba20-2c93e9a6c05f nodeName:}" failed. No retries permitted until 2026-06-12 16:40:26.130789345 +0000 UTC m=+3.038443200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cghc8" (UniqueName: "kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8") pod "network-check-target-rxzhf" (UID: "27dc5b49-5875-41c8-ba20-2c93e9a6c05f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:25.630907 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.630791 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 16:40:25.634662 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.634511 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtw7\" (UniqueName: \"kubernetes.io/projected/448c9b26-7d4f-4c0a-be83-0c494f22390d-kube-api-access-fqtw7\") pod \"iptables-alerter-dcf6t\" (UID: \"448c9b26-7d4f-4c0a-be83-0c494f22390d\") " pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.634757 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.634513 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm5sg\" (UniqueName: \"kubernetes.io/projected/197c065b-4015-44eb-b755-4ea3ef1699a9-kube-api-access-dm5sg\") pod \"multus-g6k6k\" (UID: \"197c065b-4015-44eb-b755-4ea3ef1699a9\") " pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.634757 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.634624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2l9k\" (UniqueName: \"kubernetes.io/projected/03f380ca-e643-4b86-b4e3-12a5594247d3-kube-api-access-n2l9k\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:25.634757 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.634639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htxgh\" (UniqueName: \"kubernetes.io/projected/1c4629f7-7da1-472d-a049-956ac377d391-kube-api-access-htxgh\") pod \"multus-additional-cni-plugins-7rh8n\" (UID: \"1c4629f7-7da1-472d-a049-956ac377d391\") " pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.724321 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-socket-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724349 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-run\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724381 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-var-lib-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-env-overrides\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-run\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724476 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-var-lib-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724500 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-socket-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.724507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-var-lib-kubelet\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-slash\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724563 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-etc-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-var-lib-kubelet\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724610 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-slash\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724635 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-cni-bin\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-etc-openvswitch\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n85jm\" (UniqueName: \"kubernetes.io/projected/bc20facf-4830-4904-9b5f-9822847f8f83-kube-api-access-n85jm\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h88g\" (UniqueName: \"kubernetes.io/projected/bc37f869-dbb7-4783-9585-b26792ad94fb-kube-api-access-9h88g\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724686 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-cni-bin\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysctl-conf\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-tuned\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-sys\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724796 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-sys\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9krw\" (UniqueName: \"kubernetes.io/projected/72b4a92e-1b7b-4277-8501-8e9e7e78f148-kube-api-access-r9krw\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724832 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-env-overrides\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-log-socket\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724869 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-log-socket\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.724884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724869 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysctl-conf\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724925 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-run-ovn-kubernetes\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.724978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-ovnkube-config\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-ovnkube-script-lib\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-kubelet\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-systemd\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc20facf-4830-4904-9b5f-9822847f8f83-ovn-node-metrics-cert\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725170 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-kubelet\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysctl-d\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-systemd\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-cni-netd\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc37f869-dbb7-4783-9585-b26792ad94fb-hosts-file\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725296 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-systemd\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-node-log\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80da6e59-1545-4801-b76f-f4fbf3cc3750-agent-certs\") pod \"konnectivity-agent-55zpk\" (UID: \"80da6e59-1545-4801-b76f-f4fbf3cc3750\") " pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:25.725894 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-node-log\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-device-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725368 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-sys-fs\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725276 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysctl-d\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725369 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-device-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725393 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysconfig\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725432 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80da6e59-1545-4801-b76f-f4fbf3cc3750-konnectivity-ca\") pod \"konnectivity-agent-55zpk\" (UID: \"80da6e59-1545-4801-b76f-f4fbf3cc3750\") " pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72b4a92e-1b7b-4277-8501-8e9e7e78f148-tmp\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-ovnkube-script-lib\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-serviceca\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lthfw\" (UniqueName: \"kubernetes.io/projected/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-kube-api-access-lthfw\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh79b\" (UniqueName: \"kubernetes.io/projected/d552df25-8865-43b8-b16e-f07226f6ffd0-kube-api-access-gh79b\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725650 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc37f869-dbb7-4783-9585-b26792ad94fb-tmp-dir\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-modprobe-d\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.726699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726078 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-serviceca\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726079 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-systemd\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726140 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/80da6e59-1545-4801-b76f-f4fbf3cc3750-konnectivity-ca\") pod \"konnectivity-agent-55zpk\" (UID: \"80da6e59-1545-4801-b76f-f4fbf3cc3750\") " pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bc37f869-dbb7-4783-9585-b26792ad94fb-hosts-file\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726235 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726253 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-sys-fs\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-cni-netd\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.725605 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bc20facf-4830-4904-9b5f-9822847f8f83-ovnkube-config\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-sysconfig\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-registration-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726540 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-modprobe-d\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-kubernetes\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726596 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d552df25-8865-43b8-b16e-f07226f6ffd0-registration-dir\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-host\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-lib-modules\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-systemd-units\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-run-netns\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.727570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726716 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-host\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-ovn\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-host-run-netns\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726776 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-host\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726783 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc37f869-dbb7-4783-9585-b26792ad94fb-tmp-dir\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726802 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-kubernetes\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-run-ovn\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-host\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72b4a92e-1b7b-4277-8501-8e9e7e78f148-lib-modules\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.726892 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bc20facf-4830-4904-9b5f-9822847f8f83-systemd-units\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.728269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.727684 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72b4a92e-1b7b-4277-8501-8e9e7e78f148-etc-tuned\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.728931 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.728912 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72b4a92e-1b7b-4277-8501-8e9e7e78f148-tmp\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.729196 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.729173 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/80da6e59-1545-4801-b76f-f4fbf3cc3750-agent-certs\") pod \"konnectivity-agent-55zpk\" (UID: \"80da6e59-1545-4801-b76f-f4fbf3cc3750\") " pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:25.733919 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.733884 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h88g\" (UniqueName: \"kubernetes.io/projected/bc37f869-dbb7-4783-9585-b26792ad94fb-kube-api-access-9h88g\") pod \"node-resolver-kcmt4\" (UID: \"bc37f869-dbb7-4783-9585-b26792ad94fb\") " pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.734364 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.734329 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85jm\" (UniqueName: \"kubernetes.io/projected/bc20facf-4830-4904-9b5f-9822847f8f83-kube-api-access-n85jm\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.734651 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.734624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh79b\" (UniqueName: \"kubernetes.io/projected/d552df25-8865-43b8-b16e-f07226f6ffd0-kube-api-access-gh79b\") pod \"aws-ebs-csi-driver-node-kqg7d\" (UID: \"d552df25-8865-43b8-b16e-f07226f6ffd0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.735244 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.735220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc20facf-4830-4904-9b5f-9822847f8f83-ovn-node-metrics-cert\") pod \"ovnkube-node-fnx24\" (UID: \"bc20facf-4830-4904-9b5f-9822847f8f83\") " pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.735571 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.735551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lthfw\" (UniqueName: \"kubernetes.io/projected/2ea67727-e38c-4eae-b7b3-28a9b15ee2e8-kube-api-access-lthfw\") pod \"node-ca-8zx6d\" (UID: \"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8\") " pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.735889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.735858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9krw\" (UniqueName: \"kubernetes.io/projected/72b4a92e-1b7b-4277-8501-8e9e7e78f148-kube-api-access-r9krw\") pod \"tuned-vblqc\" (UID: \"72b4a92e-1b7b-4277-8501-8e9e7e78f148\") " pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.814423 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.814389 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dcf6t" Jun 12 16:40:25.820676 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.820657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" Jun 12 16:40:25.829316 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.829292 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g6k6k" Jun 12 16:40:25.837112 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.837091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:25.842111 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.842079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" Jun 12 16:40:25.849725 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.849706 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kcmt4" Jun 12 16:40:25.857395 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.857379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vblqc" Jun 12 16:40:25.866900 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.866879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8zx6d" Jun 12 16:40:25.873563 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:25.873524 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:26.129447 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:26.129354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:26.129599 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:26.129448 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:26.129599 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.129512 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:26.129599 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.129561 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:26.129725 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.129605 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret podName:3791ad77-0aed-408a-89ed-a52849f73523 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:27.129570549 +0000 UTC m=+4.037224422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret") pod "global-pull-secret-syncer-2pzsz" (UID: "3791ad77-0aed-408a-89ed-a52849f73523") : object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:26.129725 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.129625 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:27.129617022 +0000 UTC m=+4.037270882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:26.230248 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:26.230208 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:26.230437 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.230413 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 16:40:26.230506 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.230450 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 16:40:26.230506 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.230464 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cghc8 for pod openshift-network-diagnostics/network-check-target-rxzhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:26.230606 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:26.230533 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8 podName:27dc5b49-5875-41c8-ba20-2c93e9a6c05f nodeName:}" failed. No retries permitted until 2026-06-12 16:40:27.230513089 +0000 UTC m=+4.138166958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cghc8" (UniqueName: "kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8") pod "network-check-target-rxzhf" (UID: "27dc5b49-5875-41c8-ba20-2c93e9a6c05f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:26.555933 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:26.555897 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 16:35:25 +0000 UTC" deadline="2028-01-25 09:31:28.129724518 +0000 UTC" Jun 12 16:40:26.555933 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:26.555926 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14200h51m1.573802114s" Jun 12 16:40:26.614667 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.614595 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea67727_e38c_4eae_b7b3_28a9b15ee2e8.slice/crio-e3fc0825deab6a2807c882587b6c6fd3be4fbaee0719921daad539a9a6083b1d WatchSource:0}: Error finding container e3fc0825deab6a2807c882587b6c6fd3be4fbaee0719921daad539a9a6083b1d: Status 404 returned error can't find the container with id e3fc0825deab6a2807c882587b6c6fd3be4fbaee0719921daad539a9a6083b1d Jun 12 16:40:26.618355 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.618330 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197c065b_4015_44eb_b755_4ea3ef1699a9.slice/crio-4bdf2ff305378ea01cb3282e82cc74103cc71e5acca3dde2398134d9f31972fd WatchSource:0}: Error finding container 4bdf2ff305378ea01cb3282e82cc74103cc71e5acca3dde2398134d9f31972fd: Status 404 returned error can't find the container with id 4bdf2ff305378ea01cb3282e82cc74103cc71e5acca3dde2398134d9f31972fd Jun 12 16:40:26.619037 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.618985 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b4a92e_1b7b_4277_8501_8e9e7e78f148.slice/crio-56dc42227612beec4c351f096d397cb0c70749a94e09274ce12d887f9604b03d WatchSource:0}: Error finding container 56dc42227612beec4c351f096d397cb0c70749a94e09274ce12d887f9604b03d: Status 404 returned error can't find the container with id 56dc42227612beec4c351f096d397cb0c70749a94e09274ce12d887f9604b03d Jun 12 16:40:26.620276 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.620023 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc20facf_4830_4904_9b5f_9822847f8f83.slice/crio-c59af61c80bbd1cdfea7d53449cd66fc0f2bad7bb984ddb1b2f1746c2c3237cf WatchSource:0}: Error finding container c59af61c80bbd1cdfea7d53449cd66fc0f2bad7bb984ddb1b2f1746c2c3237cf: Status 404 returned error can't find the container with id c59af61c80bbd1cdfea7d53449cd66fc0f2bad7bb984ddb1b2f1746c2c3237cf Jun 12 16:40:26.620895 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.620874 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd552df25_8865_43b8_b16e_f07226f6ffd0.slice/crio-2b8966711c8f8f5f912b13244e04875c066ebd1693fe056f82c359ffd5d4a8f3 WatchSource:0}: Error finding container 2b8966711c8f8f5f912b13244e04875c066ebd1693fe056f82c359ffd5d4a8f3: Status 404 returned error can't find the container with id 2b8966711c8f8f5f912b13244e04875c066ebd1693fe056f82c359ffd5d4a8f3 Jun 12 16:40:26.623934 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.621559 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448c9b26_7d4f_4c0a_be83_0c494f22390d.slice/crio-b1f41ae307e7d545a19d44af44b5188b4f92f790044d66908c4b49073a722807 WatchSource:0}: Error finding container b1f41ae307e7d545a19d44af44b5188b4f92f790044d66908c4b49073a722807: Status 404 returned error can't find the container with id b1f41ae307e7d545a19d44af44b5188b4f92f790044d66908c4b49073a722807 Jun 12 16:40:26.623934 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.622356 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80da6e59_1545_4801_b76f_f4fbf3cc3750.slice/crio-4cac54ee2025a975e6ee40a4805f3a95107811666d5fa5c4f9f4c5aa3be5d3f4 WatchSource:0}: Error finding container 4cac54ee2025a975e6ee40a4805f3a95107811666d5fa5c4f9f4c5aa3be5d3f4: Status 404 returned error can't find the container with id 4cac54ee2025a975e6ee40a4805f3a95107811666d5fa5c4f9f4c5aa3be5d3f4 Jun 12 16:40:26.625579 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.624483 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4629f7_7da1_472d_a049_956ac377d391.slice/crio-ae6c403090eceb4b2d1f6521f5e9f391a12fe5d690aa873e1deeb836b74e66ef WatchSource:0}: Error finding container ae6c403090eceb4b2d1f6521f5e9f391a12fe5d690aa873e1deeb836b74e66ef: Status 404 returned error can't find the container with id ae6c403090eceb4b2d1f6521f5e9f391a12fe5d690aa873e1deeb836b74e66ef Jun 12 16:40:26.625579 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:26.624675 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc37f869_dbb7_4783_9585_b26792ad94fb.slice/crio-bb902bc5f5a2d5eef8c7fd7f5415785925b07cecfbc6748807a1176590e10505 WatchSource:0}: Error finding container bb902bc5f5a2d5eef8c7fd7f5415785925b07cecfbc6748807a1176590e10505: Status 404 returned error can't find the container with id bb902bc5f5a2d5eef8c7fd7f5415785925b07cecfbc6748807a1176590e10505 Jun 12 16:40:27.137514 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.136718 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:27.137514 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.136782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:27.137514 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.136896 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:27.137514 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.136957 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret podName:3791ad77-0aed-408a-89ed-a52849f73523 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:29.136939381 +0000 UTC m=+6.044593239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret") pod "global-pull-secret-syncer-2pzsz" (UID: "3791ad77-0aed-408a-89ed-a52849f73523") : object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:27.137514 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.137381 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:27.137514 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.137432 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:29.137417336 +0000 UTC m=+6.045071194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:27.237782 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.237601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:27.237961 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.237821 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 16:40:27.237961 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.237839 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 16:40:27.237961 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.237851 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cghc8 for pod openshift-network-diagnostics/network-check-target-rxzhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:27.237961 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.237920 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8 podName:27dc5b49-5875-41c8-ba20-2c93e9a6c05f nodeName:}" failed. No retries permitted until 2026-06-12 16:40:29.237901975 +0000 UTC m=+6.145555860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cghc8" (UniqueName: "kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8") pod "network-check-target-rxzhf" (UID: "27dc5b49-5875-41c8-ba20-2c93e9a6c05f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:27.557029 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.556864 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 16:35:25 +0000 UTC" deadline="2028-03-06 00:06:56.693943776 +0000 UTC" Jun 12 16:40:27.557029 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.556926 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15175h26m29.137022835s" Jun 12 16:40:27.578926 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.578105 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:27.578926 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.578231 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:27.578926 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.578645 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:27.578926 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.578786 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:27.579527 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.579359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:27.579527 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:27.579453 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:27.604823 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.604224 2581 generic.go:356] "Generic (PLEG): container finished" podID="45572964cd7696b48b0469a3fb46e9c3" containerID="29fe761a10d81a5859c0a236787df9774b83f45df6f39d0ac2661f29d68dce18" exitCode=0 Jun 12 16:40:27.604823 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.604320 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" event={"ID":"45572964cd7696b48b0469a3fb46e9c3","Type":"ContainerDied","Data":"29fe761a10d81a5859c0a236787df9774b83f45df6f39d0ac2661f29d68dce18"} Jun 12 16:40:27.623309 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.623221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcmt4" event={"ID":"bc37f869-dbb7-4783-9585-b26792ad94fb","Type":"ContainerStarted","Data":"bb902bc5f5a2d5eef8c7fd7f5415785925b07cecfbc6748807a1176590e10505"} Jun 12 16:40:27.628789 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.628728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vblqc" event={"ID":"72b4a92e-1b7b-4277-8501-8e9e7e78f148","Type":"ContainerStarted","Data":"56dc42227612beec4c351f096d397cb0c70749a94e09274ce12d887f9604b03d"} Jun 12 16:40:27.641145 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.641104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dcf6t" event={"ID":"448c9b26-7d4f-4c0a-be83-0c494f22390d","Type":"ContainerStarted","Data":"b1f41ae307e7d545a19d44af44b5188b4f92f790044d66908c4b49073a722807"} Jun 12 16:40:27.649188 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.649084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" event={"ID":"d552df25-8865-43b8-b16e-f07226f6ffd0","Type":"ContainerStarted","Data":"2b8966711c8f8f5f912b13244e04875c066ebd1693fe056f82c359ffd5d4a8f3"} Jun 12 16:40:27.660586 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.660555 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"c59af61c80bbd1cdfea7d53449cd66fc0f2bad7bb984ddb1b2f1746c2c3237cf"} Jun 12 16:40:27.686942 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.683643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g6k6k" event={"ID":"197c065b-4015-44eb-b755-4ea3ef1699a9","Type":"ContainerStarted","Data":"4bdf2ff305378ea01cb3282e82cc74103cc71e5acca3dde2398134d9f31972fd"} Jun 12 16:40:27.700869 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.700825 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" event={"ID":"ae03d5083e42c17555e461b06baba72d","Type":"ContainerStarted","Data":"e4c3d05850442ff79cf6e00fe383c2f7bcf7dbb3a8949acfa0b824a9496dd403"} Jun 12 16:40:27.704283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.704252 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerStarted","Data":"ae6c403090eceb4b2d1f6521f5e9f391a12fe5d690aa873e1deeb836b74e66ef"} Jun 12 16:40:27.720068 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.719974 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-55zpk" event={"ID":"80da6e59-1545-4801-b76f-f4fbf3cc3750","Type":"ContainerStarted","Data":"4cac54ee2025a975e6ee40a4805f3a95107811666d5fa5c4f9f4c5aa3be5d3f4"} Jun 12 16:40:27.741595 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:27.741551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8zx6d" event={"ID":"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8","Type":"ContainerStarted","Data":"e3fc0825deab6a2807c882587b6c6fd3be4fbaee0719921daad539a9a6083b1d"} Jun 12 16:40:28.752054 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:28.752019 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" event={"ID":"45572964cd7696b48b0469a3fb46e9c3","Type":"ContainerStarted","Data":"869046be953b7c59cf4ed18bfad80952979267981863cf393e2979019941f7cc"} Jun 12 16:40:28.771052 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:28.770977 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-123.ec2.internal" podStartSLOduration=4.770955956 podStartE2EDuration="4.770955956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:27.719335103 +0000 UTC m=+4.626988990" watchObservedRunningTime="2026-06-12 16:40:28.770955956 +0000 UTC m=+5.678609828" Jun 12 16:40:29.155974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:29.155127 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:29.155974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:29.155199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:29.155974 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.155343 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:29.155974 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.155409 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret podName:3791ad77-0aed-408a-89ed-a52849f73523 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:33.155389613 +0000 UTC m=+10.063043486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret") pod "global-pull-secret-syncer-2pzsz" (UID: "3791ad77-0aed-408a-89ed-a52849f73523") : object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:29.155974 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.155800 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:29.155974 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.155847 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:33.155832044 +0000 UTC m=+10.063485897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:29.256232 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:29.256192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:29.256430 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.256392 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 16:40:29.256430 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.256414 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 16:40:29.256430 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.256427 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cghc8 for pod openshift-network-diagnostics/network-check-target-rxzhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:29.256580 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.256485 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8 podName:27dc5b49-5875-41c8-ba20-2c93e9a6c05f nodeName:}" failed. No retries permitted until 2026-06-12 16:40:33.256467817 +0000 UTC m=+10.164121673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cghc8" (UniqueName: "kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8") pod "network-check-target-rxzhf" (UID: "27dc5b49-5875-41c8-ba20-2c93e9a6c05f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:29.579958 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:29.579921 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:29.580158 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.580078 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:29.580474 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:29.580452 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:29.580625 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.580556 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:29.580625 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:29.580609 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:29.580740 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:29.580704 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:31.578730 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:31.578216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:31.578730 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:31.578337 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:31.578730 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:31.578358 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:31.578730 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:31.578500 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:31.578730 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:31.578216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:31.578730 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:31.578566 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:33.190464 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:33.190422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:33.191032 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:33.190508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:33.191032 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.190620 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:33.191032 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.190620 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:33.191032 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.190683 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:41.190668538 +0000 UTC m=+18.098322392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:33.191032 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.190703 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret podName:3791ad77-0aed-408a-89ed-a52849f73523 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:41.19069158 +0000 UTC m=+18.098345434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret") pod "global-pull-secret-syncer-2pzsz" (UID: "3791ad77-0aed-408a-89ed-a52849f73523") : object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:33.291523 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:33.291486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:33.291741 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.291710 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 16:40:33.291741 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.291734 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 16:40:33.291856 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.291747 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cghc8 for pod openshift-network-diagnostics/network-check-target-rxzhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:33.291856 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.291806 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8 podName:27dc5b49-5875-41c8-ba20-2c93e9a6c05f nodeName:}" failed. No retries permitted until 2026-06-12 16:40:41.291787748 +0000 UTC m=+18.199441622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cghc8" (UniqueName: "kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8") pod "network-check-target-rxzhf" (UID: "27dc5b49-5875-41c8-ba20-2c93e9a6c05f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:33.578371 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:33.578170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:33.578371 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.578279 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:33.578371 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:33.578321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:33.578599 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.578411 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:33.578599 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:33.578437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:33.578599 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:33.578563 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:35.577471 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:35.577436 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:35.577471 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:35.577458 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:35.577927 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:35.577563 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:35.577927 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:35.577614 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:35.577927 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:35.577697 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:35.577927 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:35.577754 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:37.577763 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:37.577730 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:37.578235 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:37.577865 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:37.578235 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:37.578097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:37.578235 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:37.578210 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:37.578235 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:37.578232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:37.578438 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:37.578341 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:39.577433 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:39.577396 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:39.577901 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:39.577398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:39.577901 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:39.577528 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:39.577901 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:39.577406 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:39.577901 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:39.577614 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:39.577901 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:39.577712 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:41.252719 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:41.252683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:41.253129 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:41.252747 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:41.253129 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.252848 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:41.253129 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.252891 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:41.253129 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.252922 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:57.252902217 +0000 UTC m=+34.160556073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:41.253129 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.252943 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret podName:3791ad77-0aed-408a-89ed-a52849f73523 nodeName:}" failed. No retries permitted until 2026-06-12 16:40:57.252932115 +0000 UTC m=+34.160585974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret") pod "global-pull-secret-syncer-2pzsz" (UID: "3791ad77-0aed-408a-89ed-a52849f73523") : object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:41.353244 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:41.353216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:41.353393 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.353366 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 16:40:41.353393 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.353387 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 16:40:41.353488 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.353397 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cghc8 for pod openshift-network-diagnostics/network-check-target-rxzhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:41.353488 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.353446 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8 podName:27dc5b49-5875-41c8-ba20-2c93e9a6c05f nodeName:}" failed. No retries permitted until 2026-06-12 16:40:57.353433653 +0000 UTC m=+34.261087507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cghc8" (UniqueName: "kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8") pod "network-check-target-rxzhf" (UID: "27dc5b49-5875-41c8-ba20-2c93e9a6c05f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:41.578029 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:41.577928 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:41.578181 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.578077 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:41.578559 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:41.578527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:41.578684 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.578634 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:41.578684 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:41.578675 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:41.578801 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:41.578757 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:43.577945 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:43.577908 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:43.578431 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:43.578010 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:43.578431 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:43.578103 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:43.578431 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:43.578200 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:43.578431 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:43.578250 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:43.578431 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:43.578322 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:45.577839 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.577574 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:45.578349 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.577574 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:45.578349 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:45.577909 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:45.578349 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.577606 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:45.578349 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:45.577971 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:45.578349 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:45.578061 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:45.789747 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.789557 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" event={"ID":"d552df25-8865-43b8-b16e-f07226f6ffd0","Type":"ContainerStarted","Data":"ea542b1745c300f395fc65ce923510616892d66914f8205ad06685c2eaccc866"} Jun 12 16:40:45.791932 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.791908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"d14b272dc1e4c134b0aec0e31a95fe8a38167553e073d37d2b3083726909bdd4"} Jun 12 16:40:45.793398 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.793372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g6k6k" event={"ID":"197c065b-4015-44eb-b755-4ea3ef1699a9","Type":"ContainerStarted","Data":"57dc1275bcc2ab1f75d09076d479812e8b78ad6e88360cbadab589df7051e368"} Jun 12 16:40:45.795245 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.795168 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c4629f7-7da1-472d-a049-956ac377d391" containerID="394983eb1c859d3d454884308668282f02840a4001b6c689b7717034392cb384" exitCode=0 Jun 12 16:40:45.795245 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.795200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerDied","Data":"394983eb1c859d3d454884308668282f02840a4001b6c689b7717034392cb384"} Jun 12 16:40:45.797271 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.797251 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-55zpk" event={"ID":"80da6e59-1545-4801-b76f-f4fbf3cc3750","Type":"ContainerStarted","Data":"fbc0df47a259d846e69e41a03ed5693db62b85b5b923eefa7d8539a795e7e739"} Jun 12 16:40:45.799470 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.799352 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8zx6d" event={"ID":"2ea67727-e38c-4eae-b7b3-28a9b15ee2e8","Type":"ContainerStarted","Data":"c840acea7af92b74b89d7766f2df73121a1443326a7c614935af9dafd3aa2811"} Jun 12 16:40:45.801156 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.801099 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kcmt4" event={"ID":"bc37f869-dbb7-4783-9585-b26792ad94fb","Type":"ContainerStarted","Data":"bd8016c3ea7b080c0fe05b961d23db2276f8b9ae20a8760e1356d9bdbd6d338e"} Jun 12 16:40:45.802914 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.802893 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vblqc" event={"ID":"72b4a92e-1b7b-4277-8501-8e9e7e78f148","Type":"ContainerStarted","Data":"4a9f1c29fba79db6740bbf7bf11e76d6a9ce80aca67edecb4ec55c20439ae5fd"} Jun 12 16:40:45.822725 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.822678 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-123.ec2.internal" podStartSLOduration=21.822664681 podStartE2EDuration="21.822664681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:28.772362561 +0000 UTC m=+5.680016437" watchObservedRunningTime="2026-06-12 16:40:45.822664681 +0000 UTC m=+22.730318558" Jun 12 16:40:45.860281 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.860237 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g6k6k" podStartSLOduration=4.107127864 podStartE2EDuration="22.860221664s" totalImagesPullingTime="18.7530938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:45.823087622 +0000 UTC m=+22.730741517" watchObservedRunningTime="2026-06-12 16:40:45.860221664 +0000 UTC m=+22.767875608" Jun 12 16:40:45.889774 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.889730 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vblqc" podStartSLOduration=4.180559248 podStartE2EDuration="22.889715876s" totalImagesPullingTime="18.709156628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:45.859864498 +0000 UTC m=+22.767518372" watchObservedRunningTime="2026-06-12 16:40:45.889715876 +0000 UTC m=+22.797369752" Jun 12 16:40:45.889856 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.889841 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8zx6d" podStartSLOduration=4.181781634 podStartE2EDuration="22.889833475s" totalImagesPullingTime="18.708051841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:45.888343202 +0000 UTC m=+22.795997078" watchObservedRunningTime="2026-06-12 16:40:45.889833475 +0000 UTC m=+22.797487351" Jun 12 16:40:45.941050 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:45.941010 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-55zpk" podStartSLOduration=8.68787019 podStartE2EDuration="22.94098016s" totalImagesPullingTime="14.25310997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:45.929279805 +0000 UTC m=+22.836933680" watchObservedRunningTime="2026-06-12 16:40:45.94098016 +0000 UTC m=+22.848634027" Jun 12 16:40:46.003440 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.003412 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:46.063958 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.063896 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kcmt4" podStartSLOduration=4.365530016 podStartE2EDuration="23.063875879s" totalImagesPullingTime="18.698345863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:46.063165085 +0000 UTC m=+22.970818974" watchObservedRunningTime="2026-06-12 16:40:46.063875879 +0000 UTC m=+22.971529754" Jun 12 16:40:46.105766 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.105680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:46.292921 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.292884 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:46.412402 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.412372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:46.521537 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.521510 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 16:40:46.552823 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.552792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:46.580885 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.580794 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T16:40:46.52153335Z","UUID":"e5c7b03e-4e2c-4067-a29a-d130ed970d74","Handler":null,"Name":"","Endpoint":""} Jun 12 16:40:46.582516 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.582496 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 16:40:46.582619 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.582536 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 16:40:46.755729 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.755696 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:46.807091 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.807056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dcf6t" event={"ID":"448c9b26-7d4f-4c0a-be83-0c494f22390d","Type":"ContainerStarted","Data":"18425a8541bdaf4e2ffaa1d7d98984320ee43233cbd5bd0622c217797e662bf4"} Jun 12 16:40:46.808822 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.808789 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" event={"ID":"d552df25-8865-43b8-b16e-f07226f6ffd0","Type":"ContainerStarted","Data":"d69661d8fdcd56d465f91bcba53f7dc9871ff3dc41245c8d77d6f9d7d9887410"} Jun 12 16:40:46.811527 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.811504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"bc8929de3585bad90eacaf5fa33b5da7a4f656c769347cd9a6445c5b17ef40a4"} Jun 12 16:40:46.811614 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.811561 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"a8c1e596070765f3d8326a8035a43e649747a2442b3ecfc5a867335051d65e37"} Jun 12 16:40:46.811614 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.811592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"adea7efe707ec11bec293d829d9cd7e9080009609f68bbdbbae00d283f481eca"} Jun 12 16:40:46.811677 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.811623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"5cac4706011d8779dcc85de64f463da1b603b8c0db84a162f7cafdcdd0ada029"} Jun 12 16:40:46.811677 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.811650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"2cc4df49219b45dcec10fc10fa60a0e271b7e7318b5bae8cb126cdf11744e512"} Jun 12 16:40:46.879754 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.879725 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:46.984284 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:46.984077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:47.377136 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:47.376946 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:47.478424 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:47.478395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:47.578118 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:47.578020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:47.578118 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:47.578063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:47.578118 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:47.578020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:47.578387 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:47.578147 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:47.578387 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:47.578206 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:47.578387 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:47.578301 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:47.816354 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:47.816284 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" event={"ID":"d552df25-8865-43b8-b16e-f07226f6ffd0","Type":"ContainerStarted","Data":"15d582efb4be8e78898de67f8d395f9049b69b52ee9da33c1933529f13f4374a"} Jun 12 16:40:47.875026 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:47.874900 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dcf6t" podStartSLOduration=6.173526931 podStartE2EDuration="24.874882995s" totalImagesPullingTime="18.701356064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:46.841466992 +0000 UTC m=+23.749120877" watchObservedRunningTime="2026-06-12 16:40:47.874882995 +0000 UTC m=+24.782536870" Jun 12 16:40:48.156933 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.156906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:48.195246 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.195216 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:48.195848 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.195833 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:48.230620 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.230558 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqg7d" podStartSLOduration=4.858074483 podStartE2EDuration="25.230541047s" totalImagesPullingTime="20.372466564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:47.875156122 +0000 UTC m=+24.782810009" watchObservedRunningTime="2026-06-12 16:40:48.230541047 +0000 UTC m=+25.138194922" Jun 12 16:40:48.256210 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.256179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:48.524888 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.524849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:48.625541 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.625499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:48.824473 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.824387 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"c9befdc7d6f61a27786ffadec149ad6b00ef6749aaa8aa1a0a61255313497f97"} Jun 12 16:40:48.825203 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.825187 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-55zpk" Jun 12 16:40:48.947951 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:48.947918 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:49.577628 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:49.577599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:49.577784 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:49.577604 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:49.577784 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:49.577696 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:49.577784 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:49.577602 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:49.577939 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:49.577784 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:49.577939 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:49.577894 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:51.580468 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.580299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:51.581124 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.580343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:51.581124 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:51.580569 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:51.581124 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:51.580670 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:51.581124 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.580356 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:51.581124 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:51.580747 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:51.833239 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.833158 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c4629f7-7da1-472d-a049-956ac377d391" containerID="e25ab8a6a30d67d6cd43b8f2c52b24b9d5919670c19d27c078de4cb12d8c558a" exitCode=0 Jun 12 16:40:51.833393 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.833243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerDied","Data":"e25ab8a6a30d67d6cd43b8f2c52b24b9d5919670c19d27c078de4cb12d8c558a"} Jun 12 16:40:51.836937 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.836908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" event={"ID":"bc20facf-4830-4904-9b5f-9822847f8f83","Type":"ContainerStarted","Data":"fff79da6c9359882f9bdc0dce71c0bcdc95ee5dc55c9fc7c6ccc3348e26425bd"} Jun 12 16:40:51.837144 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.837125 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:51.837226 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.837214 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:51.837274 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.837267 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:51.853259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.853239 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:51.853376 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.853365 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:40:51.905680 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:51.905632 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" podStartSLOduration=9.922810265 podStartE2EDuration="28.905619491s" totalImagesPullingTime="18.982809226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:40:51.903118802 +0000 UTC m=+28.810772691" watchObservedRunningTime="2026-06-12 16:40:51.905619491 +0000 UTC m=+28.813273366" Jun 12 16:40:53.580846 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.580383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:53.580846 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:53.580494 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:53.580846 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.580655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:53.580846 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.580708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:53.580846 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:53.580752 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:53.580846 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:53.580813 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:53.598556 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.598527 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2pzsz"] Jun 12 16:40:53.602074 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.601979 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xxnl"] Jun 12 16:40:53.602843 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.602816 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxzhf"] Jun 12 16:40:53.844002 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.843968 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c4629f7-7da1-472d-a049-956ac377d391" containerID="852d72fab34f48ecb234b64aaed3dcc3e818397877d9491b6c9d40bcbda78d43" exitCode=0 Jun 12 16:40:53.844144 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.844041 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:53.844144 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.844077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerDied","Data":"852d72fab34f48ecb234b64aaed3dcc3e818397877d9491b6c9d40bcbda78d43"} Jun 12 16:40:53.844144 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.844129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:53.844323 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:53.844302 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:53.844389 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:53.844360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:53.844593 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:53.844564 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:53.844770 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:53.844743 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:54.391265 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:54.391221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:54.452293 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:54.452258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:54.507644 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:54.507613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:55.577440 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:55.577412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:55.577440 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:55.577425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:55.577440 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:55.577434 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:55.578204 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:55.577512 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:55.578204 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:55.577583 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:55.578204 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:55.577642 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:55.850400 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:55.850369 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c4629f7-7da1-472d-a049-956ac377d391" containerID="8a7fc6fd20dcf8c3d3f25f3f03df23b8559d92054a90a8c071b2b82f56f0a284" exitCode=0 Jun 12 16:40:55.850547 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:55.850414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerDied","Data":"8a7fc6fd20dcf8c3d3f25f3f03df23b8559d92054a90a8c071b2b82f56f0a284"} Jun 12 16:40:57.268241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:57.268201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:57.268689 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:57.268259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:57.268689 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.268349 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:57.268689 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.268414 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:41:29.268398089 +0000 UTC m=+66.176051942 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 16:40:57.268689 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.268351 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:57.268689 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.268483 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret podName:3791ad77-0aed-408a-89ed-a52849f73523 nodeName:}" failed. No retries permitted until 2026-06-12 16:41:29.268468795 +0000 UTC m=+66.176122651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret") pod "global-pull-secret-syncer-2pzsz" (UID: "3791ad77-0aed-408a-89ed-a52849f73523") : object "kube-system"/"original-pull-secret" not registered Jun 12 16:40:57.369369 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:57.369333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:57.369554 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.369533 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 16:40:57.369605 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.369560 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 16:40:57.369605 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.369582 2581 projected.go:196] Error preparing data for projected volume kube-api-access-cghc8 for pod openshift-network-diagnostics/network-check-target-rxzhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:57.369704 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.369647 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8 podName:27dc5b49-5875-41c8-ba20-2c93e9a6c05f nodeName:}" failed. No retries permitted until 2026-06-12 16:41:29.369628086 +0000 UTC m=+66.277281942 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cghc8" (UniqueName: "kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8") pod "network-check-target-rxzhf" (UID: "27dc5b49-5875-41c8-ba20-2c93e9a6c05f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 16:40:57.577981 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:57.577896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:57.578150 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:57.577896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:57.578150 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.578033 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2pzsz" podUID="3791ad77-0aed-408a-89ed-a52849f73523" Jun 12 16:40:57.578150 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:57.578052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:57.578150 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.578139 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:40:57.578713 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:57.578663 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxzhf" podUID="27dc5b49-5875-41c8-ba20-2c93e9a6c05f" Jun 12 16:40:57.677596 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:57.677548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:58.403835 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.403759 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-123.ec2.internal" event="NodeReady" Jun 12 16:40:58.404198 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.403883 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 16:40:58.470106 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.470074 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xblzg"] Jun 12 16:40:58.490961 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.490930 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qnzfn"] Jun 12 16:40:58.491149 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.491040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.494703 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.494680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 16:40:58.495227 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.495208 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 16:40:58.495351 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.495311 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8lgp\"" Jun 12 16:40:58.527945 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.527737 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xblzg"] Jun 12 16:40:58.528094 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.527976 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnzfn"] Jun 12 16:40:58.528094 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.527846 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.531411 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.531393 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 16:40:58.531670 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.531650 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-px84m\"" Jun 12 16:40:58.531791 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.531708 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 16:40:58.531839 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.531786 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 16:40:58.577669 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.577639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb483be5-b961-4528-ab86-1e36cac7c5cb-tmp-dir\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.577816 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.577704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb483be5-b961-4528-ab86-1e36cac7c5cb-config-volume\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.577816 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.577737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7n6x\" (UniqueName: \"kubernetes.io/projected/fb483be5-b961-4528-ab86-1e36cac7c5cb-kube-api-access-f7n6x\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.577816 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.577789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.679072 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.679220 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbf2f977-24b5-4d8b-9e04-399cb8b600a8-cert\") pod \"ingress-canary-qnzfn\" (UID: \"bbf2f977-24b5-4d8b-9e04-399cb8b600a8\") " pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.679220 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj792\" (UniqueName: \"kubernetes.io/projected/bbf2f977-24b5-4d8b-9e04-399cb8b600a8-kube-api-access-zj792\") pod \"ingress-canary-qnzfn\" (UID: \"bbf2f977-24b5-4d8b-9e04-399cb8b600a8\") " pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.679220 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb483be5-b961-4528-ab86-1e36cac7c5cb-tmp-dir\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.679220 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:58.679204 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:40:58.679366 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb483be5-b961-4528-ab86-1e36cac7c5cb-config-volume\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.679366 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:58.679264 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:40:59.179248587 +0000 UTC m=+36.086902476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:40:58.679366 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7n6x\" (UniqueName: \"kubernetes.io/projected/fb483be5-b961-4528-ab86-1e36cac7c5cb-kube-api-access-f7n6x\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.679591 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679572 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb483be5-b961-4528-ab86-1e36cac7c5cb-tmp-dir\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.679686 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.679670 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb483be5-b961-4528-ab86-1e36cac7c5cb-config-volume\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.694313 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.694295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7n6x\" (UniqueName: \"kubernetes.io/projected/fb483be5-b961-4528-ab86-1e36cac7c5cb-kube-api-access-f7n6x\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:58.711303 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.711275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:58.780307 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.780272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbf2f977-24b5-4d8b-9e04-399cb8b600a8-cert\") pod \"ingress-canary-qnzfn\" (UID: \"bbf2f977-24b5-4d8b-9e04-399cb8b600a8\") " pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.780500 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.780339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj792\" (UniqueName: \"kubernetes.io/projected/bbf2f977-24b5-4d8b-9e04-399cb8b600a8-kube-api-access-zj792\") pod \"ingress-canary-qnzfn\" (UID: \"bbf2f977-24b5-4d8b-9e04-399cb8b600a8\") " pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.782985 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.782958 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbf2f977-24b5-4d8b-9e04-399cb8b600a8-cert\") pod \"ingress-canary-qnzfn\" (UID: \"bbf2f977-24b5-4d8b-9e04-399cb8b600a8\") " pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.792177 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.792150 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj792\" (UniqueName: \"kubernetes.io/projected/bbf2f977-24b5-4d8b-9e04-399cb8b600a8-kube-api-access-zj792\") pod \"ingress-canary-qnzfn\" (UID: \"bbf2f977-24b5-4d8b-9e04-399cb8b600a8\") " pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.814143 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.814107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:58.837862 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.837836 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnzfn" Jun 12 16:40:58.889368 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:58.889320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:40:59.071262 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.071228 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnzfn"] Jun 12 16:40:59.075516 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:40:59.075488 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf2f977_24b5_4d8b_9e04_399cb8b600a8.slice/crio-54c96383d48f65d0a0549a248d337b01cc26574ad3b09dbfa349f956c5e2e115 WatchSource:0}: Error finding container 54c96383d48f65d0a0549a248d337b01cc26574ad3b09dbfa349f956c5e2e115: Status 404 returned error can't find the container with id 54c96383d48f65d0a0549a248d337b01cc26574ad3b09dbfa349f956c5e2e115 Jun 12 16:40:59.183758 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.183720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:40:59.183960 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:59.183944 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:40:59.184055 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:40:59.184024 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:41:00.184005781 +0000 UTC m=+37.091659650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:40:59.577159 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.577126 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:40:59.577769 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.577749 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:40:59.578649 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.578286 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:40:59.580756 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.580738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 16:40:59.582282 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.582260 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nfh7j\"" Jun 12 16:40:59.582387 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.582281 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 16:40:59.582387 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.582281 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 16:40:59.582498 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.582396 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7ztv6\"" Jun 12 16:40:59.582498 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.582445 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 16:40:59.861027 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:40:59.860924 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnzfn" event={"ID":"bbf2f977-24b5-4d8b-9e04-399cb8b600a8","Type":"ContainerStarted","Data":"54c96383d48f65d0a0549a248d337b01cc26574ad3b09dbfa349f956c5e2e115"} Jun 12 16:41:00.191206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:00.191166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:41:00.191415 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:00.191331 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:41:00.191489 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:00.191417 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:41:02.191395247 +0000 UTC m=+39.099049118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:41:02.207322 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:02.207271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:41:02.207781 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:02.207456 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:41:02.207781 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:02.207539 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:41:06.207517912 +0000 UTC m=+43.115171767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:41:02.871276 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:02.871048 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c4629f7-7da1-472d-a049-956ac377d391" containerID="8439dc8d6061ff168068b67f262a8a8c56310876a29e412836d005a5e43ced90" exitCode=0 Jun 12 16:41:02.871276 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:02.871129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerDied","Data":"8439dc8d6061ff168068b67f262a8a8c56310876a29e412836d005a5e43ced90"} Jun 12 16:41:02.872802 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:02.872772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnzfn" event={"ID":"bbf2f977-24b5-4d8b-9e04-399cb8b600a8","Type":"ContainerStarted","Data":"93ad1b7dfc80d0bc479a70be523668f44238e3c9725f92f1b8228e22db0b07eb"} Jun 12 16:41:02.963414 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:02.963367 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qnzfn" podStartSLOduration=1.8222971669999999 podStartE2EDuration="4.963348346s" totalImagesPullingTime="3.141051179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:41:02.963202216 +0000 UTC m=+39.870856103" watchObservedRunningTime="2026-06-12 16:41:02.963348346 +0000 UTC m=+39.871002223" Jun 12 16:41:03.488961 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:03.488931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:41:03.586302 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:03.586276 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:41:03.880788 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:03.880692 2581 generic.go:356] "Generic (PLEG): container finished" podID="1c4629f7-7da1-472d-a049-956ac377d391" containerID="dd2c3f0cd49eb51a1b9cc1208bf618c7c55f6c375565f9a245cd45b0b6d85efc" exitCode=0 Jun 12 16:41:03.880946 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:03.880780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerDied","Data":"dd2c3f0cd49eb51a1b9cc1208bf618c7c55f6c375565f9a245cd45b0b6d85efc"} Jun 12 16:41:04.885790 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:04.885747 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" event={"ID":"1c4629f7-7da1-472d-a049-956ac377d391","Type":"ContainerStarted","Data":"5390b9dae468347eb45db0f274029639c9687dc4a31256e28a96e53415b80c5e"} Jun 12 16:41:05.194872 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:05.194837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:41:05.286131 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:05.286092 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" limit=1024 Jun 12 16:41:06.236490 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:06.236435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:41:06.236854 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:06.236592 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:41:06.236854 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:06.236654 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:41:14.236640297 +0000 UTC m=+51.144294150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:41:14.292602 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:14.292570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:41:14.293015 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:14.292707 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:41:14.293015 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:14.292761 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:41:30.292747494 +0000 UTC m=+67.200401348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:41:23.855954 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:23.855924 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fnx24" Jun 12 16:41:23.893397 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:23.893343 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7rh8n" podStartSLOduration=27.886977276 podStartE2EDuration="1m0.893329333s" totalImagesPullingTime="33.006352057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:41:04.931553319 +0000 UTC m=+41.839207214" watchObservedRunningTime="2026-06-12 16:41:23.893329333 +0000 UTC m=+60.800983246" Jun 12 16:41:29.292356 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.292313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:41:29.292838 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.292372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:41:29.295938 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.295914 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 16:41:29.295938 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.295929 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 16:41:29.302603 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:29.302585 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 16:41:29.302656 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:29.302648 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:42:33.30262786 +0000 UTC m=+130.210281715 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : secret "metrics-daemon-secret" not found Jun 12 16:41:29.305888 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.305856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3791ad77-0aed-408a-89ed-a52849f73523-original-pull-secret\") pod \"global-pull-secret-syncer-2pzsz\" (UID: \"3791ad77-0aed-408a-89ed-a52849f73523\") " pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:41:29.393463 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.393412 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:41:29.396255 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.396236 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 16:41:29.406588 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.406573 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 16:41:29.416663 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.416637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghc8\" (UniqueName: \"kubernetes.io/projected/27dc5b49-5875-41c8-ba20-2c93e9a6c05f-kube-api-access-cghc8\") pod \"network-check-target-rxzhf\" (UID: \"27dc5b49-5875-41c8-ba20-2c93e9a6c05f\") " pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:41:29.591287 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.591200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2pzsz" Jun 12 16:41:29.611341 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.611321 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nfh7j\"" Jun 12 16:41:29.619131 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.619109 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:41:29.749259 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.749230 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2pzsz"] Jun 12 16:41:29.772598 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.772571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxzhf"] Jun 12 16:41:29.775149 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:41:29.775121 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27dc5b49_5875_41c8_ba20_2c93e9a6c05f.slice/crio-155af6182865a437ca19442861db40c8a235a1e9377ea9568e863f6faa7e2dcc WatchSource:0}: Error finding container 155af6182865a437ca19442861db40c8a235a1e9377ea9568e863f6faa7e2dcc: Status 404 returned error can't find the container with id 155af6182865a437ca19442861db40c8a235a1e9377ea9568e863f6faa7e2dcc Jun 12 16:41:29.943289 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.943250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2pzsz" event={"ID":"3791ad77-0aed-408a-89ed-a52849f73523","Type":"ContainerStarted","Data":"ca33bf354aaddedf013771c4cfd9cc1e543ce747dc50d658b398af63361b7459"} Jun 12 16:41:29.944219 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:29.944198 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxzhf" event={"ID":"27dc5b49-5875-41c8-ba20-2c93e9a6c05f","Type":"ContainerStarted","Data":"155af6182865a437ca19442861db40c8a235a1e9377ea9568e863f6faa7e2dcc"} Jun 12 16:41:30.304610 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:30.304508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:41:30.305010 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:30.304648 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:41:30.305010 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:41:30.304721 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:42:02.304706755 +0000 UTC m=+99.212360612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:41:34.960176 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:34.960138 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2pzsz" event={"ID":"3791ad77-0aed-408a-89ed-a52849f73523","Type":"ContainerStarted","Data":"a7cd462950aafb132070fc71660fbc666a70da12d4311cafa3b7b585fde1cdd9"} Jun 12 16:41:34.961525 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:34.961497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxzhf" event={"ID":"27dc5b49-5875-41c8-ba20-2c93e9a6c05f","Type":"ContainerStarted","Data":"002a509cbc5574cdd4f09b626947759296169819c588cd950ad592b061fff060"} Jun 12 16:41:34.961642 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:34.961621 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:41:34.981604 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:34.981559 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2pzsz" podStartSLOduration=67.402963515 podStartE2EDuration="1m11.981542671s" totalImagesPullingTime="4.578579156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:41:34.981009952 +0000 UTC m=+71.888663829" watchObservedRunningTime="2026-06-12 16:41:34.981542671 +0000 UTC m=+71.889196550" Jun 12 16:41:35.006005 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:35.005944 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rxzhf" podStartSLOduration=67.454166681 podStartE2EDuration="1m12.005933315s" totalImagesPullingTime="4.551766634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:41:35.005658888 +0000 UTC m=+71.913312762" watchObservedRunningTime="2026-06-12 16:41:35.005933315 +0000 UTC m=+71.913587168" Jun 12 16:41:37.470484 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.470438 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx"] Jun 12 16:41:37.473345 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.473330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.477244 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.477217 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 16:41:37.478535 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.478512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jknqn\"" Jun 12 16:41:37.478666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.478637 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 16:41:37.478734 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.478662 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 16:41:37.478734 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.478720 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 16:41:37.493684 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.493659 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx"] Jun 12 16:41:37.557784 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.557744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db1a692c-8a00-4f9b-9bd0-dd1c5af084e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9676bd56-sr6kx\" (UID: \"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.557784 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.557786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgt49\" (UniqueName: \"kubernetes.io/projected/db1a692c-8a00-4f9b-9bd0-dd1c5af084e7-kube-api-access-hgt49\") pod \"managed-serviceaccount-addon-agent-7f9676bd56-sr6kx\" (UID: \"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.658974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.658941 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db1a692c-8a00-4f9b-9bd0-dd1c5af084e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9676bd56-sr6kx\" (UID: \"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.658974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.658976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgt49\" (UniqueName: \"kubernetes.io/projected/db1a692c-8a00-4f9b-9bd0-dd1c5af084e7-kube-api-access-hgt49\") pod \"managed-serviceaccount-addon-agent-7f9676bd56-sr6kx\" (UID: \"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.661562 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.661532 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db1a692c-8a00-4f9b-9bd0-dd1c5af084e7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f9676bd56-sr6kx\" (UID: \"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.669974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.669950 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgt49\" (UniqueName: \"kubernetes.io/projected/db1a692c-8a00-4f9b-9bd0-dd1c5af084e7-kube-api-access-hgt49\") pod \"managed-serviceaccount-addon-agent-7f9676bd56-sr6kx\" (UID: \"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.798111 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.798014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" Jun 12 16:41:37.933251 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.933221 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx"] Jun 12 16:41:37.936573 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:41:37.936548 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb1a692c_8a00_4f9b_9bd0_dd1c5af084e7.slice/crio-4cf946562ed8eed27570e066852af5f153cfb68ac75c3c74594bce849ea1376c WatchSource:0}: Error finding container 4cf946562ed8eed27570e066852af5f153cfb68ac75c3c74594bce849ea1376c: Status 404 returned error can't find the container with id 4cf946562ed8eed27570e066852af5f153cfb68ac75c3c74594bce849ea1376c Jun 12 16:41:37.968884 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:37.968850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" event={"ID":"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7","Type":"ContainerStarted","Data":"4cf946562ed8eed27570e066852af5f153cfb68ac75c3c74594bce849ea1376c"} Jun 12 16:41:40.978265 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:40.978227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" event={"ID":"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7","Type":"ContainerStarted","Data":"af93a82f9dceb6f9c166764c7761d0b944e6f2efa0964f47762fdef59cd70fed"} Jun 12 16:41:40.999913 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:41:40.999859 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" podStartSLOduration=1.459907921 podStartE2EDuration="3.999841506s" totalImagesPullingTime="2.539933585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:41:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:41:40.999457301 +0000 UTC m=+77.907111175" watchObservedRunningTime="2026-06-12 16:41:40.999841506 +0000 UTC m=+77.907495382" Jun 12 16:42:02.331151 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:42:02.331114 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:42:02.331617 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:42:02.331231 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:42:02.331617 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:42:02.331281 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:43:06.331268188 +0000 UTC m=+163.238922040 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:42:05.966321 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:42:05.966286 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rxzhf" Jun 12 16:42:33.345395 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:42:33.345351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:42:33.345969 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:42:33.345478 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 16:42:33.345969 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:42:33.345540 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs podName:03f380ca-e643-4b86-b4e3-12a5594247d3 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:35.345526685 +0000 UTC m=+252.253180541 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs") pod "network-metrics-daemon-6xxnl" (UID: "03f380ca-e643-4b86-b4e3-12a5594247d3") : secret "metrics-daemon-secret" not found Jun 12 16:43:01.513925 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:43:01.513881 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xblzg" podUID="fb483be5-b961-4528-ab86-1e36cac7c5cb" Jun 12 16:43:02.174603 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:43:02.174576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblzg" Jun 12 16:43:02.601456 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:43:02.601407 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6xxnl" podUID="03f380ca-e643-4b86-b4e3-12a5594247d3" Jun 12 16:43:06.366486 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:43:06.366427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:43:06.366968 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:43:06.366560 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 16:43:06.366968 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:43:06.366612 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls podName:fb483be5-b961-4528-ab86-1e36cac7c5cb nodeName:}" failed. No retries permitted until 2026-06-12 16:45:08.366599018 +0000 UTC m=+285.274252871 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls") pod "dns-default-xblzg" (UID: "fb483be5-b961-4528-ab86-1e36cac7c5cb") : secret "dns-default-metrics-tls" not found Jun 12 16:43:16.577399 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:43:16.577305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:43:41.268643 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:43:41.268613 2581 generic.go:356] "Generic (PLEG): container finished" podID="db1a692c-8a00-4f9b-9bd0-dd1c5af084e7" containerID="af93a82f9dceb6f9c166764c7761d0b944e6f2efa0964f47762fdef59cd70fed" exitCode=255 Jun 12 16:43:41.269081 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:43:41.268670 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" event={"ID":"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7","Type":"ContainerDied","Data":"af93a82f9dceb6f9c166764c7761d0b944e6f2efa0964f47762fdef59cd70fed"} Jun 12 16:43:41.274176 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:43:41.274157 2581 scope.go:117] "RemoveContainer" containerID="af93a82f9dceb6f9c166764c7761d0b944e6f2efa0964f47762fdef59cd70fed" Jun 12 16:43:42.273316 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:43:42.273279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f9676bd56-sr6kx" event={"ID":"db1a692c-8a00-4f9b-9bd0-dd1c5af084e7","Type":"ContainerStarted","Data":"005299839ec57f3d1607bb55141dbb4ad8540f01b635cc4b9f8fbd67391c4bb8"} Jun 12 16:44:16.085087 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.085050 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57d4f45d48-gpxzd"] Jun 12 16:44:16.087880 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.087850 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59895dc9c7-cc7qc"] Jun 12 16:44:16.088027 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.087981 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.090761 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.090740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.091639 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.091619 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 16:44:16.092089 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.092058 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 12 16:44:16.092188 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.092124 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 12 16:44:16.092188 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.092152 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7rtkn\"" Jun 12 16:44:16.092347 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.092334 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 16:44:16.092711 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.092693 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 12 16:44:16.092847 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.092832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 12 16:44:16.095429 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.095402 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 16:44:16.095707 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.095684 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 16:44:16.096238 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.096220 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bpjl4\"" Jun 12 16:44:16.097056 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.097039 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 16:44:16.102101 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.102085 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 16:44:16.107600 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.107580 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57d4f45d48-gpxzd"] Jun 12 16:44:16.108353 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.108332 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59895dc9c7-cc7qc"] Jun 12 16:44:16.178241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.178211 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z"] Jun 12 16:44:16.181112 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.181093 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.182501 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.182478 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs"] Jun 12 16:44:16.184458 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.184437 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 16:44:16.185167 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.185151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.186478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.186457 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mmx7l\"" Jun 12 16:44:16.186561 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.186461 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 12 16:44:16.186805 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.186463 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 12 16:44:16.187144 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.187108 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 16:44:16.188368 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.188338 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 12 16:44:16.188521 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.188479 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sm7hk\"" Jun 12 16:44:16.188921 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.188898 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 12 16:44:16.189075 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.189060 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 12 16:44:16.189232 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.189210 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 12 16:44:16.199699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.199670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z"] Jun 12 16:44:16.202311 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.202273 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs"] Jun 12 16:44:16.237486 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-registry-certificates\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.237486 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlt8b\" (UniqueName: \"kubernetes.io/projected/20a544b6-7432-42e2-9673-9b914b892566-kube-api-access-mlt8b\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.237732 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-stats-auth\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.237732 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.237732 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmrr8\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-kube-api-access-vmrr8\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.237732 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-default-certificate\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.237732 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.237732 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.237937 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-trusted-ca\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.237937 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-bound-sa-token\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.237937 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-image-registry-private-configuration\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.237937 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d520558-e92c-4931-9ccd-6886bac889ac-ca-trust-extracted\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.237937 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.237876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-installation-pull-secrets\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.338241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc170850-ec5b-4f31-93ea-24edfbae4631-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.338241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.338241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.338241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-bound-sa-token\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-image-registry-private-configuration\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4nq\" (UniqueName: \"kubernetes.io/projected/bc170850-ec5b-4f31-93ea-24edfbae4631-kube-api-access-px4nq\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8546d81f-170b-465b-a588-b1a5d4fdc6a8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlt8b\" (UniqueName: \"kubernetes.io/projected/20a544b6-7432-42e2-9673-9b914b892566-kube-api-access-mlt8b\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.338307 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-stats-auth\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.338358 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:16.83833613 +0000 UTC m=+233.745989996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : configmap references non-existent config key: service-ca.crt Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.338393 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:16.838382162 +0000 UTC m=+233.746036028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : secret "router-metrics-certs-default" not found Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.338416 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.338429 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59895dc9c7-cc7qc: secret "image-registry-tls" not found Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338434 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.338479 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls podName:2d520558-e92c-4931-9ccd-6886bac889ac nodeName:}" failed. No retries permitted until 2026-06-12 16:44:16.838463953 +0000 UTC m=+233.746117807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls") pod "image-registry-59895dc9c7-cc7qc" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac") : secret "image-registry-tls" not found Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-trusted-ca\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.338575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d520558-e92c-4931-9ccd-6886bac889ac-ca-trust-extracted\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc170850-ec5b-4f31-93ea-24edfbae4631-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-registry-certificates\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h522\" (UniqueName: \"kubernetes.io/projected/8546d81f-170b-465b-a588-b1a5d4fdc6a8-kube-api-access-6h522\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmrr8\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-kube-api-access-vmrr8\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-default-certificate\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-installation-pull-secrets\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.338942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d520558-e92c-4931-9ccd-6886bac889ac-ca-trust-extracted\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.339401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-registry-certificates\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.339575 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.339569 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-trusted-ca\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.341073 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.341051 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-stats-auth\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.341180 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.341140 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-image-registry-private-configuration\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.341654 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.341629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-installation-pull-secrets\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.341739 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.341670 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-default-certificate\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.347958 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.347936 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-bound-sa-token\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.348652 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.348630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmrr8\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-kube-api-access-vmrr8\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.349363 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.349340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlt8b\" (UniqueName: \"kubernetes.io/projected/20a544b6-7432-42e2-9673-9b914b892566-kube-api-access-mlt8b\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.439505 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.439465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.439712 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.439521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc170850-ec5b-4f31-93ea-24edfbae4631-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.439712 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.439616 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:16.439712 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.439633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h522\" (UniqueName: \"kubernetes.io/projected/8546d81f-170b-465b-a588-b1a5d4fdc6a8-kube-api-access-6h522\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.439712 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.439673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc170850-ec5b-4f31-93ea-24edfbae4631-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.439712 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.439688 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls podName:8546d81f-170b-465b-a588-b1a5d4fdc6a8 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:16.939668736 +0000 UTC m=+233.847322610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-6m46z" (UID: "8546d81f-170b-465b-a588-b1a5d4fdc6a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:16.439980 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.439793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4nq\" (UniqueName: \"kubernetes.io/projected/bc170850-ec5b-4f31-93ea-24edfbae4631-kube-api-access-px4nq\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.439980 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.439822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8546d81f-170b-465b-a588-b1a5d4fdc6a8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.440283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.440261 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc170850-ec5b-4f31-93ea-24edfbae4631-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.440507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.440487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8546d81f-170b-465b-a588-b1a5d4fdc6a8-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.441966 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.441947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc170850-ec5b-4f31-93ea-24edfbae4631-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.450986 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.450962 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4nq\" (UniqueName: \"kubernetes.io/projected/bc170850-ec5b-4f31-93ea-24edfbae4631-kube-api-access-px4nq\") pod \"kube-storage-version-migrator-operator-7c578b78fc-vsbrs\" (UID: \"bc170850-ec5b-4f31-93ea-24edfbae4631\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.451413 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.451396 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h522\" (UniqueName: \"kubernetes.io/projected/8546d81f-170b-465b-a588-b1a5d4fdc6a8-kube-api-access-6h522\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.497661 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.497628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" Jun 12 16:44:16.625090 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.624957 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs"] Jun 12 16:44:16.628370 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:16.628345 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc170850_ec5b_4f31_93ea_24edfbae4631.slice/crio-af116ce4780252b7eb26e31fa33b188404b0247b77a74cf970bf70464fbf9c58 WatchSource:0}: Error finding container af116ce4780252b7eb26e31fa33b188404b0247b77a74cf970bf70464fbf9c58: Status 404 returned error can't find the container with id af116ce4780252b7eb26e31fa33b188404b0247b77a74cf970bf70464fbf9c58 Jun 12 16:44:16.844168 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.844128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.844168 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.844166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:16.844388 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.844195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:16.844388 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.844283 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 16:44:16.844388 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.844301 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:17.844285761 +0000 UTC m=+234.751939616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : configmap references non-existent config key: service-ca.crt Jun 12 16:44:16.844388 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.844341 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:17.84432868 +0000 UTC m=+234.751982534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : secret "router-metrics-certs-default" not found Jun 12 16:44:16.844388 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.844361 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 16:44:16.844388 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.844371 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59895dc9c7-cc7qc: secret "image-registry-tls" not found Jun 12 16:44:16.844589 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.844408 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls podName:2d520558-e92c-4931-9ccd-6886bac889ac nodeName:}" failed. No retries permitted until 2026-06-12 16:44:17.844398144 +0000 UTC m=+234.752052001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls") pod "image-registry-59895dc9c7-cc7qc" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac") : secret "image-registry-tls" not found Jun 12 16:44:16.945127 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:16.945095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:16.945282 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.945259 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:16.945340 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:16.945329 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls podName:8546d81f-170b-465b-a588-b1a5d4fdc6a8 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:17.945315574 +0000 UTC m=+234.852969430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-6m46z" (UID: "8546d81f-170b-465b-a588-b1a5d4fdc6a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:17.359863 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:17.359782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" event={"ID":"bc170850-ec5b-4f31-93ea-24edfbae4631","Type":"ContainerStarted","Data":"af116ce4780252b7eb26e31fa33b188404b0247b77a74cf970bf70464fbf9c58"} Jun 12 16:44:17.853406 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:17.853367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:17.853406 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:17.853406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:17.853667 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:17.853456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:17.853667 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.853530 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 16:44:17.853667 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.853564 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 16:44:17.853667 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.853580 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59895dc9c7-cc7qc: secret "image-registry-tls" not found Jun 12 16:44:17.853667 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.853533 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:19.85351077 +0000 UTC m=+236.761164624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : configmap references non-existent config key: service-ca.crt Jun 12 16:44:17.853667 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.853611 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:19.853594372 +0000 UTC m=+236.761248240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : secret "router-metrics-certs-default" not found Jun 12 16:44:17.853667 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.853629 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls podName:2d520558-e92c-4931-9ccd-6886bac889ac nodeName:}" failed. No retries permitted until 2026-06-12 16:44:19.853617384 +0000 UTC m=+236.761271241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls") pod "image-registry-59895dc9c7-cc7qc" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac") : secret "image-registry-tls" not found Jun 12 16:44:17.954276 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:17.954236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:17.954449 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.954384 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:17.954449 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:17.954449 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls podName:8546d81f-170b-465b-a588-b1a5d4fdc6a8 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:19.954434019 +0000 UTC m=+236.862087874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-6m46z" (UID: "8546d81f-170b-465b-a588-b1a5d4fdc6a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:19.367265 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:19.367228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" event={"ID":"bc170850-ec5b-4f31-93ea-24edfbae4631","Type":"ContainerStarted","Data":"e726f9f6a0da721943c9ee2c4101c7129b307c7b5a2842937cf4ca61fb079c27"} Jun 12 16:44:19.385275 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:19.385224 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" podStartSLOduration=0.819928096 podStartE2EDuration="3.385203694s" totalImagesPullingTime="2.565275598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:44:19.385080709 +0000 UTC m=+236.292734616" watchObservedRunningTime="2026-06-12 16:44:19.385203694 +0000 UTC m=+236.292857551" Jun 12 16:44:19.872116 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:19.872065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:19.872322 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:19.872182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:19.872322 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:19.872200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:19.872322 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.872224 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 16:44:19.872322 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.872248 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59895dc9c7-cc7qc: secret "image-registry-tls" not found Jun 12 16:44:19.872322 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.872284 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 16:44:19.872322 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.872317 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls podName:2d520558-e92c-4931-9ccd-6886bac889ac nodeName:}" failed. No retries permitted until 2026-06-12 16:44:23.872297829 +0000 UTC m=+240.779951682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls") pod "image-registry-59895dc9c7-cc7qc" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac") : secret "image-registry-tls" not found Jun 12 16:44:19.872535 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.872333 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:23.872326723 +0000 UTC m=+240.779980576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : configmap references non-existent config key: service-ca.crt Jun 12 16:44:19.872535 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.872344 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:23.872338563 +0000 UTC m=+240.779992416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : secret "router-metrics-certs-default" not found Jun 12 16:44:19.973477 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:19.973436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:19.973640 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.973596 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:19.973687 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:19.973679 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls podName:8546d81f-170b-465b-a588-b1a5d4fdc6a8 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:23.973662622 +0000 UTC m=+240.881316475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-6m46z" (UID: "8546d81f-170b-465b-a588-b1a5d4fdc6a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:21.617266 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.617232 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cnwn2"] Jun 12 16:44:21.620073 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.620052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.623513 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.623492 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 16:44:21.623631 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.623553 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 16:44:21.623631 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.623565 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5rwrv\"" Jun 12 16:44:21.624872 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.624856 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 16:44:21.624975 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.624862 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 16:44:21.638396 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.638374 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cnwn2"] Jun 12 16:44:21.788268 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.788225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-data-volume\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.788268 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.788266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.788499 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.788352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.788499 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.788424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-469jz\" (UniqueName: \"kubernetes.io/projected/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-api-access-469jz\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.788499 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.788449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-crio-socket\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.889830 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.889738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-469jz\" (UniqueName: \"kubernetes.io/projected/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-api-access-469jz\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.889830 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.889782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-crio-socket\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.890056 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.889852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-crio-socket\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.890056 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.889940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-data-volume\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.890056 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.889968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.890056 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.890028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.890195 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:21.890108 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 16:44:21.890195 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:21.890137 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 16:44:21.890195 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:21.890172 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:22.390152943 +0000 UTC m=+239.297806810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : secret "insights-runtime-extractor-tls" not found Jun 12 16:44:21.890195 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:21.890187 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:22.39017985 +0000 UTC m=+239.297833706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : configmap "kube-rbac-proxy" not found Jun 12 16:44:21.890342 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.890255 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-data-volume\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:21.898886 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:21.898862 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-469jz\" (UniqueName: \"kubernetes.io/projected/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-api-access-469jz\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:22.394436 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:22.394407 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:22.394609 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:22.394508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:22.394609 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:22.394528 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 16:44:22.394609 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:22.394584 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:23.39456913 +0000 UTC m=+240.302222984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : configmap "kube-rbac-proxy" not found Jun 12 16:44:22.394609 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:22.394592 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 16:44:22.394760 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:22.394630 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:23.394618998 +0000 UTC m=+240.302272856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : secret "insights-runtime-extractor-tls" not found Jun 12 16:44:23.402840 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.402808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:23.403295 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.402853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:23.403295 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.402960 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 16:44:23.403295 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.402978 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 16:44:23.403295 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.403036 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:25.40301873 +0000 UTC m=+242.310672594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : configmap "kube-rbac-proxy" not found Jun 12 16:44:23.403295 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.403063 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:25.403045077 +0000 UTC m=+242.310698939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : secret "insights-runtime-extractor-tls" not found Jun 12 16:44:23.653846 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.653764 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-44wrh"] Jun 12 16:44:23.656835 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.656818 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.659581 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.659560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 12 16:44:23.659686 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.659560 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 12 16:44:23.661065 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.661040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-l4dtm\"" Jun 12 16:44:23.661168 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.661085 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 12 16:44:23.661168 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.661042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 12 16:44:23.665355 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.665334 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-44wrh"] Jun 12 16:44:23.806240 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.806208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e80f17c-5120-4869-b7b7-c18d4f130aa6-signing-key\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.806509 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.806489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzv7\" (UniqueName: \"kubernetes.io/projected/0e80f17c-5120-4869-b7b7-c18d4f130aa6-kube-api-access-zhzv7\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.806806 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.806789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e80f17c-5120-4869-b7b7-c18d4f130aa6-signing-cabundle\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.907538 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.907452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:23.907538 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.907497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e80f17c-5120-4869-b7b7-c18d4f130aa6-signing-key\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.907538 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.907517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzv7\" (UniqueName: \"kubernetes.io/projected/0e80f17c-5120-4869-b7b7-c18d4f130aa6-kube-api-access-zhzv7\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.907792 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.907608 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 16:44:23.907792 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.907630 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59895dc9c7-cc7qc: secret "image-registry-tls" not found Jun 12 16:44:23.907792 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.907610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:23.907792 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.907699 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls podName:2d520558-e92c-4931-9ccd-6886bac889ac nodeName:}" failed. No retries permitted until 2026-06-12 16:44:31.907683677 +0000 UTC m=+248.815337533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls") pod "image-registry-59895dc9c7-cc7qc" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac") : secret "image-registry-tls" not found Jun 12 16:44:23.907792 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.907713 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:31.907706961 +0000 UTC m=+248.815360814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : configmap references non-existent config key: service-ca.crt Jun 12 16:44:23.907792 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.907731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:23.907792 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.907777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e80f17c-5120-4869-b7b7-c18d4f130aa6-signing-cabundle\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.908120 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.907899 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 16:44:23.908120 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:23.907969 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:31.907950999 +0000 UTC m=+248.815604866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : secret "router-metrics-certs-default" not found Jun 12 16:44:23.908429 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.908412 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e80f17c-5120-4869-b7b7-c18d4f130aa6-signing-cabundle\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.909987 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.909970 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e80f17c-5120-4869-b7b7-c18d4f130aa6-signing-key\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.916191 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.916168 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzv7\" (UniqueName: \"kubernetes.io/projected/0e80f17c-5120-4869-b7b7-c18d4f130aa6-kube-api-access-zhzv7\") pod \"service-ca-7b994bc59-44wrh\" (UID: \"0e80f17c-5120-4869-b7b7-c18d4f130aa6\") " pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:23.966239 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:23.966186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-44wrh" Jun 12 16:44:24.008367 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:24.008336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:24.008562 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:24.008502 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:24.008631 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:24.008576 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls podName:8546d81f-170b-465b-a588-b1a5d4fdc6a8 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:32.008556524 +0000 UTC m=+248.916210377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-6m46z" (UID: "8546d81f-170b-465b-a588-b1a5d4fdc6a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:24.092077 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:24.092053 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-44wrh"] Jun 12 16:44:24.094320 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:24.094293 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e80f17c_5120_4869_b7b7_c18d4f130aa6.slice/crio-bf8962d09490749174362119724039fb4cbb4c022410172a2553762fc2a36719 WatchSource:0}: Error finding container bf8962d09490749174362119724039fb4cbb4c022410172a2553762fc2a36719: Status 404 returned error can't find the container with id bf8962d09490749174362119724039fb4cbb4c022410172a2553762fc2a36719 Jun 12 16:44:24.383498 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:24.383464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-44wrh" event={"ID":"0e80f17c-5120-4869-b7b7-c18d4f130aa6","Type":"ContainerStarted","Data":"bf8962d09490749174362119724039fb4cbb4c022410172a2553762fc2a36719"} Jun 12 16:44:24.598853 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:24.598818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcmt4_bc37f869-dbb7-4783-9585-b26792ad94fb/dns-node-resolver/0.log" Jun 12 16:44:25.397380 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:25.397347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8zx6d_2ea67727-e38c-4eae-b7b3-28a9b15ee2e8/node-ca/0.log" Jun 12 16:44:25.422959 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:25.422927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:25.423158 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:25.423061 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 16:44:25.423158 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:25.423098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:25.423158 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:25.423121 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:29.423106005 +0000 UTC m=+246.330759858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : configmap "kube-rbac-proxy" not found Jun 12 16:44:25.423315 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:25.423188 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 16:44:25.423315 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:25.423246 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:29.423229923 +0000 UTC m=+246.330883792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : secret "insights-runtime-extractor-tls" not found Jun 12 16:44:26.391601 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:26.391563 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-44wrh" event={"ID":"0e80f17c-5120-4869-b7b7-c18d4f130aa6","Type":"ContainerStarted","Data":"20c5cf51e90665ae84d8b4ab465e5d396dd63b8ecee95c4e96df2f9f7987c977"} Jun 12 16:44:26.396726 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:26.396709 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnzfn_bbf2f977-24b5-4d8b-9e04-399cb8b600a8/serve-healthcheck-canary/0.log" Jun 12 16:44:26.409149 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:26.409091 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-44wrh" podStartSLOduration=1.179365893 podStartE2EDuration="3.409071113s" totalImagesPullingTime="2.22970522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:44:26.407250527 +0000 UTC m=+243.314904432" watchObservedRunningTime="2026-06-12 16:44:26.409071113 +0000 UTC m=+243.316724991" Jun 12 16:44:26.998799 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:26.998756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-vsbrs_bc170850-ec5b-4f31-93ea-24edfbae4631/kube-storage-version-migrator-operator/0.log" Jun 12 16:44:29.458678 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:29.458632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:29.459126 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:29.458752 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 16:44:29.459126 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:29.458806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:29.459126 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:29.458822 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:37.458800896 +0000 UTC m=+254.366454751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : configmap "kube-rbac-proxy" not found Jun 12 16:44:29.459126 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:29.458912 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 16:44:29.459126 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:29.458968 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:37.458952541 +0000 UTC m=+254.366606405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : secret "insights-runtime-extractor-tls" not found Jun 12 16:44:31.979889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:31.979842 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:31.979889 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:31.979878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:31.980392 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:31.979926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:31.980392 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:31.980044 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:47.980024341 +0000 UTC m=+264.887678197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : configmap references non-existent config key: service-ca.crt Jun 12 16:44:31.980392 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:31.980084 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 12 16:44:31.980392 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:31.980158 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs podName:20a544b6-7432-42e2-9673-9b914b892566 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:47.980143669 +0000 UTC m=+264.887797525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs") pod "router-default-57d4f45d48-gpxzd" (UID: "20a544b6-7432-42e2-9673-9b914b892566") : secret "router-metrics-certs-default" not found Jun 12 16:44:31.982518 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:31.982497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"image-registry-59895dc9c7-cc7qc\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:32.006583 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.006555 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bpjl4\"" Jun 12 16:44:32.014028 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.013984 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:32.080956 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.080660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:32.080956 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:32.080952 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:32.081210 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:32.081149 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls podName:8546d81f-170b-465b-a588-b1a5d4fdc6a8 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:48.081126518 +0000 UTC m=+264.988780376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-6m46z" (UID: "8546d81f-170b-465b-a588-b1a5d4fdc6a8") : secret "cluster-monitoring-operator-tls" not found Jun 12 16:44:32.145756 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.145731 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59895dc9c7-cc7qc"] Jun 12 16:44:32.148034 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:32.147987 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d520558_e92c_4931_9ccd_6886bac889ac.slice/crio-2d3049f281e0c4de37ee6d27d0e38c1093184b649a1c7a43fbe297d2d2956fad WatchSource:0}: Error finding container 2d3049f281e0c4de37ee6d27d0e38c1093184b649a1c7a43fbe297d2d2956fad: Status 404 returned error can't find the container with id 2d3049f281e0c4de37ee6d27d0e38c1093184b649a1c7a43fbe297d2d2956fad Jun 12 16:44:32.413436 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.413335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" event={"ID":"2d520558-e92c-4931-9ccd-6886bac889ac","Type":"ContainerStarted","Data":"37c47ebfc0ed81a3030ef7fa74b87b1ddec1490218a82f1e8748f23433f141cd"} Jun 12 16:44:32.413436 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.413391 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" event={"ID":"2d520558-e92c-4931-9ccd-6886bac889ac","Type":"ContainerStarted","Data":"2d3049f281e0c4de37ee6d27d0e38c1093184b649a1c7a43fbe297d2d2956fad"} Jun 12 16:44:32.413631 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.413469 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:44:32.450640 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:32.450588 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" podStartSLOduration=16.450570085 podStartE2EDuration="16.450570085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:44:32.449349761 +0000 UTC m=+249.357003674" watchObservedRunningTime="2026-06-12 16:44:32.450570085 +0000 UTC m=+249.358223959" Jun 12 16:44:35.408903 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:35.408865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:44:35.411313 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:35.411284 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03f380ca-e643-4b86-b4e3-12a5594247d3-metrics-certs\") pod \"network-metrics-daemon-6xxnl\" (UID: \"03f380ca-e643-4b86-b4e3-12a5594247d3\") " pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:44:35.480927 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:35.480896 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7ztv6\"" Jun 12 16:44:35.488432 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:35.488414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xxnl" Jun 12 16:44:35.616438 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:35.616408 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xxnl"] Jun 12 16:44:35.619881 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:35.619850 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f380ca_e643_4b86_b4e3_12a5594247d3.slice/crio-a769e8d43cad0d8f886814e12aaa6e60db41b27f65e4de77dc54e65db404d86f WatchSource:0}: Error finding container a769e8d43cad0d8f886814e12aaa6e60db41b27f65e4de77dc54e65db404d86f: Status 404 returned error can't find the container with id a769e8d43cad0d8f886814e12aaa6e60db41b27f65e4de77dc54e65db404d86f Jun 12 16:44:36.429611 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:36.429516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xxnl" event={"ID":"03f380ca-e643-4b86-b4e3-12a5594247d3","Type":"ContainerStarted","Data":"a769e8d43cad0d8f886814e12aaa6e60db41b27f65e4de77dc54e65db404d86f"} Jun 12 16:44:37.434624 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:37.434589 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xxnl" event={"ID":"03f380ca-e643-4b86-b4e3-12a5594247d3","Type":"ContainerStarted","Data":"6057ee9f95af8d13491ff9b60ccea2af8f74cb0980f36d1540c7ee07983872d6"} Jun 12 16:44:37.435059 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:37.434647 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xxnl" event={"ID":"03f380ca-e643-4b86-b4e3-12a5594247d3","Type":"ContainerStarted","Data":"8865b85be030693f34b52412c717f138d4f7d84c95ce1a06dd7af55960d854ab"} Jun 12 16:44:37.454755 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:37.454693 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6xxnl" podStartSLOduration=253.430774577 podStartE2EDuration="4m14.45467198s" totalImagesPullingTime="1.023897403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:44:37.454448705 +0000 UTC m=+254.362102604" watchObservedRunningTime="2026-06-12 16:44:37.45467198 +0000 UTC m=+254.362325856" Jun 12 16:44:37.526845 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:37.526802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:37.527068 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:37.526853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:37.527068 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:37.526974 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 16:44:37.527156 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:37.527117 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls podName:6bda7d37-6d62-42e8-a3af-8f9f83d7749e nodeName:}" failed. No retries permitted until 2026-06-12 16:44:53.527093841 +0000 UTC m=+270.434747708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cnwn2" (UID: "6bda7d37-6d62-42e8-a3af-8f9f83d7749e") : secret "insights-runtime-extractor-tls" not found Jun 12 16:44:37.527476 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:37.527455 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:45.197839 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:45.197759 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59895dc9c7-cc7qc"] Jun 12 16:44:48.015150 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.015108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:48.015150 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.015149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:48.015752 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.015731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20a544b6-7432-42e2-9673-9b914b892566-service-ca-bundle\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:48.017666 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.017644 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20a544b6-7432-42e2-9673-9b914b892566-metrics-certs\") pod \"router-default-57d4f45d48-gpxzd\" (UID: \"20a544b6-7432-42e2-9673-9b914b892566\") " pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:48.116359 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.116319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:48.119078 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.119045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8546d81f-170b-465b-a588-b1a5d4fdc6a8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-6m46z\" (UID: \"8546d81f-170b-465b-a588-b1a5d4fdc6a8\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:48.201085 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.201036 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7rtkn\"" Jun 12 16:44:48.208543 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.208518 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:48.297285 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.297255 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mmx7l\"" Jun 12 16:44:48.303804 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.303780 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" Jun 12 16:44:48.367184 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.367098 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57d4f45d48-gpxzd"] Jun 12 16:44:48.371630 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:48.371596 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a544b6_7432_42e2_9673_9b914b892566.slice/crio-0b46495f8d0c346ca0db29096ed266cea03dbfcdbe86b75761b2955cf80790fe WatchSource:0}: Error finding container 0b46495f8d0c346ca0db29096ed266cea03dbfcdbe86b75761b2955cf80790fe: Status 404 returned error can't find the container with id 0b46495f8d0c346ca0db29096ed266cea03dbfcdbe86b75761b2955cf80790fe Jun 12 16:44:48.439726 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.439698 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z"] Jun 12 16:44:48.443689 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:48.443661 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8546d81f_170b_465b_a588_b1a5d4fdc6a8.slice/crio-4c58df0cb588eb711a6d37b874f81b0510c4316c15f9abd497f0d4a3f6604b72 WatchSource:0}: Error finding container 4c58df0cb588eb711a6d37b874f81b0510c4316c15f9abd497f0d4a3f6604b72: Status 404 returned error can't find the container with id 4c58df0cb588eb711a6d37b874f81b0510c4316c15f9abd497f0d4a3f6604b72 Jun 12 16:44:48.468507 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.467895 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" event={"ID":"8546d81f-170b-465b-a588-b1a5d4fdc6a8","Type":"ContainerStarted","Data":"4c58df0cb588eb711a6d37b874f81b0510c4316c15f9abd497f0d4a3f6604b72"} Jun 12 16:44:48.469664 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.469640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" event={"ID":"20a544b6-7432-42e2-9673-9b914b892566","Type":"ContainerStarted","Data":"3583adfb06d4b2f932d466eaf96cd5a510558ab703c5a68a9c8df822e65de796"} Jun 12 16:44:48.469804 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.469691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" event={"ID":"20a544b6-7432-42e2-9673-9b914b892566","Type":"ContainerStarted","Data":"0b46495f8d0c346ca0db29096ed266cea03dbfcdbe86b75761b2955cf80790fe"} Jun 12 16:44:48.489820 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:48.489764 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" podStartSLOduration=32.48974387 podStartE2EDuration="32.48974387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:44:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:44:48.488844302 +0000 UTC m=+265.396498196" watchObservedRunningTime="2026-06-12 16:44:48.48974387 +0000 UTC m=+265.397397745" Jun 12 16:44:49.209651 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:49.209610 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:49.212126 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:49.212105 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:49.473190 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:49.473109 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:49.474349 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:49.474327 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57d4f45d48-gpxzd" Jun 12 16:44:51.008166 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.008134 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk"] Jun 12 16:44:51.011071 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.011056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:51.013632 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.013612 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 12 16:44:51.013760 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.013641 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xwt94\"" Jun 12 16:44:51.020548 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.020525 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk"] Jun 12 16:44:51.142570 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.142525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f967ae75-0d87-4be7-b50a-c143e7591645-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-k2tkk\" (UID: \"f967ae75-0d87-4be7-b50a-c143e7591645\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:51.243906 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.243870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f967ae75-0d87-4be7-b50a-c143e7591645-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-k2tkk\" (UID: \"f967ae75-0d87-4be7-b50a-c143e7591645\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:51.244073 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:51.244041 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 12 16:44:51.244131 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:51.244105 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f967ae75-0d87-4be7-b50a-c143e7591645-tls-certificates podName:f967ae75-0d87-4be7-b50a-c143e7591645 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:51.744090458 +0000 UTC m=+268.651744316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f967ae75-0d87-4be7-b50a-c143e7591645-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-k2tkk" (UID: "f967ae75-0d87-4be7-b50a-c143e7591645") : secret "prometheus-operator-admission-webhook-tls" not found Jun 12 16:44:51.480208 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.480168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" event={"ID":"8546d81f-170b-465b-a588-b1a5d4fdc6a8","Type":"ContainerStarted","Data":"614334cd47d40edc0ec70bc6f31e11e7f8fde23366652ae38c585444201dcfb5"} Jun 12 16:44:51.499774 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.499722 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" podStartSLOduration=33.394521322 podStartE2EDuration="35.499706798s" totalImagesPullingTime="2.105185476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:44:51.497591704 +0000 UTC m=+268.405245578" watchObservedRunningTime="2026-06-12 16:44:51.499706798 +0000 UTC m=+268.407360672" Jun 12 16:44:51.748907 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.748819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f967ae75-0d87-4be7-b50a-c143e7591645-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-k2tkk\" (UID: \"f967ae75-0d87-4be7-b50a-c143e7591645\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:51.751276 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.751250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f967ae75-0d87-4be7-b50a-c143e7591645-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-k2tkk\" (UID: \"f967ae75-0d87-4be7-b50a-c143e7591645\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:51.921588 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:51.921543 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:52.049842 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:52.049808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk"] Jun 12 16:44:52.052594 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:52.052559 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf967ae75_0d87_4be7_b50a_c143e7591645.slice/crio-1048fc9d12eed648ef7c78b3e7975f4db0a9ba608ef5f41b964d489c80d09afd WatchSource:0}: Error finding container 1048fc9d12eed648ef7c78b3e7975f4db0a9ba608ef5f41b964d489c80d09afd: Status 404 returned error can't find the container with id 1048fc9d12eed648ef7c78b3e7975f4db0a9ba608ef5f41b964d489c80d09afd Jun 12 16:44:52.484576 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:52.484528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" event={"ID":"f967ae75-0d87-4be7-b50a-c143e7591645","Type":"ContainerStarted","Data":"1048fc9d12eed648ef7c78b3e7975f4db0a9ba608ef5f41b964d489c80d09afd"} Jun 12 16:44:53.488758 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.488723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" event={"ID":"f967ae75-0d87-4be7-b50a-c143e7591645","Type":"ContainerStarted","Data":"cc73937ecf66392cd4f90b31ba2b2ed3dabd24c10e8e25daec19dd6c176ea3c7"} Jun 12 16:44:53.489281 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.488933 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:53.493120 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.493095 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" Jun 12 16:44:53.507817 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.507777 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-k2tkk" podStartSLOduration=2.431188313 podStartE2EDuration="3.507766768s" totalImagesPullingTime="1.076578455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:44:53.506211332 +0000 UTC m=+270.413865206" watchObservedRunningTime="2026-06-12 16:44:53.507766768 +0000 UTC m=+270.415420643" Jun 12 16:44:53.568224 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.568193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:53.570519 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.570497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6bda7d37-6d62-42e8-a3af-8f9f83d7749e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cnwn2\" (UID: \"6bda7d37-6d62-42e8-a3af-8f9f83d7749e\") " pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:53.731250 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.731212 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5rwrv\"" Jun 12 16:44:53.738595 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.738576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cnwn2" Jun 12 16:44:53.883040 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:53.882984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cnwn2"] Jun 12 16:44:53.885771 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:53.885742 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bda7d37_6d62_42e8_a3af_8f9f83d7749e.slice/crio-a96ea9b1cd635df4acb93e786a67c7c7a26fe86c7315277e3e23d7a9603f963d WatchSource:0}: Error finding container a96ea9b1cd635df4acb93e786a67c7c7a26fe86c7315277e3e23d7a9603f963d: Status 404 returned error can't find the container with id a96ea9b1cd635df4acb93e786a67c7c7a26fe86c7315277e3e23d7a9603f963d Jun 12 16:44:54.063303 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.063222 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw"] Jun 12 16:44:54.067565 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.067549 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.070441 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.070417 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 16:44:54.070441 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.070439 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 16:44:54.070612 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.070586 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dqmkp\"" Jun 12 16:44:54.070754 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.070737 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 16:44:54.076299 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.076276 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw"] Jun 12 16:44:54.173727 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.173690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eceb6aaf-47af-4caf-8cf7-f208db832f19-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.173904 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.173735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.173904 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.173761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.173904 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.173829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp68h\" (UniqueName: \"kubernetes.io/projected/eceb6aaf-47af-4caf-8cf7-f208db832f19-kube-api-access-vp68h\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.275435 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.274797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eceb6aaf-47af-4caf-8cf7-f208db832f19-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.275435 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.274857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.275435 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.274884 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.275435 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.274944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp68h\" (UniqueName: \"kubernetes.io/projected/eceb6aaf-47af-4caf-8cf7-f208db832f19-kube-api-access-vp68h\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.275435 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:54.275113 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 12 16:44:54.275435 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:54.275184 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls podName:eceb6aaf-47af-4caf-8cf7-f208db832f19 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:54.775162859 +0000 UTC m=+271.682816734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-26rrw" (UID: "eceb6aaf-47af-4caf-8cf7-f208db832f19") : secret "prometheus-operator-tls" not found Jun 12 16:44:54.275946 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.275921 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eceb6aaf-47af-4caf-8cf7-f208db832f19-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.280286 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.280086 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.286704 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.286673 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp68h\" (UniqueName: \"kubernetes.io/projected/eceb6aaf-47af-4caf-8cf7-f208db832f19-kube-api-access-vp68h\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.497407 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.497369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnwn2" event={"ID":"6bda7d37-6d62-42e8-a3af-8f9f83d7749e","Type":"ContainerStarted","Data":"a96ea9b1cd635df4acb93e786a67c7c7a26fe86c7315277e3e23d7a9603f963d"} Jun 12 16:44:54.781140 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:54.781047 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:54.781310 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:54.781229 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 12 16:44:54.781310 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:44:54.781299 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls podName:eceb6aaf-47af-4caf-8cf7-f208db832f19 nodeName:}" failed. No retries permitted until 2026-06-12 16:44:55.78128065 +0000 UTC m=+272.688934507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-26rrw" (UID: "eceb6aaf-47af-4caf-8cf7-f208db832f19") : secret "prometheus-operator-tls" not found Jun 12 16:44:55.205812 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:55.205768 2581 patch_prober.go:28] interesting pod/image-registry-59895dc9c7-cc7qc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 16:44:55.206092 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:55.205833 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" podUID="2d520558-e92c-4931-9ccd-6886bac889ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 16:44:55.790769 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:55.790733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:55.793587 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:55.793553 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eceb6aaf-47af-4caf-8cf7-f208db832f19-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-26rrw\" (UID: \"eceb6aaf-47af-4caf-8cf7-f208db832f19\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:55.878076 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:55.878017 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" Jun 12 16:44:57.342021 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:57.341977 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw"] Jun 12 16:44:57.345580 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:44:57.345557 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeceb6aaf_47af_4caf_8cf7_f208db832f19.slice/crio-eabd0075a25b00cd145fa7ab49b23a4d248238e4698c25671c407e1bb270a270 WatchSource:0}: Error finding container eabd0075a25b00cd145fa7ab49b23a4d248238e4698c25671c407e1bb270a270: Status 404 returned error can't find the container with id eabd0075a25b00cd145fa7ab49b23a4d248238e4698c25671c407e1bb270a270 Jun 12 16:44:57.508027 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:57.507936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnwn2" event={"ID":"6bda7d37-6d62-42e8-a3af-8f9f83d7749e","Type":"ContainerStarted","Data":"7112fa909d91e6ca046f16ddf193e9c941ca6751a21a78408cf76efef24bdad0"} Jun 12 16:44:57.508943 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:57.508920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" event={"ID":"eceb6aaf-47af-4caf-8cf7-f208db832f19","Type":"ContainerStarted","Data":"eabd0075a25b00cd145fa7ab49b23a4d248238e4698c25671c407e1bb270a270"} Jun 12 16:44:58.515274 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:44:58.515235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnwn2" event={"ID":"6bda7d37-6d62-42e8-a3af-8f9f83d7749e","Type":"ContainerStarted","Data":"e0baee161cd86fb8c72c09a9311d0b2e60c272121d4a203237f2d8ea68908e5f"} Jun 12 16:45:00.527428 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:00.527393 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cnwn2" event={"ID":"6bda7d37-6d62-42e8-a3af-8f9f83d7749e","Type":"ContainerStarted","Data":"a25ef278e77cf18fbc2c37ed8b12462cc11d1f785194653bdb9e49d84b794252"} Jun 12 16:45:00.529125 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:00.529103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" event={"ID":"eceb6aaf-47af-4caf-8cf7-f208db832f19","Type":"ContainerStarted","Data":"5486c2fac1ff086978316aa192b4c3592339a0b3dc619075d91be35862bfae0f"} Jun 12 16:45:00.529237 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:00.529143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" event={"ID":"eceb6aaf-47af-4caf-8cf7-f208db832f19","Type":"ContainerStarted","Data":"95316d56324906b121c5b63017f91b13913a5e57fc3185fc14b86ce5f8af4e07"} Jun 12 16:45:00.549115 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:00.549070 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cnwn2" podStartSLOduration=33.838660061 podStartE2EDuration="39.549057068s" totalImagesPullingTime="5.710397007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:44:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:00.547378268 +0000 UTC m=+277.455032143" watchObservedRunningTime="2026-06-12 16:45:00.549057068 +0000 UTC m=+277.456710942" Jun 12 16:45:00.567552 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:00.567506 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-26rrw" podStartSLOduration=4.18739391 podStartE2EDuration="6.567492703s" totalImagesPullingTime="2.380098793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:00.566525822 +0000 UTC m=+277.474179723" watchObservedRunningTime="2026-06-12 16:45:00.567492703 +0000 UTC m=+277.475146578" Jun 12 16:45:02.537197 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:02.537168 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-6m46z_8546d81f-170b-465b-a588-b1a5d4fdc6a8/cluster-monitoring-operator/0.log" Jun 12 16:45:02.537573 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:02.537218 2581 generic.go:356] "Generic (PLEG): container finished" podID="8546d81f-170b-465b-a588-b1a5d4fdc6a8" containerID="614334cd47d40edc0ec70bc6f31e11e7f8fde23366652ae38c585444201dcfb5" exitCode=2 Jun 12 16:45:02.537573 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:02.537269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" event={"ID":"8546d81f-170b-465b-a588-b1a5d4fdc6a8","Type":"ContainerDied","Data":"614334cd47d40edc0ec70bc6f31e11e7f8fde23366652ae38c585444201dcfb5"} Jun 12 16:45:02.537573 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:02.537565 2581 scope.go:117] "RemoveContainer" containerID="614334cd47d40edc0ec70bc6f31e11e7f8fde23366652ae38c585444201dcfb5" Jun 12 16:45:03.542173 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:03.542146 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-6m46z_8546d81f-170b-465b-a588-b1a5d4fdc6a8/cluster-monitoring-operator/0.log" Jun 12 16:45:03.542584 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:03.542222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-6m46z" event={"ID":"8546d81f-170b-465b-a588-b1a5d4fdc6a8","Type":"ContainerStarted","Data":"59f08d05bcc550000c278710407fc7c89a029c40dd628cee715d447c7623ac18"} Jun 12 16:45:05.175593 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:05.175540 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xblzg" podUID="fb483be5-b961-4528-ab86-1e36cac7c5cb" Jun 12 16:45:05.202707 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:05.202673 2581 patch_prober.go:28] interesting pod/image-registry-59895dc9c7-cc7qc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 16:45:05.202840 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:05.202735 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" podUID="2d520558-e92c-4931-9ccd-6886bac889ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 16:45:05.549430 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:05.549402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblzg" Jun 12 16:45:06.180141 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.180099 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c"] Jun 12 16:45:06.184045 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.184024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.187476 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.187288 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 16:45:06.187476 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.187350 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f7rnp\"" Jun 12 16:45:06.188073 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.188053 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 16:45:06.190061 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.190041 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gxhgj"] Jun 12 16:45:06.193874 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.193634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.197239 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.196744 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 16:45:06.197239 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.196864 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c"] Jun 12 16:45:06.197239 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.196984 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 16:45:06.197239 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.197021 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7tbk6\"" Jun 12 16:45:06.197239 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.197042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 16:45:06.198307 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.198285 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc"] Jun 12 16:45:06.202175 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.202153 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.205158 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.205139 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 16:45:06.205389 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.205141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xxhf8\"" Jun 12 16:45:06.205518 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.205223 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 16:45:06.205643 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.205122 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 16:45:06.215722 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.215696 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc"] Jun 12 16:45:06.273499 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.273466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.273692 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.273527 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6f5999-4b79-441c-ab3a-c1764c390a3f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.273692 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.273589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.273692 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.273616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7mhq\" (UniqueName: \"kubernetes.io/projected/da6f5999-4b79-441c-ab3a-c1764c390a3f-kube-api-access-w7mhq\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.374373 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.374373 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374377 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t69cm\" (UniqueName: \"kubernetes.io/projected/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-api-access-t69cm\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.374647 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:06.374489 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 12 16:45:06.374647 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6f5999-4b79-441c-ab3a-c1764c390a3f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.374647 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-textfile\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.374647 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:06.374552 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-tls podName:da6f5999-4b79-441c-ab3a-c1764c390a3f nodeName:}" failed. No retries permitted until 2026-06-12 16:45:06.874533638 +0000 UTC m=+283.782187509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-4bq4c" (UID: "da6f5999-4b79-441c-ab3a-c1764c390a3f") : secret "openshift-state-metrics-tls" not found Jun 12 16:45:06.374647 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95039aff-ee36-4e52-a8cb-1cb5edbd353a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.374647 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-sys\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/95039aff-ee36-4e52-a8cb-1cb5edbd353a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7mhq\" (UniqueName: \"kubernetes.io/projected/da6f5999-4b79-441c-ab3a-c1764c390a3f-kube-api-access-w7mhq\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bbh2\" (UniqueName: \"kubernetes.io/projected/1d02f670-4374-44d8-9f5d-2877c41719e0-kube-api-access-6bbh2\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-tls\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.374940 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374933 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-wtmp\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.375383 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.374970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d02f670-4374-44d8-9f5d-2877c41719e0-metrics-client-ca\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.375383 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.375026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.375383 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.375074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.375383 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.375101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-root\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.375788 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.375768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da6f5999-4b79-441c-ab3a-c1764c390a3f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.377849 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.377827 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.385288 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.385266 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7mhq\" (UniqueName: \"kubernetes.io/projected/da6f5999-4b79-441c-ab3a-c1764c390a3f-kube-api-access-w7mhq\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.475975 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.475873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95039aff-ee36-4e52-a8cb-1cb5edbd353a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.475975 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.475932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-sys\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.475975 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.475962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/95039aff-ee36-4e52-a8cb-1cb5edbd353a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.476206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.475988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.476206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476043 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.476206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bbh2\" (UniqueName: \"kubernetes.io/projected/1d02f670-4374-44d8-9f5d-2877c41719e0-kube-api-access-6bbh2\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-tls\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-wtmp\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476206 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d02f670-4374-44d8-9f5d-2877c41719e0-metrics-client-ca\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476404 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476235 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476404 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.476404 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-root\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476404 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t69cm\" (UniqueName: \"kubernetes.io/projected/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-api-access-t69cm\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.476404 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-textfile\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476741 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476714 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-textfile\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476804 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476788 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-sys\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.476895 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.476871 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95039aff-ee36-4e52-a8cb-1cb5edbd353a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.477080 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.477060 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-wtmp\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.477164 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.477065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/95039aff-ee36-4e52-a8cb-1cb5edbd353a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.477164 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:06.477118 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 12 16:45:06.477276 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:06.477208 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-tls podName:95039aff-ee36-4e52-a8cb-1cb5edbd353a nodeName:}" failed. No retries permitted until 2026-06-12 16:45:06.977182139 +0000 UTC m=+283.884836014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-gb5nc" (UID: "95039aff-ee36-4e52-a8cb-1cb5edbd353a") : secret "kube-state-metrics-tls" not found Jun 12 16:45:06.477548 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.477525 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d02f670-4374-44d8-9f5d-2877c41719e0-root\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.477548 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.477533 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d02f670-4374-44d8-9f5d-2877c41719e0-metrics-client-ca\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.477760 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:06.477740 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 16:45:06.477823 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:06.477802 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-tls podName:1d02f670-4374-44d8-9f5d-2877c41719e0 nodeName:}" failed. No retries permitted until 2026-06-12 16:45:06.977787725 +0000 UTC m=+283.885441585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-tls") pod "node-exporter-gxhgj" (UID: "1d02f670-4374-44d8-9f5d-2877c41719e0") : secret "node-exporter-tls" not found Jun 12 16:45:06.478164 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.478138 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.478577 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.478506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.480523 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.480492 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.480928 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.480906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.488562 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.488519 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t69cm\" (UniqueName: \"kubernetes.io/projected/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-api-access-t69cm\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.489421 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.489397 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bbh2\" (UniqueName: \"kubernetes.io/projected/1d02f670-4374-44d8-9f5d-2877c41719e0-kube-api-access-6bbh2\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.880387 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.880297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.883035 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.883013 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da6f5999-4b79-441c-ab3a-c1764c390a3f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-4bq4c\" (UID: \"da6f5999-4b79-441c-ab3a-c1764c390a3f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:06.981429 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.981389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:06.981618 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.981447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-tls\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.983967 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.983934 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d02f670-4374-44d8-9f5d-2877c41719e0-node-exporter-tls\") pod \"node-exporter-gxhgj\" (UID: \"1d02f670-4374-44d8-9f5d-2877c41719e0\") " pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:06.984097 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:06.984046 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/95039aff-ee36-4e52-a8cb-1cb5edbd353a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-gb5nc\" (UID: \"95039aff-ee36-4e52-a8cb-1cb5edbd353a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:07.095661 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.095625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" Jun 12 16:45:07.107171 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.107147 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gxhgj" Jun 12 16:45:07.115512 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.115493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" Jun 12 16:45:07.118737 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:45:07.118713 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d02f670_4374_44d8_9f5d_2877c41719e0.slice/crio-beaf83ab8c828f9e0f063eac7094e2b47949579160e05058c0230f30fe55d6f0 WatchSource:0}: Error finding container beaf83ab8c828f9e0f063eac7094e2b47949579160e05058c0230f30fe55d6f0: Status 404 returned error can't find the container with id beaf83ab8c828f9e0f063eac7094e2b47949579160e05058c0230f30fe55d6f0 Jun 12 16:45:07.271768 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.271742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c"] Jun 12 16:45:07.274363 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:45:07.274334 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6f5999_4b79_441c_ab3a_c1764c390a3f.slice/crio-2e0c6e9ccadaecadb3f76ef120141666541bed8d119f45c5ecbd921ee6357627 WatchSource:0}: Error finding container 2e0c6e9ccadaecadb3f76ef120141666541bed8d119f45c5ecbd921ee6357627: Status 404 returned error can't find the container with id 2e0c6e9ccadaecadb3f76ef120141666541bed8d119f45c5ecbd921ee6357627 Jun 12 16:45:07.298550 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.298524 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc"] Jun 12 16:45:07.304657 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:45:07.304567 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95039aff_ee36_4e52_a8cb_1cb5edbd353a.slice/crio-4e2c471c6951acdefb1652395dbf43d01d47fd6edb9da45b362b3ce48fb8664f WatchSource:0}: Error finding container 4e2c471c6951acdefb1652395dbf43d01d47fd6edb9da45b362b3ce48fb8664f: Status 404 returned error can't find the container with id 4e2c471c6951acdefb1652395dbf43d01d47fd6edb9da45b362b3ce48fb8664f Jun 12 16:45:07.558089 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.558049 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxhgj" event={"ID":"1d02f670-4374-44d8-9f5d-2877c41719e0","Type":"ContainerStarted","Data":"beaf83ab8c828f9e0f063eac7094e2b47949579160e05058c0230f30fe55d6f0"} Jun 12 16:45:07.559109 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.559087 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" event={"ID":"95039aff-ee36-4e52-a8cb-1cb5edbd353a","Type":"ContainerStarted","Data":"4e2c471c6951acdefb1652395dbf43d01d47fd6edb9da45b362b3ce48fb8664f"} Jun 12 16:45:07.560706 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.560687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" event={"ID":"da6f5999-4b79-441c-ab3a-c1764c390a3f","Type":"ContainerStarted","Data":"91a90d26757d4e61c1bf4ff3826d83dd36ccad47395a2188d5625eb850a6923b"} Jun 12 16:45:07.560799 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.560728 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" event={"ID":"da6f5999-4b79-441c-ab3a-c1764c390a3f","Type":"ContainerStarted","Data":"7e844a7037de423b8c417b7e45cc0b2698b8d30d74c90cfba3dabcd8eaf94ad7"} Jun 12 16:45:07.560799 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:07.560751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" event={"ID":"da6f5999-4b79-441c-ab3a-c1764c390a3f","Type":"ContainerStarted","Data":"2e0c6e9ccadaecadb3f76ef120141666541bed8d119f45c5ecbd921ee6357627"} Jun 12 16:45:08.394130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:08.394086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:45:08.397078 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:08.397043 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb483be5-b961-4528-ab86-1e36cac7c5cb-metrics-tls\") pod \"dns-default-xblzg\" (UID: \"fb483be5-b961-4528-ab86-1e36cac7c5cb\") " pod="openshift-dns/dns-default-xblzg" Jun 12 16:45:08.553623 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:08.553587 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8lgp\"" Jun 12 16:45:08.561372 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:08.561338 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblzg" Jun 12 16:45:09.189417 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.189385 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xblzg"] Jun 12 16:45:09.200578 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:45:09.198454 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb483be5_b961_4528_ab86_1e36cac7c5cb.slice/crio-e42068173a1ef9047b7d2e6ad09cc058e69edfb3db9af40b48c0b1e5b018068b WatchSource:0}: Error finding container e42068173a1ef9047b7d2e6ad09cc058e69edfb3db9af40b48c0b1e5b018068b: Status 404 returned error can't find the container with id e42068173a1ef9047b7d2e6ad09cc058e69edfb3db9af40b48c0b1e5b018068b Jun 12 16:45:09.573358 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.573269 2581 generic.go:356] "Generic (PLEG): container finished" podID="1d02f670-4374-44d8-9f5d-2877c41719e0" containerID="612ea8d835e5284e78bb80ab8b8860c04f8d8174e34654dce8b6835d9a2580e9" exitCode=0 Jun 12 16:45:09.573358 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.573314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxhgj" event={"ID":"1d02f670-4374-44d8-9f5d-2877c41719e0","Type":"ContainerDied","Data":"612ea8d835e5284e78bb80ab8b8860c04f8d8174e34654dce8b6835d9a2580e9"} Jun 12 16:45:09.574607 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.574581 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xblzg" event={"ID":"fb483be5-b961-4528-ab86-1e36cac7c5cb","Type":"ContainerStarted","Data":"e42068173a1ef9047b7d2e6ad09cc058e69edfb3db9af40b48c0b1e5b018068b"} Jun 12 16:45:09.582253 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.582229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" event={"ID":"95039aff-ee36-4e52-a8cb-1cb5edbd353a","Type":"ContainerStarted","Data":"29914152598ef14379d0de35614d5205253d2bb5321e8643f29db7fb6618d9b0"} Jun 12 16:45:09.582327 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.582276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" event={"ID":"95039aff-ee36-4e52-a8cb-1cb5edbd353a","Type":"ContainerStarted","Data":"6ca45fa2f61a112b24eb49243d7f79fdb23aa88889887d692623c8b1d8093f9a"} Jun 12 16:45:09.582327 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.582294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" event={"ID":"95039aff-ee36-4e52-a8cb-1cb5edbd353a","Type":"ContainerStarted","Data":"4d034d8039d88810428bf6911b2f75a13ea28404bfb71c2850c1fdb30832aab1"} Jun 12 16:45:09.582327 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.582311 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" event={"ID":"da6f5999-4b79-441c-ab3a-c1764c390a3f","Type":"ContainerStarted","Data":"a472e65752a3e080cfb8c299b0c70c4956eba92677ef7b85ad5bee96cf0789e5"} Jun 12 16:45:09.615814 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.615752 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-gb5nc" podStartSLOduration=1.9001379969999999 podStartE2EDuration="3.615735249s" totalImagesPullingTime="1.715597252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:09.613066648 +0000 UTC m=+286.520720525" watchObservedRunningTime="2026-06-12 16:45:09.615735249 +0000 UTC m=+286.523389101" Jun 12 16:45:09.632848 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:09.632793 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-4bq4c" podStartSLOduration=2.043116113 podStartE2EDuration="3.632773306s" totalImagesPullingTime="1.589657193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:09.632168513 +0000 UTC m=+286.539822413" watchObservedRunningTime="2026-06-12 16:45:09.632773306 +0000 UTC m=+286.540427183" Jun 12 16:45:10.218022 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.217955 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" podUID="2d520558-e92c-4931-9ccd-6886bac889ac" containerName="registry" containerID="cri-o://37c47ebfc0ed81a3030ef7fa74b87b1ddec1490218a82f1e8748f23433f141cd" gracePeriod=30 Jun 12 16:45:10.589143 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.589039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxhgj" event={"ID":"1d02f670-4374-44d8-9f5d-2877c41719e0","Type":"ContainerStarted","Data":"6b23f56be4e34b90b0f328523b29b4c00abeec5608d893f8da8b37ac53f83ca7"} Jun 12 16:45:10.589143 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.589136 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gxhgj" event={"ID":"1d02f670-4374-44d8-9f5d-2877c41719e0","Type":"ContainerStarted","Data":"7b1d14a9403f70b50b023c3db1ab9c9f67959eb81317d5fafa02be761242d2fa"} Jun 12 16:45:10.590865 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.590841 2581 generic.go:356] "Generic (PLEG): container finished" podID="2d520558-e92c-4931-9ccd-6886bac889ac" containerID="37c47ebfc0ed81a3030ef7fa74b87b1ddec1490218a82f1e8748f23433f141cd" exitCode=0 Jun 12 16:45:10.591039 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.590929 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" event={"ID":"2d520558-e92c-4931-9ccd-6886bac889ac","Type":"ContainerDied","Data":"37c47ebfc0ed81a3030ef7fa74b87b1ddec1490218a82f1e8748f23433f141cd"} Jun 12 16:45:10.611939 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.611879 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gxhgj" podStartSLOduration=2.586975308 podStartE2EDuration="4.611860637s" totalImagesPullingTime="1.900198757s" totalInitContainerRuntime="124.686572ms" isStatefulPod=true podCreationTimestamp="2026-06-12 16:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:10.610155112 +0000 UTC m=+287.517809006" watchObservedRunningTime="2026-06-12 16:45:10.611860637 +0000 UTC m=+287.519514515" Jun 12 16:45:10.904169 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.904143 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:45:10.987867 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.987839 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5"] Jun 12 16:45:10.988264 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.988241 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d520558-e92c-4931-9ccd-6886bac889ac" containerName="registry" Jun 12 16:45:10.988264 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.988264 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d520558-e92c-4931-9ccd-6886bac889ac" containerName="registry" Jun 12 16:45:10.988463 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.988315 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d520558-e92c-4931-9ccd-6886bac889ac" containerName="registry" Jun 12 16:45:10.991567 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.991545 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:10.994974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.994406 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 16:45:10.994974 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.994511 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rhpsb\"" Jun 12 16:45:10.999398 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:10.999374 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5"] Jun 12 16:45:11.016436 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016415 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmrr8\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-kube-api-access-vmrr8\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.016544 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016465 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-bound-sa-token\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.016544 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016493 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-trusted-ca\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.016544 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016525 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-installation-pull-secrets\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.016714 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016566 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d520558-e92c-4931-9ccd-6886bac889ac-ca-trust-extracted\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.016714 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016592 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.016714 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016620 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-image-registry-private-configuration\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.016714 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.016655 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-registry-certificates\") pod \"2d520558-e92c-4931-9ccd-6886bac889ac\" (UID: \"2d520558-e92c-4931-9ccd-6886bac889ac\") " Jun 12 16:45:11.017474 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.017216 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 16:45:11.017853 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.017823 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 16:45:11.019395 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.019367 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-kube-api-access-vmrr8" (OuterVolumeSpecName: "kube-api-access-vmrr8") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "kube-api-access-vmrr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 16:45:11.020255 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.020143 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 16:45:11.020672 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.020639 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 16:45:11.020834 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.020796 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 16:45:11.021474 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.021446 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 16:45:11.028038 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.028014 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d520558-e92c-4931-9ccd-6886bac889ac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2d520558-e92c-4931-9ccd-6886bac889ac" (UID: "2d520558-e92c-4931-9ccd-6886bac889ac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 16:45:11.031702 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.031679 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fdbb99d9d-5svkv"] Jun 12 16:45:11.036168 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.036149 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.039120 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039098 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 16:45:11.039228 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039100 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 16:45:11.039228 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039146 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 16:45:11.039228 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039200 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-58dpv\"" Jun 12 16:45:11.039228 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 16:45:11.039228 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039145 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 16:45:11.039595 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039571 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 16:45:11.039595 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.039582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 16:45:11.046126 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.046093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fdbb99d9d-5svkv"] Jun 12 16:45:11.046126 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.046116 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 16:45:11.118145 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26aad9ad-61f4-462d-923b-f7fb3d9198aa-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-fnkl5\" (UID: \"26aad9ad-61f4-462d-923b-f7fb3d9198aa\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:11.118145 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vhgf\" (UniqueName: \"kubernetes.io/projected/26aad9ad-61f4-462d-923b-f7fb3d9198aa-kube-api-access-7vhgf\") pod \"monitoring-plugin-589576dfc7-fnkl5\" (UID: \"26aad9ad-61f4-462d-923b-f7fb3d9198aa\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:11.118283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118216 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-bound-sa-token\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.118283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118234 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-trusted-ca\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.118283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118243 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-installation-pull-secrets\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.118283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118253 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2d520558-e92c-4931-9ccd-6886bac889ac-ca-trust-extracted\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.118283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118263 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-registry-tls\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.118283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118272 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2d520558-e92c-4931-9ccd-6886bac889ac-image-registry-private-configuration\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.118283 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118281 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2d520558-e92c-4931-9ccd-6886bac889ac-registry-certificates\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.118596 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.118290 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmrr8\" (UniqueName: \"kubernetes.io/projected/2d520558-e92c-4931-9ccd-6886bac889ac-kube-api-access-vmrr8\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:11.218857 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.218821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-trusted-ca-bundle\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.218857 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.218858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-oauth-config\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.219155 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.218885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vhgf\" (UniqueName: \"kubernetes.io/projected/26aad9ad-61f4-462d-923b-f7fb3d9198aa-kube-api-access-7vhgf\") pod \"monitoring-plugin-589576dfc7-fnkl5\" (UID: \"26aad9ad-61f4-462d-923b-f7fb3d9198aa\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:11.219155 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.218953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-serving-cert\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.219155 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.219044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pww6\" (UniqueName: \"kubernetes.io/projected/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-kube-api-access-9pww6\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.219155 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.219107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26aad9ad-61f4-462d-923b-f7fb3d9198aa-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-fnkl5\" (UID: \"26aad9ad-61f4-462d-923b-f7fb3d9198aa\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:11.219155 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.219137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-config\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.219363 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.219168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-oauth-serving-cert\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.219363 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.219193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-service-ca\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.219363 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:11.219232 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 12 16:45:11.219363 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:11.219286 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26aad9ad-61f4-462d-923b-f7fb3d9198aa-monitoring-plugin-cert podName:26aad9ad-61f4-462d-923b-f7fb3d9198aa nodeName:}" failed. No retries permitted until 2026-06-12 16:45:11.71927148 +0000 UTC m=+288.626925333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/26aad9ad-61f4-462d-923b-f7fb3d9198aa-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-fnkl5" (UID: "26aad9ad-61f4-462d-923b-f7fb3d9198aa") : secret "monitoring-plugin-cert" not found Jun 12 16:45:11.228968 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.228942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vhgf\" (UniqueName: \"kubernetes.io/projected/26aad9ad-61f4-462d-923b-f7fb3d9198aa-kube-api-access-7vhgf\") pod \"monitoring-plugin-589576dfc7-fnkl5\" (UID: \"26aad9ad-61f4-462d-923b-f7fb3d9198aa\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:11.319929 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.319887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-trusted-ca-bundle\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.320126 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.319943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-oauth-config\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.320241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.320121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-serving-cert\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.320241 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.320199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pww6\" (UniqueName: \"kubernetes.io/projected/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-kube-api-access-9pww6\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.320360 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.320275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-config\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.320360 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.320318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-oauth-serving-cert\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.320360 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.320343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-service-ca\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.321130 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.321097 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-service-ca\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.321369 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.321311 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-config\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.321455 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.321371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-trusted-ca-bundle\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.321615 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.321592 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-oauth-serving-cert\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.322800 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.322780 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-oauth-config\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.323017 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.322976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-serving-cert\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.332159 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.332133 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pww6\" (UniqueName: \"kubernetes.io/projected/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-kube-api-access-9pww6\") pod \"console-5fdbb99d9d-5svkv\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.357604 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.357566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:11.393744 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.393655 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-74dff6c94d-rkbrk"] Jun 12 16:45:11.397790 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.397768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.400899 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.400868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 16:45:11.400899 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.400885 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vlt5k\"" Jun 12 16:45:11.401096 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.400907 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 16:45:11.401225 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.401200 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 16:45:11.401336 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.401317 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 16:45:11.401397 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.401318 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 16:45:11.407595 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.407569 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 16:45:11.411512 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.411490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74dff6c94d-rkbrk"] Jun 12 16:45:11.497924 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.497900 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fdbb99d9d-5svkv"] Jun 12 16:45:11.500467 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:45:11.500441 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4a5f21_428c_4d3a_ad4c_573a3a2d92a5.slice/crio-a923a990e80d830b5eb6ac31bab75e744564df315e95d894c94a09e964399384 WatchSource:0}: Error finding container a923a990e80d830b5eb6ac31bab75e744564df315e95d894c94a09e964399384: Status 404 returned error can't find the container with id a923a990e80d830b5eb6ac31bab75e744564df315e95d894c94a09e964399384 Jun 12 16:45:11.527293 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.527469 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.527469 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-secret-telemeter-client\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.527469 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-serving-certs-ca-bundle\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.527572 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6vjw\" (UniqueName: \"kubernetes.io/projected/47e4d154-14bb-4b61-a07c-7297ca422ea6-kube-api-access-g6vjw\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.527572 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527514 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-telemeter-client-tls\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.527572 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527537 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-metrics-client-ca\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.527660 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.527629 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-federate-client-tls\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.596368 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.596334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xblzg" event={"ID":"fb483be5-b961-4528-ab86-1e36cac7c5cb","Type":"ContainerStarted","Data":"ccc64d6c838a71d441f2eafe7516999cf3613bbf97e18208cb36f7a61095ac39"} Jun 12 16:45:11.596778 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.596386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xblzg" event={"ID":"fb483be5-b961-4528-ab86-1e36cac7c5cb","Type":"ContainerStarted","Data":"089195b44913f11ade80fd03640bf7ee518578281d15a81083dee5f278e355b3"} Jun 12 16:45:11.596778 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.596409 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xblzg" Jun 12 16:45:11.597545 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.597524 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fdbb99d9d-5svkv" event={"ID":"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5","Type":"ContainerStarted","Data":"a923a990e80d830b5eb6ac31bab75e744564df315e95d894c94a09e964399384"} Jun 12 16:45:11.598613 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.598597 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" Jun 12 16:45:11.598676 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.598634 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59895dc9c7-cc7qc" event={"ID":"2d520558-e92c-4931-9ccd-6886bac889ac","Type":"ContainerDied","Data":"2d3049f281e0c4de37ee6d27d0e38c1093184b649a1c7a43fbe297d2d2956fad"} Jun 12 16:45:11.598719 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.598691 2581 scope.go:117] "RemoveContainer" containerID="37c47ebfc0ed81a3030ef7fa74b87b1ddec1490218a82f1e8748f23433f141cd" Jun 12 16:45:11.616083 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.616034 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xblzg" podStartSLOduration=251.884995694 podStartE2EDuration="4m13.616016898s" totalImagesPullingTime="1.731021204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:11.61526329 +0000 UTC m=+288.522917195" watchObservedRunningTime="2026-06-12 16:45:11.616016898 +0000 UTC m=+288.523670774" Jun 12 16:45:11.628062 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-telemeter-client-tls\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628152 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-metrics-client-ca\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628152 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-federate-client-tls\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628152 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628318 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628318 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628206 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-secret-telemeter-client\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628318 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-serving-certs-ca-bundle\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628456 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6vjw\" (UniqueName: \"kubernetes.io/projected/47e4d154-14bb-4b61-a07c-7297ca422ea6-kube-api-access-g6vjw\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.628886 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.628854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-metrics-client-ca\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.629303 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.629248 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.629303 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.629257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47e4d154-14bb-4b61-a07c-7297ca422ea6-serving-certs-ca-bundle\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.630398 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.630375 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59895dc9c7-cc7qc"] Jun 12 16:45:11.631311 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.631261 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.631767 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.631738 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-secret-telemeter-client\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.631922 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.631906 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-federate-client-tls\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.632568 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.632549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47e4d154-14bb-4b61-a07c-7297ca422ea6-telemeter-client-tls\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.632779 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.632762 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59895dc9c7-cc7qc"] Jun 12 16:45:11.636496 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.636477 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6vjw\" (UniqueName: \"kubernetes.io/projected/47e4d154-14bb-4b61-a07c-7297ca422ea6-kube-api-access-g6vjw\") pod \"telemeter-client-74dff6c94d-rkbrk\" (UID: \"47e4d154-14bb-4b61-a07c-7297ca422ea6\") " pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.710927 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.710896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" Jun 12 16:45:11.729491 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.729455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26aad9ad-61f4-462d-923b-f7fb3d9198aa-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-fnkl5\" (UID: \"26aad9ad-61f4-462d-923b-f7fb3d9198aa\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:11.732051 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.732030 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/26aad9ad-61f4-462d-923b-f7fb3d9198aa-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-fnkl5\" (UID: \"26aad9ad-61f4-462d-923b-f7fb3d9198aa\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:11.848669 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.848627 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-74dff6c94d-rkbrk"] Jun 12 16:45:11.852178 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:45:11.852147 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e4d154_14bb_4b61_a07c_7297ca422ea6.slice/crio-253a578c92dd983aeeb1d6f0c5a726212ad1374ec11f70dc7a0c0d66eaa6636e WatchSource:0}: Error finding container 253a578c92dd983aeeb1d6f0c5a726212ad1374ec11f70dc7a0c0d66eaa6636e: Status 404 returned error can't find the container with id 253a578c92dd983aeeb1d6f0c5a726212ad1374ec11f70dc7a0c0d66eaa6636e Jun 12 16:45:11.921716 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:11.921683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:12.075781 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:12.075755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5"] Jun 12 16:45:12.078210 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:45:12.078188 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26aad9ad_61f4_462d_923b_f7fb3d9198aa.slice/crio-2ba32c1f86dfa9a69d2c1ba4ad3499951010fc914f3a65998338ff965788f798 WatchSource:0}: Error finding container 2ba32c1f86dfa9a69d2c1ba4ad3499951010fc914f3a65998338ff965788f798: Status 404 returned error can't find the container with id 2ba32c1f86dfa9a69d2c1ba4ad3499951010fc914f3a65998338ff965788f798 Jun 12 16:45:12.604635 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:12.604595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" event={"ID":"26aad9ad-61f4-462d-923b-f7fb3d9198aa","Type":"ContainerStarted","Data":"2ba32c1f86dfa9a69d2c1ba4ad3499951010fc914f3a65998338ff965788f798"} Jun 12 16:45:12.606739 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:12.606706 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" event={"ID":"47e4d154-14bb-4b61-a07c-7297ca422ea6","Type":"ContainerStarted","Data":"253a578c92dd983aeeb1d6f0c5a726212ad1374ec11f70dc7a0c0d66eaa6636e"} Jun 12 16:45:13.583981 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:13.583947 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d520558-e92c-4931-9ccd-6886bac889ac" path="/var/lib/kubelet/pods/2d520558-e92c-4931-9ccd-6886bac889ac/volumes" Jun 12 16:45:15.621375 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:15.621333 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" event={"ID":"26aad9ad-61f4-462d-923b-f7fb3d9198aa","Type":"ContainerStarted","Data":"32bedb15ce46d401a7862f1fa5616b141eac4c8fae0191f449127b105e41585c"} Jun 12 16:45:15.621833 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:15.621399 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:15.623069 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:15.623044 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fdbb99d9d-5svkv" event={"ID":"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5","Type":"ContainerStarted","Data":"705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533"} Jun 12 16:45:15.624671 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:15.624650 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" event={"ID":"47e4d154-14bb-4b61-a07c-7297ca422ea6","Type":"ContainerStarted","Data":"4c2ac3f628cd32fb1baaf9e6870d67cd5e3ae1df5e62474753656222c6623614"} Jun 12 16:45:15.626632 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:15.626612 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" Jun 12 16:45:15.643174 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:15.643096 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-fnkl5" podStartSLOduration=2.3149192100000002 podStartE2EDuration="5.643083123s" totalImagesPullingTime="3.328163913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:15.641831295 +0000 UTC m=+292.549485174" watchObservedRunningTime="2026-06-12 16:45:15.643083123 +0000 UTC m=+292.550737011" Jun 12 16:45:15.660905 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:15.660851 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fdbb99d9d-5svkv" podStartSLOduration=0.748651119 podStartE2EDuration="4.660836762s" totalImagesPullingTime="3.912185643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:15.66024015 +0000 UTC m=+292.567894053" watchObservedRunningTime="2026-06-12 16:45:15.660836762 +0000 UTC m=+292.568490636" Jun 12 16:45:16.630344 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:16.630244 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" event={"ID":"47e4d154-14bb-4b61-a07c-7297ca422ea6","Type":"ContainerStarted","Data":"3c770733bab1ececaa0068e974fd8b80956eb7ac475979531246df8f59c50eb2"} Jun 12 16:45:16.630344 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:16.630307 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" event={"ID":"47e4d154-14bb-4b61-a07c-7297ca422ea6","Type":"ContainerStarted","Data":"870b6e77aa1a19b6ed0967d9a93e8f97234f60751232f19a2d074206ff5ac42e"} Jun 12 16:45:16.657693 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:16.657642 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-74dff6c94d-rkbrk" podStartSLOduration=1.239381996 podStartE2EDuration="5.657624035s" totalImagesPullingTime="4.418242039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 16:45:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:45:16.656649618 +0000 UTC m=+293.564303500" watchObservedRunningTime="2026-06-12 16:45:16.657624035 +0000 UTC m=+293.565277952" Jun 12 16:45:21.358495 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:21.358450 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:21.358902 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:21.358509 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:21.363373 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:21.363346 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:21.609375 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:21.609301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xblzg" Jun 12 16:45:21.655437 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:21.655407 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:23.534011 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:23.533969 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-6m46z_8546d81f-170b-465b-a588-b1a5d4fdc6a8/cluster-monitoring-operator/0.log" Jun 12 16:45:23.536603 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:23.536583 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-6m46z_8546d81f-170b-465b-a588-b1a5d4fdc6a8/cluster-monitoring-operator/0.log" Jun 12 16:45:23.546422 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:23.546406 2581 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 16:45:28.129433 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:28.129397 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fdbb99d9d-5svkv"] Jun 12 16:45:40.723768 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:40.723734 2581 generic.go:356] "Generic (PLEG): container finished" podID="bc170850-ec5b-4f31-93ea-24edfbae4631" containerID="e726f9f6a0da721943c9ee2c4101c7129b307c7b5a2842937cf4ca61fb079c27" exitCode=0 Jun 12 16:45:40.724164 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:40.723808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" event={"ID":"bc170850-ec5b-4f31-93ea-24edfbae4631","Type":"ContainerDied","Data":"e726f9f6a0da721943c9ee2c4101c7129b307c7b5a2842937cf4ca61fb079c27"} Jun 12 16:45:40.724213 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:40.724171 2581 scope.go:117] "RemoveContainer" containerID="e726f9f6a0da721943c9ee2c4101c7129b307c7b5a2842937cf4ca61fb079c27" Jun 12 16:45:41.734399 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:41.734368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-vsbrs" event={"ID":"bc170850-ec5b-4f31-93ea-24edfbae4631","Type":"ContainerStarted","Data":"c44795421142d1aaa7f643ef41cb99a5104fa034c84766e479328c70fda128cd"} Jun 12 16:45:46.822810 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:46.822746 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57d4f45d48-gpxzd_20a544b6-7432-42e2-9673-9b914b892566/router/0.log" Jun 12 16:45:46.872219 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:46.872191 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnzfn_bbf2f977-24b5-4d8b-9e04-399cb8b600a8/serve-healthcheck-canary/0.log" Jun 12 16:45:53.150420 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.150364 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fdbb99d9d-5svkv" podUID="5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" containerName="console" containerID="cri-o://705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533" gracePeriod=15 Jun 12 16:45:53.388773 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.388749 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:53.478430 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478388 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-service-ca\") pod \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " Jun 12 16:45:53.478430 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478437 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-trusted-ca-bundle\") pod \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " Jun 12 16:45:53.478634 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478480 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-oauth-config\") pod \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " Jun 12 16:45:53.478671 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478640 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-oauth-serving-cert\") pod \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " Jun 12 16:45:53.478727 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478710 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-serving-cert\") pod \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " Jun 12 16:45:53.478769 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478743 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pww6\" (UniqueName: \"kubernetes.io/projected/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-kube-api-access-9pww6\") pod \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " Jun 12 16:45:53.478813 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478768 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-config\") pod \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\" (UID: \"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5\") " Jun 12 16:45:53.478926 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478802 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" (UID: "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 16:45:53.479044 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.478942 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" (UID: "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 16:45:53.479044 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.479027 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" (UID: "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 16:45:53.479171 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.479079 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-service-ca\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:53.479171 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.479097 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-trusted-ca-bundle\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:53.479253 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.479212 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-config" (OuterVolumeSpecName: "console-config") pod "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" (UID: "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 16:45:53.480864 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.480828 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" (UID: "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 16:45:53.480960 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.480882 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" (UID: "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 16:45:53.481061 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.481039 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-kube-api-access-9pww6" (OuterVolumeSpecName: "kube-api-access-9pww6") pod "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" (UID: "5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5"). InnerVolumeSpecName "kube-api-access-9pww6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 16:45:53.579547 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.579523 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-oauth-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:53.579699 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.579655 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-oauth-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:53.579742 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.579720 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-serving-cert\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:53.579742 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.579736 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pww6\" (UniqueName: \"kubernetes.io/projected/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-kube-api-access-9pww6\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:53.579812 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.579745 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5-console-config\") on node \"ip-10-0-128-123.ec2.internal\" DevicePath \"\"" Jun 12 16:45:53.780270 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.780183 2581 generic.go:356] "Generic (PLEG): container finished" podID="5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" containerID="705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533" exitCode=0 Jun 12 16:45:53.780270 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.780227 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fdbb99d9d-5svkv" Jun 12 16:45:53.780270 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.780237 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fdbb99d9d-5svkv" event={"ID":"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5","Type":"ContainerDied","Data":"705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533"} Jun 12 16:45:53.780505 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.780278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fdbb99d9d-5svkv" event={"ID":"5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5","Type":"ContainerDied","Data":"a923a990e80d830b5eb6ac31bab75e744564df315e95d894c94a09e964399384"} Jun 12 16:45:53.780505 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.780298 2581 scope.go:117] "RemoveContainer" containerID="705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533" Jun 12 16:45:53.788400 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.788385 2581 scope.go:117] "RemoveContainer" containerID="705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533" Jun 12 16:45:53.788667 ip-10-0-128-123 kubenswrapper[2581]: E0612 16:45:53.788647 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533\": container with ID starting with 705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533 not found: ID does not exist" containerID="705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533" Jun 12 16:45:53.788716 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.788674 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533"} err="failed to get container status \"705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533\": rpc error: code = NotFound desc = could not find container \"705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533\": container with ID starting with 705c2698bd88990e34cf40bb1a913cbb9a126c5cb9539107cc74109a40c70533 not found: ID does not exist" Jun 12 16:45:53.800461 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.800433 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fdbb99d9d-5svkv"] Jun 12 16:45:53.804124 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:53.804102 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fdbb99d9d-5svkv"] Jun 12 16:45:55.583074 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:45:55.583033 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" path="/var/lib/kubelet/pods/5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5/volumes" Jun 12 16:47:33.100645 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:33.100610 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2pzsz_3791ad77-0aed-408a-89ed-a52849f73523/global-pull-secret-syncer/0.log" Jun 12 16:47:33.253001 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:33.252948 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-55zpk_80da6e59-1545-4801-b76f-f4fbf3cc3750/konnectivity-agent/0.log" Jun 12 16:47:33.292269 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:33.292235 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-123.ec2.internal_ae03d5083e42c17555e461b06baba72d/haproxy/0.log" Jun 12 16:47:36.676203 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:36.676172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-6m46z_8546d81f-170b-465b-a588-b1a5d4fdc6a8/cluster-monitoring-operator/1.log" Jun 12 16:47:36.830741 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:36.830712 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-6m46z_8546d81f-170b-465b-a588-b1a5d4fdc6a8/cluster-monitoring-operator/0.log" Jun 12 16:47:36.862350 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:36.862328 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-gb5nc_95039aff-ee36-4e52-a8cb-1cb5edbd353a/kube-state-metrics/0.log" Jun 12 16:47:36.889585 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:36.889563 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-gb5nc_95039aff-ee36-4e52-a8cb-1cb5edbd353a/kube-rbac-proxy-main/0.log" Jun 12 16:47:36.930845 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:36.930814 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-gb5nc_95039aff-ee36-4e52-a8cb-1cb5edbd353a/kube-rbac-proxy-self/0.log" Jun 12 16:47:37.022107 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.022078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-fnkl5_26aad9ad-61f4-462d-923b-f7fb3d9198aa/monitoring-plugin/0.log" Jun 12 16:47:37.062472 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.062437 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gxhgj_1d02f670-4374-44d8-9f5d-2877c41719e0/node-exporter/0.log" Jun 12 16:47:37.083488 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.083461 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gxhgj_1d02f670-4374-44d8-9f5d-2877c41719e0/kube-rbac-proxy/0.log" Jun 12 16:47:37.105626 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.105602 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gxhgj_1d02f670-4374-44d8-9f5d-2877c41719e0/init-textfile/0.log" Jun 12 16:47:37.301865 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.301780 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4bq4c_da6f5999-4b79-441c-ab3a-c1764c390a3f/kube-rbac-proxy-main/0.log" Jun 12 16:47:37.325180 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.325150 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4bq4c_da6f5999-4b79-441c-ab3a-c1764c390a3f/kube-rbac-proxy-self/0.log" Jun 12 16:47:37.346356 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.346331 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-4bq4c_da6f5999-4b79-441c-ab3a-c1764c390a3f/openshift-state-metrics/0.log" Jun 12 16:47:37.573028 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.572935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-26rrw_eceb6aaf-47af-4caf-8cf7-f208db832f19/prometheus-operator/0.log" Jun 12 16:47:37.595851 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.595822 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-26rrw_eceb6aaf-47af-4caf-8cf7-f208db832f19/kube-rbac-proxy/0.log" Jun 12 16:47:37.623117 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.623090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-k2tkk_f967ae75-0d87-4be7-b50a-c143e7591645/prometheus-operator-admission-webhook/0.log" Jun 12 16:47:37.650942 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.650914 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74dff6c94d-rkbrk_47e4d154-14bb-4b61-a07c-7297ca422ea6/telemeter-client/0.log" Jun 12 16:47:37.673898 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.673873 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74dff6c94d-rkbrk_47e4d154-14bb-4b61-a07c-7297ca422ea6/reload/0.log" Jun 12 16:47:37.696095 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:37.696064 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-74dff6c94d-rkbrk_47e4d154-14bb-4b61-a07c-7297ca422ea6/kube-rbac-proxy/0.log" Jun 12 16:47:40.310492 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.310463 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c"] Jun 12 16:47:40.310871 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.310739 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" containerName="console" Jun 12 16:47:40.310871 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.310748 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" containerName="console" Jun 12 16:47:40.310871 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.310798 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4a5f21-428c-4d3a-ad4c-573a3a2d92a5" containerName="console" Jun 12 16:47:40.313773 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.313754 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.316422 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.316398 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p8pvd\"/\"kube-root-ca.crt\"" Jun 12 16:47:40.316544 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.316469 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p8pvd\"/\"openshift-service-ca.crt\"" Jun 12 16:47:40.317818 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.317803 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p8pvd\"/\"default-dockercfg-bhnzm\"" Jun 12 16:47:40.323700 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.323675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c"] Jun 12 16:47:40.397308 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.397272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-sys\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.397518 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.397321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-podres\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.397518 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.397353 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-lib-modules\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.397518 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.397387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbfbz\" (UniqueName: \"kubernetes.io/projected/0d72cd16-9e07-4197-8e41-4f3c00d3981f-kube-api-access-qbfbz\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.397518 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.397449 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-proc\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.498783 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-sys\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.498783 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-podres\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.499058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-lib-modules\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.499058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbfbz\" (UniqueName: \"kubernetes.io/projected/0d72cd16-9e07-4197-8e41-4f3c00d3981f-kube-api-access-qbfbz\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.499058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498870 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-sys\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.499058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-proc\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.499058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498926 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-proc\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.499058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.498931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-podres\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.499058 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.499017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d72cd16-9e07-4197-8e41-4f3c00d3981f-lib-modules\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.508514 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.508491 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbfbz\" (UniqueName: \"kubernetes.io/projected/0d72cd16-9e07-4197-8e41-4f3c00d3981f-kube-api-access-qbfbz\") pod \"perf-node-gather-daemonset-88q5c\" (UID: \"0d72cd16-9e07-4197-8e41-4f3c00d3981f\") " pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.624489 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.624398 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:40.754098 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:40.754064 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c"] Jun 12 16:47:40.756954 ip-10-0-128-123 kubenswrapper[2581]: W0612 16:47:40.756925 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d72cd16_9e07_4197_8e41_4f3c00d3981f.slice/crio-9718306b197bb9dceb3058099cd59a80f081294ecc0820140d80a8ca5bc3914c WatchSource:0}: Error finding container 9718306b197bb9dceb3058099cd59a80f081294ecc0820140d80a8ca5bc3914c: Status 404 returned error can't find the container with id 9718306b197bb9dceb3058099cd59a80f081294ecc0820140d80a8ca5bc3914c Jun 12 16:47:41.194838 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.194799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" event={"ID":"0d72cd16-9e07-4197-8e41-4f3c00d3981f","Type":"ContainerStarted","Data":"13d4416ad7278376d65f52968bf3fb6bc520d6a83041ccdb84fea5022cbbe252"} Jun 12 16:47:41.195061 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.194856 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" event={"ID":"0d72cd16-9e07-4197-8e41-4f3c00d3981f","Type":"ContainerStarted","Data":"9718306b197bb9dceb3058099cd59a80f081294ecc0820140d80a8ca5bc3914c"} Jun 12 16:47:41.195061 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.194943 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:41.214208 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.214149 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" podStartSLOduration=1.214136315 podStartE2EDuration="1.214136315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 16:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 16:47:41.213101912 +0000 UTC m=+438.120755805" watchObservedRunningTime="2026-06-12 16:47:41.214136315 +0000 UTC m=+438.121790191" Jun 12 16:47:41.414587 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.414558 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xblzg_fb483be5-b961-4528-ab86-1e36cac7c5cb/dns/0.log" Jun 12 16:47:41.433815 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.433785 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xblzg_fb483be5-b961-4528-ab86-1e36cac7c5cb/kube-rbac-proxy/0.log" Jun 12 16:47:41.508957 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.508871 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kcmt4_bc37f869-dbb7-4783-9585-b26792ad94fb/dns-node-resolver/0.log" Jun 12 16:47:41.908473 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:41.908387 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8zx6d_2ea67727-e38c-4eae-b7b3-28a9b15ee2e8/node-ca/0.log" Jun 12 16:47:42.584162 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:42.584131 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57d4f45d48-gpxzd_20a544b6-7432-42e2-9673-9b914b892566/router/0.log" Jun 12 16:47:42.930265 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:42.930235 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnzfn_bbf2f977-24b5-4d8b-9e04-399cb8b600a8/serve-healthcheck-canary/0.log" Jun 12 16:47:43.334120 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:43.334028 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnwn2_6bda7d37-6d62-42e8-a3af-8f9f83d7749e/kube-rbac-proxy/0.log" Jun 12 16:47:43.355362 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:43.355336 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnwn2_6bda7d37-6d62-42e8-a3af-8f9f83d7749e/exporter/0.log" Jun 12 16:47:43.377550 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:43.377517 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cnwn2_6bda7d37-6d62-42e8-a3af-8f9f83d7749e/extractor/0.log" Jun 12 16:47:47.209318 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:47.209293 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p8pvd/perf-node-gather-daemonset-88q5c" Jun 12 16:47:47.729476 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:47.729448 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-vsbrs_bc170850-ec5b-4f31-93ea-24edfbae4631/kube-storage-version-migrator-operator/1.log" Jun 12 16:47:47.731030 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:47.730983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-vsbrs_bc170850-ec5b-4f31-93ea-24edfbae4631/kube-storage-version-migrator-operator/0.log" Jun 12 16:47:48.652175 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:48.652151 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rh8n_1c4629f7-7da1-472d-a049-956ac377d391/kube-multus-additional-cni-plugins/0.log" Jun 12 16:47:48.673577 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:48.673552 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rh8n_1c4629f7-7da1-472d-a049-956ac377d391/egress-router-binary-copy/0.log" Jun 12 16:47:48.692252 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:48.692231 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rh8n_1c4629f7-7da1-472d-a049-956ac377d391/cni-plugins/0.log" Jun 12 16:47:48.711228 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:48.711208 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rh8n_1c4629f7-7da1-472d-a049-956ac377d391/bond-cni-plugin/0.log" Jun 12 16:47:48.731054 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:48.731025 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rh8n_1c4629f7-7da1-472d-a049-956ac377d391/routeoverride-cni/0.log" Jun 12 16:47:48.750982 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:48.750959 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rh8n_1c4629f7-7da1-472d-a049-956ac377d391/whereabouts-cni-bincopy/0.log" Jun 12 16:47:48.771776 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:48.771751 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7rh8n_1c4629f7-7da1-472d-a049-956ac377d391/whereabouts-cni/0.log" Jun 12 16:47:49.150154 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:49.150056 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g6k6k_197c065b-4015-44eb-b755-4ea3ef1699a9/kube-multus/0.log" Jun 12 16:47:49.196478 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:49.196445 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6xxnl_03f380ca-e643-4b86-b4e3-12a5594247d3/network-metrics-daemon/0.log" Jun 12 16:47:49.221208 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:49.221159 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6xxnl_03f380ca-e643-4b86-b4e3-12a5594247d3/kube-rbac-proxy/0.log" Jun 12 16:47:50.136496 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.136466 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/ovn-controller/0.log" Jun 12 16:47:50.152300 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.152272 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/ovn-acl-logging/0.log" Jun 12 16:47:50.181204 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.181172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/kube-rbac-proxy-node/0.log" Jun 12 16:47:50.205213 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.205144 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/kube-rbac-proxy-ovn-metrics/0.log" Jun 12 16:47:50.220027 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.219983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/northd/0.log" Jun 12 16:47:50.241492 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.241462 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/nbdb/0.log" Jun 12 16:47:50.260223 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.260199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/sbdb/0.log" Jun 12 16:47:50.313789 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:50.313764 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fnx24_bc20facf-4830-4904-9b5f-9822847f8f83/ovnkube-controller/0.log" Jun 12 16:47:51.774215 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:51.774183 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rxzhf_27dc5b49-5875-41c8-ba20-2c93e9a6c05f/network-check-target-container/0.log" Jun 12 16:47:52.600606 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:52.600575 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dcf6t_448c9b26-7d4f-4c0a-be83-0c494f22390d/iptables-alerter/0.log" Jun 12 16:47:53.359354 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:53.359301 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-vblqc_72b4a92e-1b7b-4277-8501-8e9e7e78f148/tuned/0.log" Jun 12 16:47:56.340103 ip-10-0-128-123 kubenswrapper[2581]: I0612 16:47:56.340070 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7b994bc59-44wrh_0e80f17c-5120-4869-b7b7-c18d4f130aa6/service-ca-controller/0.log"