Jul 01 18:05:12.376445 ip-10-0-139-128 systemd[1]: Starting Kubernetes Kubelet... Jul 01 18:05:12.777170 ip-10-0-139-128 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:05:12.777170 ip-10-0-139-128 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 18:05:12.777170 ip-10-0-139-128 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:05:12.777170 ip-10-0-139-128 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 18:05:12.777170 ip-10-0-139-128 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:05:12.778593 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.778503 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 18:05:12.783965 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783940 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:05:12.783965 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783964 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:05:12.783965 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783968 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783973 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783976 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783979 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783981 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783984 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783987 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783990 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783992 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783995 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.783998 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784000 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784003 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784005 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784008 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784010 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784013 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784022 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784025 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784027 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:05:12.784067 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784030 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784032 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784035 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784038 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784040 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784042 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784045 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784047 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784050 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784052 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784055 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784057 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784060 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784062 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784065 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784068 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784071 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784074 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784076 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784079 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:05:12.784568 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784083 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784087 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784091 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784093 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784096 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784099 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784101 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784104 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784107 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784110 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784113 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784115 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784118 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784120 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784136 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784138 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784142 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784144 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784147 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784150 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:05:12.785055 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784152 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784154 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784157 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784160 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784162 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784165 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784168 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784170 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784173 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784176 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784178 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784181 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784183 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784186 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784188 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784191 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784194 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784196 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784199 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784202 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:05:12.785594 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784204 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784206 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784209 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784211 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784213 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784217 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784220 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784223 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784225 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784229 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784233 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784236 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784239 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784242 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784245 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784248 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784251 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784973 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784980 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:05:12.786068 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784984 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784987 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784989 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784992 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784996 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.784998 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785001 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785003 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785006 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785009 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785013 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785017 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785020 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785022 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785025 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785027 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785030 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785032 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785035 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785038 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:05:12.786555 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785041 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785043 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785046 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785048 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785051 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785053 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785056 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785059 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785061 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785064 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785066 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785069 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785071 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785074 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785077 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785079 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785082 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785085 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785089 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785092 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:05:12.787049 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785094 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785097 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785099 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785101 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785104 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785106 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785109 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785111 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785114 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785116 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785118 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785138 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785141 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785144 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785147 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785149 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785152 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785154 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785157 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785159 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:05:12.787560 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785163 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785166 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785170 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785173 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785176 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785179 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785181 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785185 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785187 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785190 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785194 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785197 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785199 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785202 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785204 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785207 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785209 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785212 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785214 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785217 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:05:12.788065 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785219 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785222 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785224 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785227 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785230 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785232 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785234 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785239 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785242 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785244 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785247 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785250 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785253 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785256 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785259 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785261 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785264 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785652 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785657 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:05:12.788581 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785659 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785662 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785665 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785667 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785670 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785672 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785675 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785677 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785680 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785683 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785685 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785688 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785690 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785693 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785696 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785698 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785701 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785704 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785706 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785709 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:05:12.789145 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785712 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785714 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785716 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785719 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785725 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785727 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785730 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785732 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785735 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785737 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785740 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785742 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785745 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785747 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785749 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785752 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785755 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785758 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785760 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785763 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:05:12.789665 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785765 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785767 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785770 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785772 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785775 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785777 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785782 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785785 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785788 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785791 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785793 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785795 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785798 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785800 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785803 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785805 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785809 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785812 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785814 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:05:12.790368 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785818 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785821 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785824 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785827 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785830 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785832 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785835 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785837 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785840 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785843 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785846 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785848 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785851 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785854 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785856 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785858 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785861 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785863 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785866 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785868 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:05:12.790841 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785870 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785873 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785876 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785879 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785881 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785883 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785886 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785889 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785891 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785895 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785897 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785901 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785904 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785906 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785909 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785911 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785914 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.785917 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.785993 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786000 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786006 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 18:05:12.791407 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786010 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786015 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786018 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786022 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786027 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786030 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786033 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786036 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786039 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786043 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786046 2561 flags.go:64] FLAG: --cgroup-root="" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786048 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786051 2561 flags.go:64] FLAG: --client-ca-file="" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786054 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786057 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786062 2561 flags.go:64] FLAG: --cluster-domain="" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786065 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786068 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786071 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786074 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786082 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786085 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786088 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 18:05:12.791929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786092 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786095 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786098 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786100 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786103 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786106 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786110 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786113 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786116 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786119 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786138 2561 flags.go:64] FLAG: --enable-server="true" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786142 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786146 2561 flags.go:64] FLAG: --event-burst="100" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786149 2561 flags.go:64] FLAG: --event-qps="50" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786152 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786155 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786158 2561 flags.go:64] FLAG: --eviction-hard="" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786161 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786164 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786167 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786170 2561 flags.go:64] FLAG: --eviction-soft="" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786173 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786175 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786178 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786181 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 18:05:12.792527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786184 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786186 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786189 2561 flags.go:64] FLAG: --feature-gates="" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786193 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786197 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786201 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786204 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786207 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786210 2561 flags.go:64] FLAG: --help="false" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786213 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-139-128.ec2.internal" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786216 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786218 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786221 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786225 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786228 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786230 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786233 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786236 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786239 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786242 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786245 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786248 2561 flags.go:64] FLAG: --kube-reserved="" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786251 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786253 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 18:05:12.793203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786257 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786260 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786262 2561 flags.go:64] FLAG: --lock-file="" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786265 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786267 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786270 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786276 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786278 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786281 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786283 2561 flags.go:64] FLAG: --logging-format="text" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786286 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786290 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786294 2561 flags.go:64] FLAG: --manifest-url="" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786296 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786301 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786304 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786308 2561 flags.go:64] FLAG: --max-pods="110" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786311 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786314 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786316 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786319 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786322 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786325 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786328 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786335 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 18:05:12.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786338 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786341 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786344 2561 flags.go:64] FLAG: --pod-cidr="" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786347 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786353 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786355 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786359 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786361 2561 flags.go:64] FLAG: --port="10250" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786364 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786367 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-076858686761d616f" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786370 2561 flags.go:64] FLAG: --qos-reserved="" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786373 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786376 2561 flags.go:64] FLAG: --register-node="true" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786378 2561 flags.go:64] FLAG: --register-with-taints="" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786382 2561 flags.go:64] FLAG: --registry-burst="10" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786384 2561 flags.go:64] FLAG: --registry-qps="5" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786387 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786390 2561 flags.go:64] FLAG: --reserved-memory="" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786393 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786396 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786400 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786403 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786405 2561 flags.go:64] FLAG: --runonce="false" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786408 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786411 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 18:05:12.794475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786414 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786417 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786419 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786422 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786425 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786428 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786431 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786434 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786436 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786439 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786442 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786446 2561 flags.go:64] FLAG: --system-cgroups="" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786448 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786455 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786458 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786460 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786465 2561 flags.go:64] FLAG: --tls-min-version="" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786468 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786470 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786473 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786476 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786479 2561 flags.go:64] FLAG: --v="2" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786483 2561 flags.go:64] FLAG: --version="false" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786487 2561 flags.go:64] FLAG: --vmodule="" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786490 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 18:05:12.795091 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.786493 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786606 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786612 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786616 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786619 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786622 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786625 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786628 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786631 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786634 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786636 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786639 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786642 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786645 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786648 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786650 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786652 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786655 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786658 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:05:12.795742 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786661 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786665 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786667 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786670 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786672 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786674 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786677 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786679 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786681 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786684 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786686 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786688 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786691 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786693 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786696 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786699 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786702 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786704 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786707 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786709 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:05:12.796264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786712 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786714 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786717 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786719 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786722 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786724 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786727 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786729 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786731 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786734 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786736 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786740 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786743 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786748 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786750 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786753 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786755 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786758 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786760 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786762 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:05:12.796774 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786765 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786767 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786770 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786772 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786775 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786777 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786779 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786783 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786785 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786788 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786790 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786793 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786795 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786798 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786800 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786802 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786805 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786807 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786809 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786812 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:05:12.797293 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786814 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786816 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786820 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786823 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786826 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786830 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786840 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786844 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786846 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786849 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786851 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786853 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786856 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786858 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786861 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786863 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786866 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786868 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786870 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:05:12.797805 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786874 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.786877 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.787796 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.795182 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.795200 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.795218 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.795224 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795292 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795297 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795300 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795303 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795307 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795310 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795312 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795315 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:05:12.798296 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795318 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795321 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795324 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795327 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795331 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795333 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795336 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795338 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795341 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795344 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795346 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795349 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795351 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795354 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795356 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795358 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795361 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795363 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795366 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795368 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:05:12.798702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795371 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795380 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795383 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795386 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795388 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795391 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795393 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795396 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795398 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795400 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795403 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795405 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795408 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795410 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795412 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795415 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795417 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795419 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795422 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795425 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:05:12.799311 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795427 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795429 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795432 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795434 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795436 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795439 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795441 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795443 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795446 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795448 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795451 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795454 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795456 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795461 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795470 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795473 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795476 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795479 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795483 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:05:12.799873 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795486 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795489 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795492 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795494 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795497 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795506 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795509 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795512 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795514 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795517 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795519 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795522 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795524 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795527 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795529 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795533 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795536 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795539 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795541 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795544 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:05:12.800363 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795546 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795549 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795551 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795554 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795557 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795561 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795563 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795566 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795576 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795580 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795584 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795588 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.795595 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795761 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795767 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:05:12.800850 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795770 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795773 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795776 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795778 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795781 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795784 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795787 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795789 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795792 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795794 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795796 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795799 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795801 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795804 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795806 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795808 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795811 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795813 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795815 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795818 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:05:12.801264 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795820 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795822 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795825 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795828 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795830 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795833 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795841 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795844 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795846 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795849 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795851 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795854 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795857 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795859 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795862 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795864 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795866 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795869 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795871 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795874 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:05:12.801743 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795876 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795878 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795880 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795883 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795885 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795888 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795890 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795892 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795895 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795897 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795900 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795902 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795904 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795907 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795910 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795912 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795915 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795919 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795922 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:05:12.802251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795932 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795936 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795938 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795941 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795944 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795947 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795949 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795952 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795954 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795957 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795959 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795962 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795965 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795967 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795969 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795972 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795974 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795976 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795979 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795981 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:05:12.802714 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795983 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795986 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795988 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795991 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795993 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795995 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.795998 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796001 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796003 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796006 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796008 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796011 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796013 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796021 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796024 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796027 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796029 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:05:12.803222 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:12.796031 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:05:12.803735 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.796036 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:05:12.803735 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.796207 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 18:05:12.803735 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.799343 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 18:05:12.803735 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.800956 2561 server.go:1019] "Starting client certificate rotation" Jul 01 18:05:12.803735 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.801059 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:05:12.803735 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.801098 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:05:12.806324 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.806170 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:05:12.811178 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.811152 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:05:12.824475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.824450 2561 log.go:25] "Validated CRI v1 runtime API" Jul 01 18:05:12.826663 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.826647 2561 log.go:25] "Validated CRI v1 image API" Jul 01 18:05:12.827493 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.827477 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 18:05:12.830090 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.830069 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a1a6a7cf-8acd-4d0e-83bd-321bae76dee0:/dev/nvme0n1p3 ed93c46b-fadd-4b98-822c-e67292fe6560:/dev/nvme0n1p4] Jul 01 18:05:12.830157 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.830090 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 18:05:12.833369 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.833347 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:05:12.836466 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.836350 2561 manager.go:216] Machine: {Timestamp:2026-07-01 18:05:12.834846631 +0000 UTC m=+0.336410926 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084404 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec244e0c78bcef2e89dfc5f31bf883b2 SystemUUID:ec244e0c-78bc-ef2e-89df-c5f31bf883b2 BootID:9232d063-c3cd-41b9-9d9f-6785f3f3a700 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:7d:22:cd:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:7d:22:cd:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:18:bc:0c:01:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 18:05:12.836466 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.836461 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 18:05:12.836582 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.836549 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 18:05:12.841724 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.841694 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 18:05:12.841869 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.841727 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 18:05:12.842449 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.842437 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 18:05:12.842481 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.842452 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 18:05:12.842481 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.842460 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:05:12.843151 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.843141 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:05:12.844088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.844076 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 18:05:12.847230 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847216 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:05:12.847545 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847534 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 18:05:12.847575 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847569 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 01 18:05:12.847602 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847580 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 18:05:12.847602 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847595 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 18:05:12.847664 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847606 2561 kubelet.go:398] "Adding apiserver pod source" Jul 01 18:05:12.847664 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847615 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 18:05:12.847997 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.847983 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:05:12.848041 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.848006 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:05:12.850769 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.850747 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 18:05:12.852719 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.852688 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 18:05:12.852816 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.852739 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 18:05:12.852967 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.852955 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 18:05:12.853002 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.852977 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 18:05:12.853002 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.852987 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 18:05:12.853002 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.852995 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 18:05:12.853088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853013 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 18:05:12.853088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853022 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 18:05:12.853494 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853479 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 18:05:12.853545 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853497 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 18:05:12.853545 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853510 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 18:05:12.853545 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853520 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 18:05:12.853667 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853552 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 18:05:12.853667 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.853607 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 18:05:12.855004 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.854985 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 18:05:12.855089 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.855016 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 18:05:12.858967 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.858950 2561 server.go:1268] "Started kubelet" Jul 01 18:05:12.859079 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.859030 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 18:05:12.859152 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.859090 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 18:05:12.859202 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.859180 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 18:05:12.860009 ip-10-0-139-128 systemd[1]: Started Kubernetes Kubelet. Jul 01 18:05:12.860231 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.860209 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 18:05:12.860501 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.860478 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 18:05:12.860577 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.860478 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 18:05:12.860577 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.860498 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 18:05:12.861071 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.861060 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 01 18:05:12.864418 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.864400 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 18:05:12.867068 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.866083 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-128.ec2.internal.18be3c94efa8703f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-128.ec2.internal,UID:ip-10-0-139-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-128.ec2.internal,},FirstTimestamp:2026-07-01 18:05:12.858914879 +0000 UTC m=+0.360479175,LastTimestamp:2026-07-01 18:05:12.858914879 +0000 UTC m=+0.360479175,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-128.ec2.internal,}" Jul 01 18:05:12.868069 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.868055 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 18:05:12.868118 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.868088 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 18:05:12.868202 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.868168 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:12.868850 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.868820 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 18:05:12.868952 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.868821 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 18:05:12.868952 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.868870 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 18:05:12.869050 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869019 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 01 18:05:12.869050 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869028 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 01 18:05:12.869155 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869101 2561 factory.go:55] Registering systemd factory Jul 01 18:05:12.869155 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869147 2561 factory.go:223] Registration of the systemd container factory successfully Jul 01 18:05:12.869419 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869405 2561 factory.go:153] Registering CRI-O factory Jul 01 18:05:12.869486 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869422 2561 factory.go:223] Registration of the crio container factory successfully Jul 01 18:05:12.869486 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869466 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 18:05:12.869486 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869486 2561 factory.go:103] Registering Raw factory Jul 01 18:05:12.869603 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869496 2561 manager.go:1196] Started watching for new ooms in manager Jul 01 18:05:12.869913 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.869895 2561 manager.go:349] Starting recovery of all containers Jul 01 18:05:12.873036 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.873009 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 18:05:12.873170 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.873148 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 18:05:12.880631 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.880464 2561 manager.go:354] Recovery completed Jul 01 18:05:12.881992 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.881963 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcs6p" Jul 01 18:05:12.886295 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.886281 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:05:12.888430 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.888413 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:05:12.888514 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.888445 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:05:12.888514 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.888457 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:05:12.888967 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.888953 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:05:12.889031 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.888993 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcs6p" Jul 01 18:05:12.889065 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.888956 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 18:05:12.889095 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.889065 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 18:05:12.889095 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.889083 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:05:12.889833 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.889816 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:05:12.889888 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.889845 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:05:12.889888 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.889855 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:05:12.890762 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.890674 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-128.ec2.internal.18be3c94f16ad21e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-128.ec2.internal,UID:ip-10-0-139-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-128.ec2.internal,},FirstTimestamp:2026-07-01 18:05:12.888431134 +0000 UTC m=+0.389995432,LastTimestamp:2026-07-01 18:05:12.888431134 +0000 UTC m=+0.389995432,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-128.ec2.internal,}" Jul 01 18:05:12.891312 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.891300 2561 policy_none.go:49] "None policy: Start" Jul 01 18:05:12.891351 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.891318 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 18:05:12.891351 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.891329 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 18:05:12.892503 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.892490 2561 policy_none.go:47] "Start" Jul 01 18:05:12.924739 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.924713 2561 manager.go:337] "Starting Device Plugin manager" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.924760 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.924777 2561 server.go:87] "Starting device plugin registration server" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.925104 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.925117 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.925224 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.925302 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.925310 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.925963 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.926018 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.935638 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.937036 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.937076 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.937098 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:12.937155 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 18:05:12.940241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:12.939321 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:05:13.025590 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.025554 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:05:13.027661 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.027605 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:05:13.027661 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.027641 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:05:13.027661 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.027651 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:05:13.027836 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.027684 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.037687 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.037666 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.037808 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.037694 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-128.ec2.internal\": node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:13.037808 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.037771 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal"] Jul 01 18:05:13.037894 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.037825 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:05:13.038752 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.038725 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:05:13.038811 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.038758 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:05:13.038811 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.038769 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:05:13.039907 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.039895 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:05:13.040029 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040013 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.040084 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040047 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:05:13.040670 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040653 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:05:13.040771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040687 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:05:13.040771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040701 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:05:13.040771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040653 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:05:13.040771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040765 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:05:13.040915 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.040779 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:05:13.041830 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.041818 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.041892 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.041842 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:05:13.042474 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.042462 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:05:13.042539 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.042480 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:05:13.042539 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.042489 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:05:13.067370 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.067351 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:13.068180 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.068165 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-128.ec2.internal\" not found" node="ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.070150 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.070116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbec032c3b8f31ccd043161433e00141-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal\" (UID: \"dbec032c3b8f31ccd043161433e00141\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.070210 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.070158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbec032c3b8f31ccd043161433e00141-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal\" (UID: \"dbec032c3b8f31ccd043161433e00141\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.070255 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.070208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75ff5128bd579c311d860ae653b44e0c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-128.ec2.internal\" (UID: \"75ff5128bd579c311d860ae653b44e0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.072657 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.072642 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-128.ec2.internal\" not found" node="ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.168098 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.168059 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:13.170313 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.170286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbec032c3b8f31ccd043161433e00141-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal\" (UID: \"dbec032c3b8f31ccd043161433e00141\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.170405 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.170323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbec032c3b8f31ccd043161433e00141-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal\" (UID: \"dbec032c3b8f31ccd043161433e00141\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.170405 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.170345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75ff5128bd579c311d860ae653b44e0c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-128.ec2.internal\" (UID: \"75ff5128bd579c311d860ae653b44e0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.170405 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.170385 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dbec032c3b8f31ccd043161433e00141-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal\" (UID: \"dbec032c3b8f31ccd043161433e00141\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.170405 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.170399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75ff5128bd579c311d860ae653b44e0c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-128.ec2.internal\" (UID: \"75ff5128bd579c311d860ae653b44e0c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.170523 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.170400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbec032c3b8f31ccd043161433e00141-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal\" (UID: \"dbec032c3b8f31ccd043161433e00141\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.268515 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.268487 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:13.369188 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.369158 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:13.371378 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.371360 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.375444 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.375200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.470148 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.470094 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:13.570668 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.570635 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-128.ec2.internal\" not found" Jul 01 18:05:13.669878 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.669812 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:05:13.751455 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.751429 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:05:13.768443 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.768422 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.781214 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.781192 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:05:13.783702 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.783685 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" Jul 01 18:05:13.793838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.793823 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:05:13.799997 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.799964 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 18:05:13.800173 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.800143 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 18:05:13.800293 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.800177 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 18:05:13.848247 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.848215 2561 apiserver.go:52] "Watching apiserver" Jul 01 18:05:13.856343 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.856320 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 18:05:13.860962 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.860050 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7lfk6","kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6","openshift-cluster-node-tuning-operator/tuned-8gqkk","openshift-dns/node-resolver-5cftj","openshift-image-registry/node-ca-jhmvd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal","openshift-multus/multus-additional-cni-plugins-lhcjg","kube-system/konnectivity-agent-cgzqv","openshift-multus/multus-gj55x","openshift-multus/network-metrics-daemon-88zx4","openshift-network-diagnostics/network-check-target-scsm9","openshift-network-operator/iptables-alerter-4vxkh","openshift-ovn-kubernetes/ovnkube-node-khzgt"] Jul 01 18:05:13.860962 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.860196 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:05:13.862185 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.862170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.862263 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.862241 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:13.863397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.863379 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.864655 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.864638 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.865838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.865806 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 18:05:13.865838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.865821 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 18:05:13.865838 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.865836 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.866040 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.865822 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 18:05:13.866040 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.865887 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t5g8q\"" Jul 01 18:05:13.866513 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.866500 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 18:05:13.866692 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.866677 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:05:13.866817 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.866800 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rlrdh\"" Jul 01 18:05:13.867006 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.866993 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.868062 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.868047 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 18:05:13.868197 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.868186 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 18:05:13.868419 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.868397 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 18:05:13.868476 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.868465 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.868522 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.868485 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8kbc8\"" Jul 01 18:05:13.869175 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.869159 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 18:05:13.869260 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.869185 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 18:05:13.869260 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.869191 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4ngln\"" Jul 01 18:05:13.869260 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.869164 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 18:05:13.869672 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.869657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:13.870708 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.870693 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 18:05:13.870791 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.870754 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 18:05:13.870925 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.870911 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nchgf\"" Jul 01 18:05:13.871119 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.871102 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 18:05:13.871194 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.871112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.871280 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.871268 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 18:05:13.871325 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.871283 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 18:05:13.872028 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.872014 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 18:05:13.872089 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.872023 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 18:05:13.872171 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.872083 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sqvnb\"" Jul 01 18:05:13.872376 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.872362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:13.872447 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.872430 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:13.873448 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.873430 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 18:05:13.873448 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.873445 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g9wpm\"" Jul 01 18:05:13.873563 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.873521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:13.873613 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.873571 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:13.874908 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.874890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.874996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.874912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.874996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.874928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-registration-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.874996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.874943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-systemd\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.874996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.874956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-sys\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.874996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.874979 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:13.874996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.874986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnkqk\" (UniqueName: \"kubernetes.io/projected/32c1ea41-21e5-4d23-a152-f780441562d9-kube-api-access-bnkqk\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875024 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cnibin\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0c55c6-b31b-4351-be70-1634dc904f25-kubelet-config\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0c55c6-b31b-4351-be70-1634dc904f25-dbus\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27d60be-b9f0-43ac-a658-dbbba04242eb-tmp-dir\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccfcz\" (UniqueName: \"kubernetes.io/projected/ef74ef40-28d4-4fe1-9e39-4585c07719c5-kube-api-access-ccfcz\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-device-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-run\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-lib-modules\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2cn4\" (UniqueName: \"kubernetes.io/projected/ddb70c9a-7989-498f-91ab-bd0f305c25ad-kube-api-access-v2cn4\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-host\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875310 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ac15a45-8118-4b27-8a47-4f43c83b48db-konnectivity-ca\") pod \"konnectivity-agent-cgzqv\" (UID: \"8ac15a45-8118-4b27-8a47-4f43c83b48db\") " pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef74ef40-28d4-4fe1-9e39-4585c07719c5-host\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysctl-conf\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32c1ea41-21e5-4d23-a152-f780441562d9-tmp\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ac15a45-8118-4b27-8a47-4f43c83b48db-agent-certs\") pod \"konnectivity-agent-cgzqv\" (UID: \"8ac15a45-8118-4b27-8a47-4f43c83b48db\") " pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875459 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysconfig\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-kubernetes\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysctl-d\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-var-lib-kubelet\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32c1ea41-21e5-4d23-a152-f780441562d9-etc-tuned\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-sys-fs\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-modprobe-d\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.875697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b27d60be-b9f0-43ac-a658-dbbba04242eb-hosts-file\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.876182 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef74ef40-28d4-4fe1-9e39-4585c07719c5-serviceca\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.876182 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xftv\" (UniqueName: \"kubernetes.io/projected/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-kube-api-access-5xftv\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.876182 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-socket-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.876182 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkscb\" (UniqueName: \"kubernetes.io/projected/b27d60be-b9f0-43ac-a658-dbbba04242eb-kube-api-access-vkscb\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.876182 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.875781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-os-release\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.876441 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.876423 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.877152 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.877118 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:05:13.877338 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.877324 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 18:05:13.877415 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.877396 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 18:05:13.877415 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.877408 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kp4m4\"" Jul 01 18:05:13.879106 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.879090 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nrdxc\"" Jul 01 18:05:13.879404 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.879386 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 18:05:13.879454 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.879394 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 18:05:13.880269 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.880249 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 18:05:13.880353 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.880308 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 18:05:13.880353 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.880333 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 18:05:13.880475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.880411 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 18:05:13.883192 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.883175 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:05:13.893326 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.893289 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 18:00:13 +0000 UTC" deadline="2028-02-17 11:59:41.46927335 +0000 UTC" Jul 01 18:05:13.893326 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.893322 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14297h54m27.575954772s" Jul 01 18:05:13.921995 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.921928 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wb276" Jul 01 18:05:13.929869 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.929849 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wb276" Jul 01 18:05:13.969737 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.969717 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 18:05:13.975964 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.975942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-kubelet\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.976088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.975969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:13.976088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.975985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wtrk\" (UniqueName: \"kubernetes.io/projected/258a0859-f254-49cc-adff-c015d01b1954-kube-api-access-5wtrk\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.976088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-host\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.976088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-ovnkube-config\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.976249 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-host\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.976249 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-system-cni-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.976249 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef74ef40-28d4-4fe1-9e39-4585c07719c5-host\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.976249 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.976249 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976224 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef74ef40-28d4-4fe1-9e39-4585c07719c5-host\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.976397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976259 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-slash\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.976397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-system-cni-dir\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.976397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-env-overrides\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.976397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-os-release\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.976397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.976397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-kubernetes\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-ovnkube-script-lib\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-kubernetes\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.976462 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-k8s-cni-cncf-io\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:13.976511 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret podName:4a0c55c6-b31b-4351-be70-1634dc904f25 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:14.476495006 +0000 UTC m=+1.978059289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret") pod "global-pull-secret-syncer-7lfk6" (UID: "4a0c55c6-b31b-4351-be70-1634dc904f25") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32c1ea41-21e5-4d23-a152-f780441562d9-etc-tuned\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4ee8c01-8c60-4607-9feb-13224e0e1b41-iptables-alerter-script\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:13.976567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-run-netns\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-var-lib-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-cni-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-modprobe-d\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef74ef40-28d4-4fe1-9e39-4585c07719c5-serviceca\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xftv\" (UniqueName: \"kubernetes.io/projected/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-kube-api-access-5xftv\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-socket-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkscb\" (UniqueName: \"kubernetes.io/projected/b27d60be-b9f0-43ac-a658-dbbba04242eb-kube-api-access-vkscb\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976823 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-modprobe-d\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-systemd\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-socket-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976874 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976945 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-systemd\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.977007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.976995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-sys\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-systemd\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef74ef40-28d4-4fe1-9e39-4585c07719c5-serviceca\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-cni-bin\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-sys\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0c55c6-b31b-4351-be70-1634dc904f25-dbus\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4ee8c01-8c60-4607-9feb-13224e0e1b41-host-slash\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-run-ovn-kubernetes\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a0c55c6-b31b-4351-be70-1634dc904f25-dbus\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-systemd-units\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-cnibin\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977257 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-cni-multus\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-kubelet\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-etc-kubernetes\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2cn4\" (UniqueName: \"kubernetes.io/projected/ddb70c9a-7989-498f-91ab-bd0f305c25ad-kube-api-access-v2cn4\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.977640 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977346 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ac15a45-8118-4b27-8a47-4f43c83b48db-konnectivity-ca\") pod \"konnectivity-agent-cgzqv\" (UID: \"8ac15a45-8118-4b27-8a47-4f43c83b48db\") " pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcljq\" (UniqueName: \"kubernetes.io/projected/a4ee8c01-8c60-4607-9feb-13224e0e1b41-kube-api-access-rcljq\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-log-socket\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-conf-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysctl-conf\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32c1ea41-21e5-4d23-a152-f780441562d9-tmp\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977489 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ac15a45-8118-4b27-8a47-4f43c83b48db-agent-certs\") pod \"konnectivity-agent-cgzqv\" (UID: \"8ac15a45-8118-4b27-8a47-4f43c83b48db\") " pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-node-log\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/258a0859-f254-49cc-adff-c015d01b1954-cni-binary-copy\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysctl-conf\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysconfig\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977673 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysctl-d\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-cni-netd\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.979686 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-cni-bin\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977755 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysconfig\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-multus-certs\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977903 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-etc-sysctl-d\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-var-lib-kubelet\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.977978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-etc-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-ovn\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978034 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-socket-dir-parent\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-sys-fs\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b27d60be-b9f0-43ac-a658-dbbba04242eb-hosts-file\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-var-lib-kubelet\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978092 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978099 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-registration-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnkqk\" (UniqueName: \"kubernetes.io/projected/32c1ea41-21e5-4d23-a152-f780441562d9-kube-api-access-bnkqk\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b27d60be-b9f0-43ac-a658-dbbba04242eb-hosts-file\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-sys-fs\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978262 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-registration-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.980373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da551ab-27cc-48d2-a260-4c3606a43976-ovn-node-metrics-cert\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rz9q\" (UniqueName: \"kubernetes.io/projected/0da551ab-27cc-48d2-a260-4c3606a43976-kube-api-access-2rz9q\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-os-release\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbj8w\" (UniqueName: \"kubernetes.io/projected/007188c8-8039-4d6a-8dc6-e80b4698e864-kube-api-access-hbj8w\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-netns\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/258a0859-f254-49cc-adff-c015d01b1954-multus-daemon-config\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cnibin\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0c55c6-b31b-4351-be70-1634dc904f25-kubelet-config\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-hostroot\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ac15a45-8118-4b27-8a47-4f43c83b48db-konnectivity-ca\") pod \"konnectivity-agent-cgzqv\" (UID: \"8ac15a45-8118-4b27-8a47-4f43c83b48db\") " pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27d60be-b9f0-43ac-a658-dbbba04242eb-tmp-dir\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccfcz\" (UniqueName: \"kubernetes.io/projected/ef74ef40-28d4-4fe1-9e39-4585c07719c5-kube-api-access-ccfcz\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-device-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-run\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-lib-modules\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.980831 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978735 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ddb70c9a-7989-498f-91ab-bd0f305c25ad-device-dir\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978850 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-run\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978953 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32c1ea41-21e5-4d23-a152-f780441562d9-lib-modules\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-os-release\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.978999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-cnibin\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.979044 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a0c55c6-b31b-4351-be70-1634dc904f25-kubelet-config\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.979311 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27d60be-b9f0-43ac-a658-dbbba04242eb-tmp-dir\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.980212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32c1ea41-21e5-4d23-a152-f780441562d9-etc-tuned\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.980233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32c1ea41-21e5-4d23-a152-f780441562d9-tmp\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.981349 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.980476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ac15a45-8118-4b27-8a47-4f43c83b48db-agent-certs\") pod \"konnectivity-agent-cgzqv\" (UID: \"8ac15a45-8118-4b27-8a47-4f43c83b48db\") " pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:13.985320 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.985300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnkqk\" (UniqueName: \"kubernetes.io/projected/32c1ea41-21e5-4d23-a152-f780441562d9-kube-api-access-bnkqk\") pod \"tuned-8gqkk\" (UID: \"32c1ea41-21e5-4d23-a152-f780441562d9\") " pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:13.985441 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.985356 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2cn4\" (UniqueName: \"kubernetes.io/projected/ddb70c9a-7989-498f-91ab-bd0f305c25ad-kube-api-access-v2cn4\") pod \"aws-ebs-csi-driver-node-xgdj6\" (UID: \"ddb70c9a-7989-498f-91ab-bd0f305c25ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:13.985529 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.985511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xftv\" (UniqueName: \"kubernetes.io/projected/5b6bb22e-bafd-46fa-92e2-855947e4f9fe-kube-api-access-5xftv\") pod \"multus-additional-cni-plugins-lhcjg\" (UID: \"5b6bb22e-bafd-46fa-92e2-855947e4f9fe\") " pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:13.985935 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.985916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkscb\" (UniqueName: \"kubernetes.io/projected/b27d60be-b9f0-43ac-a658-dbbba04242eb-kube-api-access-vkscb\") pod \"node-resolver-5cftj\" (UID: \"b27d60be-b9f0-43ac-a658-dbbba04242eb\") " pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:13.986010 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:13.985918 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccfcz\" (UniqueName: \"kubernetes.io/projected/ef74ef40-28d4-4fe1-9e39-4585c07719c5-kube-api-access-ccfcz\") pod \"node-ca-jhmvd\" (UID: \"ef74ef40-28d4-4fe1-9e39-4585c07719c5\") " pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:14.080053 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-etc-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080053 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-ovn\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-socket-dir-parent\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-etc-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-ovn\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-socket-dir-parent\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da551ab-27cc-48d2-a260-4c3606a43976-ovn-node-metrics-cert\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rz9q\" (UniqueName: \"kubernetes.io/projected/0da551ab-27cc-48d2-a260-4c3606a43976-kube-api-access-2rz9q\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbj8w\" (UniqueName: \"kubernetes.io/projected/007188c8-8039-4d6a-8dc6-e80b4698e864-kube-api-access-hbj8w\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-netns\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/258a0859-f254-49cc-adff-c015d01b1954-multus-daemon-config\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-hostroot\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080344 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-kubelet\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080355 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-netns\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wtrk\" (UniqueName: \"kubernetes.io/projected/258a0859-f254-49cc-adff-c015d01b1954-kube-api-access-5wtrk\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-hostroot\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-ovnkube-config\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080465 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-kubelet\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-system-cni-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080521 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-system-cni-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.080520 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-slash\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-env-overrides\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-slash\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.080619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:14.58058605 +0000 UTC m=+2.082150335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-os-release\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-ovnkube-script-lib\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.080896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-k8s-cni-cncf-io\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-os-release\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4ee8c01-8c60-4607-9feb-13224e0e1b41-iptables-alerter-script\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080794 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-run-netns\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-k8s-cni-cncf-io\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-var-lib-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-cni-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-run-netns\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-var-lib-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-openvswitch\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-cni-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/258a0859-f254-49cc-adff-c015d01b1954-multus-daemon-config\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.080989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-systemd\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081058 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-run-systemd\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.081750 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-ovnkube-config\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-cni-bin\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-cni-bin\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4ee8c01-8c60-4607-9feb-13224e0e1b41-host-slash\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081261 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-run-ovn-kubernetes\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-systemd-units\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-cnibin\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-cni-multus\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-run-ovn-kubernetes\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-kubelet\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081382 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4ee8c01-8c60-4607-9feb-13224e0e1b41-host-slash\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-etc-kubernetes\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081450 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-cnibin\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-kubelet\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081424 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-systemd-units\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081425 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4ee8c01-8c60-4607-9feb-13224e0e1b41-iptables-alerter-script\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-etc-kubernetes\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081342 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-env-overrides\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.082410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-cni-multus\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcljq\" (UniqueName: \"kubernetes.io/projected/a4ee8c01-8c60-4607-9feb-13224e0e1b41-kube-api-access-rcljq\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081528 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0da551ab-27cc-48d2-a260-4c3606a43976-ovnkube-script-lib\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-log-socket\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081568 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-conf-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-node-log\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081631 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-log-socket\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/258a0859-f254-49cc-adff-c015d01b1954-cni-binary-copy\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-multus-conf-dir\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-cni-netd\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-cni-bin\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-node-log\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081721 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0da551ab-27cc-48d2-a260-4c3606a43976-host-cni-netd\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-multus-certs\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-run-multus-certs\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.081802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/258a0859-f254-49cc-adff-c015d01b1954-host-var-lib-cni-bin\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.082790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/258a0859-f254-49cc-adff-c015d01b1954-cni-binary-copy\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.083143 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.083050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da551ab-27cc-48d2-a260-4c3606a43976-ovn-node-metrics-cert\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.091349 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.091325 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:05:14.091349 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.091350 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:05:14.091529 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.091364 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6clb6 for pod openshift-network-diagnostics/network-check-target-scsm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:14.091529 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.091487 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6 podName:17ca6bb4-dc40-47ed-97df-abdc439fd0a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:14.591467092 +0000 UTC m=+2.093031381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6clb6" (UniqueName: "kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6") pod "network-check-target-scsm9" (UID: "17ca6bb4-dc40-47ed-97df-abdc439fd0a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:14.093088 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.093054 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wtrk\" (UniqueName: \"kubernetes.io/projected/258a0859-f254-49cc-adff-c015d01b1954-kube-api-access-5wtrk\") pod \"multus-gj55x\" (UID: \"258a0859-f254-49cc-adff-c015d01b1954\") " pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.093699 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.093678 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rz9q\" (UniqueName: \"kubernetes.io/projected/0da551ab-27cc-48d2-a260-4c3606a43976-kube-api-access-2rz9q\") pod \"ovnkube-node-khzgt\" (UID: \"0da551ab-27cc-48d2-a260-4c3606a43976\") " pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.093810 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.093791 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcljq\" (UniqueName: \"kubernetes.io/projected/a4ee8c01-8c60-4607-9feb-13224e0e1b41-kube-api-access-rcljq\") pod \"iptables-alerter-4vxkh\" (UID: \"a4ee8c01-8c60-4607-9feb-13224e0e1b41\") " pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:14.093955 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.093937 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbj8w\" (UniqueName: \"kubernetes.io/projected/007188c8-8039-4d6a-8dc6-e80b4698e864-kube-api-access-hbj8w\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:14.193410 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.193304 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" Jul 01 18:05:14.209270 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.209232 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" Jul 01 18:05:14.235580 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.235541 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5cftj" Jul 01 18:05:14.249897 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.249840 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhmvd" Jul 01 18:05:14.266422 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.266386 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" Jul 01 18:05:14.274621 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.274595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:14.294913 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.294873 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gj55x" Jul 01 18:05:14.312603 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.312571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vxkh" Jul 01 18:05:14.318976 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.318949 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:14.485444 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.485359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:14.485586 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.485518 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:14.485586 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.485581 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret podName:4a0c55c6-b31b-4351-be70-1634dc904f25 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:15.485562441 +0000 UTC m=+2.987126728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret") pod "global-pull-secret-syncer-7lfk6" (UID: "4a0c55c6-b31b-4351-be70-1634dc904f25") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:14.586212 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.586172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:14.586387 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.586322 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:14.586387 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.586384 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:15.586367975 +0000 UTC m=+3.087932260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:14.686662 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.686629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:14.686902 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.686822 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:05:14.686902 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.686850 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:05:14.686902 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.686865 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6clb6 for pod openshift-network-diagnostics/network-check-target-scsm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:14.687029 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:14.686940 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6 podName:17ca6bb4-dc40-47ed-97df-abdc439fd0a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:15.686918844 +0000 UTC m=+3.188483130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6clb6" (UniqueName: "kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6") pod "network-check-target-scsm9" (UID: "17ca6bb4-dc40-47ed-97df-abdc439fd0a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:14.752436 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.752382 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb70c9a_7989_498f_91ab_bd0f305c25ad.slice/crio-9b30b4d093916b1d76cddb3d198cdb53411f7b4061725d7ed664efbc165d4450 WatchSource:0}: Error finding container 9b30b4d093916b1d76cddb3d198cdb53411f7b4061725d7ed664efbc165d4450: Status 404 returned error can't find the container with id 9b30b4d093916b1d76cddb3d198cdb53411f7b4061725d7ed664efbc165d4450 Jul 01 18:05:14.752787 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.752765 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c1ea41_21e5_4d23_a152_f780441562d9.slice/crio-b16a55b610608165539196a116165071db8e90d106f67807014acef48f457ff5 WatchSource:0}: Error finding container b16a55b610608165539196a116165071db8e90d106f67807014acef48f457ff5: Status 404 returned error can't find the container with id b16a55b610608165539196a116165071db8e90d106f67807014acef48f457ff5 Jul 01 18:05:14.759775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.759755 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:05:14.762457 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.762428 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef74ef40_28d4_4fe1_9e39_4585c07719c5.slice/crio-654f4f9047ec08df638a9e78b58daf45e7d251ba6a7ad5d0dbb014b2d9e2567e WatchSource:0}: Error finding container 654f4f9047ec08df638a9e78b58daf45e7d251ba6a7ad5d0dbb014b2d9e2567e: Status 404 returned error can't find the container with id 654f4f9047ec08df638a9e78b58daf45e7d251ba6a7ad5d0dbb014b2d9e2567e Jul 01 18:05:14.777251 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.777217 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258a0859_f254_49cc_adff_c015d01b1954.slice/crio-71e04af47f547b6b8c6476938bc720e4fb8248318059b969b3f7cf7441ae3bb0 WatchSource:0}: Error finding container 71e04af47f547b6b8c6476938bc720e4fb8248318059b969b3f7cf7441ae3bb0: Status 404 returned error can't find the container with id 71e04af47f547b6b8c6476938bc720e4fb8248318059b969b3f7cf7441ae3bb0 Jul 01 18:05:14.783625 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.783595 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6bb22e_bafd_46fa_92e2_855947e4f9fe.slice/crio-276db18a3e8beb2ace1d581aece260d5f3fadc6fe1ea2a99372ba71b5eaac080 WatchSource:0}: Error finding container 276db18a3e8beb2ace1d581aece260d5f3fadc6fe1ea2a99372ba71b5eaac080: Status 404 returned error can't find the container with id 276db18a3e8beb2ace1d581aece260d5f3fadc6fe1ea2a99372ba71b5eaac080 Jul 01 18:05:14.787650 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.787619 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac15a45_8118_4b27_8a47_4f43c83b48db.slice/crio-4f09835651db6c873b8a893c13a5154b1fc2e58754125e58a0777949a684e846 WatchSource:0}: Error finding container 4f09835651db6c873b8a893c13a5154b1fc2e58754125e58a0777949a684e846: Status 404 returned error can't find the container with id 4f09835651db6c873b8a893c13a5154b1fc2e58754125e58a0777949a684e846 Jul 01 18:05:14.792160 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.792112 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da551ab_27cc_48d2_a260_4c3606a43976.slice/crio-33e6a14e1e105e573745718d2c78ecf42510a47f2948ddb0aa5056048b5a21c6 WatchSource:0}: Error finding container 33e6a14e1e105e573745718d2c78ecf42510a47f2948ddb0aa5056048b5a21c6: Status 404 returned error can't find the container with id 33e6a14e1e105e573745718d2c78ecf42510a47f2948ddb0aa5056048b5a21c6 Jul 01 18:05:14.792897 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.792869 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ee8c01_8c60_4607_9feb_13224e0e1b41.slice/crio-b9946ab36d3b993ec5c1e7287a03011ade54e67d5ae17197da9cce7d70f1c044 WatchSource:0}: Error finding container b9946ab36d3b993ec5c1e7287a03011ade54e67d5ae17197da9cce7d70f1c044: Status 404 returned error can't find the container with id b9946ab36d3b993ec5c1e7287a03011ade54e67d5ae17197da9cce7d70f1c044 Jul 01 18:05:14.812519 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:14.812492 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27d60be_b9f0_43ac_a658_dbbba04242eb.slice/crio-48a0006d600a45fe40085fd283c2c4cd1a3f2f319017fd4fae1c31e47fb3197c WatchSource:0}: Error finding container 48a0006d600a45fe40085fd283c2c4cd1a3f2f319017fd4fae1c31e47fb3197c: Status 404 returned error can't find the container with id 48a0006d600a45fe40085fd283c2c4cd1a3f2f319017fd4fae1c31e47fb3197c Jul 01 18:05:14.932174 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.932125 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:00:14 +0000 UTC" deadline="2028-03-20 01:46:06.028184432 +0000 UTC" Jul 01 18:05:14.932174 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.932172 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15055h40m51.096016188s" Jul 01 18:05:14.944287 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.944232 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerStarted","Data":"276db18a3e8beb2ace1d581aece260d5f3fadc6fe1ea2a99372ba71b5eaac080"} Jul 01 18:05:14.945334 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.945308 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhmvd" event={"ID":"ef74ef40-28d4-4fe1-9e39-4585c07719c5","Type":"ContainerStarted","Data":"654f4f9047ec08df638a9e78b58daf45e7d251ba6a7ad5d0dbb014b2d9e2567e"} Jul 01 18:05:14.946329 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.946309 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" event={"ID":"ddb70c9a-7989-498f-91ab-bd0f305c25ad","Type":"ContainerStarted","Data":"9b30b4d093916b1d76cddb3d198cdb53411f7b4061725d7ed664efbc165d4450"} Jul 01 18:05:14.947364 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.947338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" event={"ID":"32c1ea41-21e5-4d23-a152-f780441562d9","Type":"ContainerStarted","Data":"b16a55b610608165539196a116165071db8e90d106f67807014acef48f457ff5"} Jul 01 18:05:14.948458 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.948419 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5cftj" event={"ID":"b27d60be-b9f0-43ac-a658-dbbba04242eb","Type":"ContainerStarted","Data":"48a0006d600a45fe40085fd283c2c4cd1a3f2f319017fd4fae1c31e47fb3197c"} Jul 01 18:05:14.949476 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.949458 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vxkh" event={"ID":"a4ee8c01-8c60-4607-9feb-13224e0e1b41","Type":"ContainerStarted","Data":"b9946ab36d3b993ec5c1e7287a03011ade54e67d5ae17197da9cce7d70f1c044"} Jul 01 18:05:14.950557 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.950531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cgzqv" event={"ID":"8ac15a45-8118-4b27-8a47-4f43c83b48db","Type":"ContainerStarted","Data":"4f09835651db6c873b8a893c13a5154b1fc2e58754125e58a0777949a684e846"} Jul 01 18:05:14.951601 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.951582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gj55x" event={"ID":"258a0859-f254-49cc-adff-c015d01b1954","Type":"ContainerStarted","Data":"71e04af47f547b6b8c6476938bc720e4fb8248318059b969b3f7cf7441ae3bb0"} Jul 01 18:05:14.952697 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:14.952679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"33e6a14e1e105e573745718d2c78ecf42510a47f2948ddb0aa5056048b5a21c6"} Jul 01 18:05:15.128081 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.128029 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c31f1f5cf0b2f04acb86acba1c5b6b839a148ba2a82a0ffd2a747464e10d379: reading manifest sha256:0255b6d09d35e8c4912937161e6e0e46191a360d0feedcad858efed4ee514a65 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c31f1f5cf0b2f04acb86acba1c5b6b839a148ba2a82a0ffd2a747464e10d379" Jul 01 18:05:15.128272 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.128178 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container node-ca start failed in pod node-ca-jhmvd_openshift-image-registry(ef74ef40-28d4-4fe1-9e39-4585c07719c5): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c31f1f5cf0b2f04acb86acba1c5b6b839a148ba2a82a0ffd2a747464e10d379: reading manifest sha256:0255b6d09d35e8c4912937161e6e0e46191a360d0feedcad858efed4ee514a65 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 01 18:05:15.128272 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.128216 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c31f1f5cf0b2f04acb86acba1c5b6b839a148ba2a82a0ffd2a747464e10d379: reading manifest sha256:0255b6d09d35e8c4912937161e6e0e46191a360d0feedcad858efed4ee514a65 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-image-registry/node-ca-jhmvd" podUID="ef74ef40-28d4-4fe1-9e39-4585c07719c5" Jul 01 18:05:15.156456 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.156402 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:05:15.494179 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.494124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:15.494396 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.494353 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:15.494477 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.494434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret podName:4a0c55c6-b31b-4351-be70-1634dc904f25 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:17.494405065 +0000 UTC m=+4.995969351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret") pod "global-pull-secret-syncer-7lfk6" (UID: "4a0c55c6-b31b-4351-be70-1634dc904f25") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:15.595558 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.595514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:15.595755 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.595707 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:15.595817 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.595770 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:17.59575219 +0000 UTC m=+5.097316477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:15.696900 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.696858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:15.697103 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.697047 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:05:15.697103 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.697065 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:05:15.697103 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.697076 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6clb6 for pod openshift-network-diagnostics/network-check-target-scsm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:15.697318 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.697124 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6 podName:17ca6bb4-dc40-47ed-97df-abdc439fd0a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:17.697109971 +0000 UTC m=+5.198674256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6clb6" (UniqueName: "kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6") pod "network-check-target-scsm9" (UID: "17ca6bb4-dc40-47ed-97df-abdc439fd0a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:15.933347 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.933283 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:00:14 +0000 UTC" deadline="2027-12-20 19:43:12.107740482 +0000 UTC" Jul 01 18:05:15.933347 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.933343 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12889h37m56.174401783s" Jul 01 18:05:15.937802 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.937766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:15.938000 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.937917 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:15.938072 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.938017 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:15.938133 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.938107 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:15.938224 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:15.938187 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:15.938777 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.938748 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:15.959298 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:15.959249 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c31f1f5cf0b2f04acb86acba1c5b6b839a148ba2a82a0ffd2a747464e10d379\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c31f1f5cf0b2f04acb86acba1c5b6b839a148ba2a82a0ffd2a747464e10d379: reading manifest sha256:0255b6d09d35e8c4912937161e6e0e46191a360d0feedcad858efed4ee514a65 in quay.io/openshift-release-dev/ocp-v4.0-art-dev: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-image-registry/node-ca-jhmvd" podUID="ef74ef40-28d4-4fe1-9e39-4585c07719c5" Jul 01 18:05:16.577931 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:16.577653 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:05:17.513565 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:17.513485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:17.514084 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.513692 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:17.514084 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.513792 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret podName:4a0c55c6-b31b-4351-be70-1634dc904f25 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:21.513769625 +0000 UTC m=+9.015333915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret") pod "global-pull-secret-syncer-7lfk6" (UID: "4a0c55c6-b31b-4351-be70-1634dc904f25") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:17.614222 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:17.614180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:17.614413 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.614330 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:17.614413 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.614404 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:21.614384094 +0000 UTC m=+9.115948394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:17.715314 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:17.715273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:17.715483 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.715434 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:05:17.715483 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.715465 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:05:17.715483 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.715481 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6clb6 for pod openshift-network-diagnostics/network-check-target-scsm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:17.715627 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.715553 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6 podName:17ca6bb4-dc40-47ed-97df-abdc439fd0a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:21.715529607 +0000 UTC m=+9.217093956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6clb6" (UniqueName: "kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6") pod "network-check-target-scsm9" (UID: "17ca6bb4-dc40-47ed-97df-abdc439fd0a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:17.938175 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:17.938116 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:17.938344 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.938287 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:17.938768 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:17.938748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:17.938891 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.938860 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:17.938940 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:17.938915 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:17.939017 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:17.938998 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:19.938236 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:19.937359 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:19.938236 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:19.937477 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:19.938236 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:19.937925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:19.938236 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:19.938066 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:19.938236 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:19.938131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:19.939248 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:19.938748 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:21.549612 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:21.549566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:21.550110 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.549793 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:21.550110 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.549866 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret podName:4a0c55c6-b31b-4351-be70-1634dc904f25 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:29.549844036 +0000 UTC m=+17.051408323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret") pod "global-pull-secret-syncer-7lfk6" (UID: "4a0c55c6-b31b-4351-be70-1634dc904f25") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:21.651330 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:21.650671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:21.651330 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.650853 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:21.651330 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.650931 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:29.650906908 +0000 UTC m=+17.152471214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:21.751249 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:21.751103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:21.751443 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.751326 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:05:21.751443 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.751354 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:05:21.751443 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.751369 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6clb6 for pod openshift-network-diagnostics/network-check-target-scsm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:21.751443 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.751436 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6 podName:17ca6bb4-dc40-47ed-97df-abdc439fd0a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:29.751415318 +0000 UTC m=+17.252979624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6clb6" (UniqueName: "kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6") pod "network-check-target-scsm9" (UID: "17ca6bb4-dc40-47ed-97df-abdc439fd0a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:21.937996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:21.937955 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:21.938221 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.938097 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:21.938556 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:21.938536 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:21.938677 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.938656 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:21.938742 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:21.938708 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:21.938799 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:21.938777 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:23.937878 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:23.937831 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:23.938360 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:23.937972 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:23.938360 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:23.938235 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:23.938477 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:23.938354 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:23.938477 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:23.938373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:23.938477 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:23.938462 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:25.937501 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:25.937457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:25.938015 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:25.937532 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:25.938015 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:25.937703 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:25.938015 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:25.937724 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:25.938015 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:25.937799 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:25.938015 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:25.937917 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:27.937746 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:27.937708 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:27.937746 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:27.937737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:27.938359 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:27.937829 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:27.938359 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:27.937877 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:27.938359 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:27.937968 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:27.938359 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:27.938043 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:29.614891 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:29.614854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:29.615358 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.615024 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:29.615358 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.615099 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret podName:4a0c55c6-b31b-4351-be70-1634dc904f25 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:45.615079452 +0000 UTC m=+33.116643739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret") pod "global-pull-secret-syncer-7lfk6" (UID: "4a0c55c6-b31b-4351-be70-1634dc904f25") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:29.715977 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:29.715924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:29.716160 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.716074 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:29.716160 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.716156 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:45.716140368 +0000 UTC m=+33.217704664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:29.817003 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:29.816963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:29.817206 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.817111 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:05:29.817206 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.817144 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:05:29.817206 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.817154 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6clb6 for pod openshift-network-diagnostics/network-check-target-scsm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:29.817206 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.817201 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6 podName:17ca6bb4-dc40-47ed-97df-abdc439fd0a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:45.81718795 +0000 UTC m=+33.318752233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6clb6" (UniqueName: "kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6") pod "network-check-target-scsm9" (UID: "17ca6bb4-dc40-47ed-97df-abdc439fd0a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:29.938205 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:29.938097 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:29.938205 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:29.938144 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:29.938205 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:29.938155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:29.938407 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.938241 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:29.938407 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.938360 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:29.938480 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:29.938435 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:31.938162 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:31.938107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:31.938578 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:31.938174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:31.938578 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:31.938174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:31.938578 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:31.938256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:31.938578 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:31.938374 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:31.938578 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:31.938452 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:33.938009 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:33.937931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:33.938458 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:33.937931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:33.938458 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:33.938076 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:33.938458 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:33.938164 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:33.938458 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:33.937931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:33.938458 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:33.938251 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:35.000283 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:34.999744 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:05:35.000994 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.000588 2561 generic.go:356] "Generic (PLEG): container finished" podID="0da551ab-27cc-48d2-a260-4c3606a43976" containerID="5207bdf1e63423cfcc275bddbd6dc28a40b249a0f9cca50f48754aad8d1f239b" exitCode=1 Jul 01 18:05:35.000994 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.000670 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerDied","Data":"5207bdf1e63423cfcc275bddbd6dc28a40b249a0f9cca50f48754aad8d1f239b"} Jul 01 18:05:35.000994 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.000747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"4d3fdedcbdf4856e2427f04646da3689307b79333bcde0be70e9b562025b32d0"} Jul 01 18:05:35.002588 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.002562 2561 generic.go:356] "Generic (PLEG): container finished" podID="5b6bb22e-bafd-46fa-92e2-855947e4f9fe" containerID="dfc8896763ffa981b1ecd2a3501c6b4bb6861466ce7ca02ab3808aaf51382785" exitCode=0 Jul 01 18:05:35.002708 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.002636 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerDied","Data":"dfc8896763ffa981b1ecd2a3501c6b4bb6861466ce7ca02ab3808aaf51382785"} Jul 01 18:05:35.005692 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.005666 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" event={"ID":"ddb70c9a-7989-498f-91ab-bd0f305c25ad","Type":"ContainerStarted","Data":"8c2c3cc0126d6b3dc93a2bb5d25d151f53f9434b5a6b19c316f40ec3db312cc8"} Jul 01 18:05:35.008061 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.008036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" event={"ID":"32c1ea41-21e5-4d23-a152-f780441562d9","Type":"ContainerStarted","Data":"457480ffdb0a0a83380b02707abcaa0c87bbbf8ca8ab45f6b66de2990048d004"} Jul 01 18:05:35.009576 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.009530 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" event={"ID":"75ff5128bd579c311d860ae653b44e0c","Type":"ContainerStarted","Data":"6261c72da865b169c17441598a789e3819415364845ec9a0b9173d9eba592dc1"} Jul 01 18:05:35.011100 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.011070 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5cftj" event={"ID":"b27d60be-b9f0-43ac-a658-dbbba04242eb","Type":"ContainerStarted","Data":"89e168baa7eab97d384318b01c6845a36ab0691bd5285891bbc160e1f871ccb7"} Jul 01 18:05:35.012601 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.012530 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cgzqv" event={"ID":"8ac15a45-8118-4b27-8a47-4f43c83b48db","Type":"ContainerStarted","Data":"7e95eb1e262fb7f1de01a64f28ba0e9c7386f57f1f0ff8c10ec483c3238bdc9c"} Jul 01 18:05:35.014083 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.014036 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gj55x" event={"ID":"258a0859-f254-49cc-adff-c015d01b1954","Type":"ContainerStarted","Data":"f90d3137cf122ee7ee1094f542df38e73aed1c24cde59a6c08cb0ee3b369ed34"} Jul 01 18:05:35.015142 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.015107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" event={"ID":"dbec032c3b8f31ccd043161433e00141","Type":"ContainerStarted","Data":"388691e18b1800749d95d0b39dbdca23bf710f4f3139e643f6562018eeedc223"} Jul 01 18:05:35.038978 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.038315 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5cftj" podStartSLOduration=2.188025092 podStartE2EDuration="21.03829665s" totalImagesPullingTime="18.850271558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:35.038274905 +0000 UTC m=+22.539839211" watchObservedRunningTime="2026-07-01 18:05:35.03829665 +0000 UTC m=+22.539860956" Jul 01 18:05:35.069580 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.069519 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8gqkk" podStartSLOduration=1.832025449 podStartE2EDuration="21.069497196s" totalImagesPullingTime="19.237471747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:35.069376408 +0000 UTC m=+22.570940714" watchObservedRunningTime="2026-07-01 18:05:35.069497196 +0000 UTC m=+22.571061502" Jul 01 18:05:35.069817 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.069796 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cgzqv" podStartSLOduration=1.862105473 podStartE2EDuration="21.069789477s" totalImagesPullingTime="19.207684004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:35.053312265 +0000 UTC m=+22.554876572" watchObservedRunningTime="2026-07-01 18:05:35.069789477 +0000 UTC m=+22.571353782" Jul 01 18:05:35.086271 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.086217 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gj55x" podStartSLOduration=1.755973757 podStartE2EDuration="21.086199715s" totalImagesPullingTime="19.330225958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:35.085689972 +0000 UTC m=+22.587254278" watchObservedRunningTime="2026-07-01 18:05:35.086199715 +0000 UTC m=+22.587764020" Jul 01 18:05:35.938542 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.937636 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:35.938542 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.937806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:35.938542 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:35.937910 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:35.938542 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:35.938353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:35.938542 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:35.938454 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:35.938542 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:35.938491 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:36.021241 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:36.021204 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vxkh" event={"ID":"a4ee8c01-8c60-4607-9feb-13224e0e1b41","Type":"ContainerStarted","Data":"b3efe291508b90a59e9dab1165faa17ad5b18cd0c4929b5b8ec1b6ba50b38440"} Jul 01 18:05:37.025058 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.025015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhmvd" event={"ID":"ef74ef40-28d4-4fe1-9e39-4585c07719c5","Type":"ContainerStarted","Data":"0780ad206913cc70300b180aa8b304b41cc43f01a267b7af241669b3b4e283d3"} Jul 01 18:05:37.039303 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.039231 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jhmvd" podStartSLOduration=1.44973687 podStartE2EDuration="23.039212721s" totalImagesPullingTime="21.589475851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-01 18:05:37.039013186 +0000 UTC m=+24.540577528" watchObservedRunningTime="2026-07-01 18:05:37.039212721 +0000 UTC m=+24.540777026" Jul 01 18:05:37.039648 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.039616 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vxkh" podStartSLOduration=3.836960801 podStartE2EDuration="23.039606804s" totalImagesPullingTime="19.202646003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:36.03718894 +0000 UTC m=+23.538753246" watchObservedRunningTime="2026-07-01 18:05:37.039606804 +0000 UTC m=+24.541171110" Jul 01 18:05:37.724396 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.724356 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:37.725108 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.725084 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:37.783202 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.783170 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 18:05:37.937551 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.937368 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:37.937551 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.937481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:37.937551 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:37.937492 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:37.937551 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.937521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:37.937717 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:37.937611 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:37.937717 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:37.937681 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:37.947014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.946942 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T18:05:37.783186998Z","UUID":"866d7d5b-9e44-4b2f-9741-a224b3e0956a","Handler":null,"Name":"","Endpoint":""} Jul 01 18:05:37.948915 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.948897 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 18:05:37.949031 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:37.948934 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 18:05:38.030586 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.030489 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:05:38.030977 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.030918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"d43045391198344ea283ac6f0489c14fed6008c9d3c7f289ce3f94f1be616f95"} Jul 01 18:05:38.031021 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.031005 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"2b5994ab965a788706e6fb58ab932bdd365c4064a1f99656b113374de6423ecd"} Jul 01 18:05:38.031070 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.031053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"d981c32e3133585b9fe010b646c11f7f2a4e915ffc7132052d0d3af050058dce"} Jul 01 18:05:38.031121 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.031102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"0371e4bf4f8d830553af0c01a08ed77737d1c18f72c51956f70fa5c664ba1fdb"} Jul 01 18:05:38.032969 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.032943 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" event={"ID":"ddb70c9a-7989-498f-91ab-bd0f305c25ad","Type":"ContainerStarted","Data":"a87c31fc3299180512dfe9db3ed5dd15a4ce0c0846b8eac7c5bedca614372793"} Jul 01 18:05:38.034688 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.034657 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 18:05:38.034810 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:38.034687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" event={"ID":"75ff5128bd579c311d860ae653b44e0c","Type":"ContainerStarted","Data":"f0b9d2ba742c8a4f3a7ea3a4ac6aec9f6eb3e37903bd55209a323983280ca279"} Jul 01 18:05:39.937387 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:39.937346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:39.937387 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:39.937376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:39.938014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:39.937395 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:39.938014 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:39.937487 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:39.938014 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:39.937609 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:39.938014 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:39.937678 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:40.404488 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:40.404452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:40.404661 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:40.404574 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 18:05:40.404995 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:40.404976 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cgzqv" Jul 01 18:05:40.419488 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:40.419438 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-128.ec2.internal" podStartSLOduration=26.419424172 podStartE2EDuration="26.419424172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:38.054593742 +0000 UTC m=+25.556158048" watchObservedRunningTime="2026-07-01 18:05:40.419424172 +0000 UTC m=+27.920988489" Jul 01 18:05:41.042846 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.042818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" event={"ID":"ddb70c9a-7989-498f-91ab-bd0f305c25ad","Type":"ContainerStarted","Data":"36d6c21f3e527ac54cdd928c9e53a3e3c937fc069a1aaed609115220166e259f"} Jul 01 18:05:41.045714 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.045693 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:05:41.046081 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.046060 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"d92a8ed901886a74074e2e8888093abebec5ff9077562a2d64f992e80b18afd4"} Jul 01 18:05:41.047811 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.047785 2561 generic.go:356] "Generic (PLEG): container finished" podID="5b6bb22e-bafd-46fa-92e2-855947e4f9fe" containerID="eb0b26009699a4ef01d41215d0922c26e33ad49b1a9cf65b4e1c496bfa233d81" exitCode=0 Jul 01 18:05:41.047895 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.047867 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerDied","Data":"eb0b26009699a4ef01d41215d0922c26e33ad49b1a9cf65b4e1c496bfa233d81"} Jul 01 18:05:41.062052 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.062008 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgdj6" podStartSLOduration=2.546562208 podStartE2EDuration="27.061991826s" totalImagesPullingTime="24.515429618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:41.06190616 +0000 UTC m=+28.563470464" watchObservedRunningTime="2026-07-01 18:05:41.061991826 +0000 UTC m=+28.563556131" Jul 01 18:05:41.937788 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.937756 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:41.937788 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.937771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:41.937788 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:41.937797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:41.938027 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:41.937893 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:41.938027 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:41.937997 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:41.938097 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:41.938071 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:42.051413 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:42.051381 2561 generic.go:356] "Generic (PLEG): container finished" podID="dbec032c3b8f31ccd043161433e00141" containerID="3f35e7e6bf70d30d5f27e8876292daf63b3685dacdc8030e441a1d7fb0b1f001" exitCode=0 Jul 01 18:05:42.051899 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:42.051469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" event={"ID":"dbec032c3b8f31ccd043161433e00141","Type":"ContainerDied","Data":"3f35e7e6bf70d30d5f27e8876292daf63b3685dacdc8030e441a1d7fb0b1f001"} Jul 01 18:05:43.055490 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.055276 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" event={"ID":"dbec032c3b8f31ccd043161433e00141","Type":"ContainerStarted","Data":"7926a9c3613a5ce7864a24aa3d5f44d5a8f9839df5a84875f0b02bd318891541"} Jul 01 18:05:43.058483 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.058461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:05:43.058912 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.058887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"4c4667a3315359e3854dd0763f0a6bcf59165894955b617dee09c11168babd19"} Jul 01 18:05:43.059168 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.059148 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:43.059273 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.059214 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:43.059273 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.059261 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:43.059786 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.059771 2561 scope.go:117] "RemoveContainer" containerID="5207bdf1e63423cfcc275bddbd6dc28a40b249a0f9cca50f48754aad8d1f239b" Jul 01 18:05:43.061707 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.061685 2561 generic.go:356] "Generic (PLEG): container finished" podID="5b6bb22e-bafd-46fa-92e2-855947e4f9fe" containerID="40aeafbaeec600b9be1cacf122438efd2f60178c8ec93f965ec58d8fe6c453a4" exitCode=0 Jul 01 18:05:43.061804 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.061725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerDied","Data":"40aeafbaeec600b9be1cacf122438efd2f60178c8ec93f965ec58d8fe6c453a4"} Jul 01 18:05:43.069779 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.069739 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-128.ec2.internal" podStartSLOduration=29.06972529 podStartE2EDuration="29.06972529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:43.069506001 +0000 UTC m=+30.571070307" watchObservedRunningTime="2026-07-01 18:05:43.06972529 +0000 UTC m=+30.571289594" Jul 01 18:05:43.078558 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.078528 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:43.078912 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.078894 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:05:43.937547 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.937367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:43.937730 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.937367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:43.937730 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:43.937651 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:43.937832 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:43.937731 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:43.937832 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:43.937367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:43.937925 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:43.937846 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:44.071269 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.071180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:05:44.072759 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.071996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" event={"ID":"0da551ab-27cc-48d2-a260-4c3606a43976","Type":"ContainerStarted","Data":"33e54d7b963204a99ea88dcae13597e7a8bafc10de0d38594f78df6284bb7e52"} Jul 01 18:05:44.098931 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.098872 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" podStartSLOduration=7.489291751 podStartE2EDuration="30.098849059s" totalImagesPullingTime="22.609557308s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:44.097766855 +0000 UTC m=+31.599331166" watchObservedRunningTime="2026-07-01 18:05:44.098849059 +0000 UTC m=+31.600413367" Jul 01 18:05:44.345606 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.345574 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-88zx4"] Jul 01 18:05:44.345800 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.345752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:44.345898 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:44.345874 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:44.348858 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.348831 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7lfk6"] Jul 01 18:05:44.349025 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.348951 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:44.349102 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:44.349057 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:44.349379 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.349357 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scsm9"] Jul 01 18:05:44.349460 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:44.349449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:44.349555 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:44.349535 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:45.076053 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.076024 2561 generic.go:356] "Generic (PLEG): container finished" podID="5b6bb22e-bafd-46fa-92e2-855947e4f9fe" containerID="caf5192c0f882933f171546d19667ab4362786ff040d0f93fe7cf89b1a7214a0" exitCode=0 Jul 01 18:05:45.076529 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.076120 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerDied","Data":"caf5192c0f882933f171546d19667ab4362786ff040d0f93fe7cf89b1a7214a0"} Jul 01 18:05:45.629891 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.629856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:45.630071 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.629959 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:45.630071 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.630015 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret podName:4a0c55c6-b31b-4351-be70-1634dc904f25 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:17.630000308 +0000 UTC m=+65.131564591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret") pod "global-pull-secret-syncer-7lfk6" (UID: "4a0c55c6-b31b-4351-be70-1634dc904f25") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:05:45.731081 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.731044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:45.731277 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.731191 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:45.731277 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.731245 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:17.731232535 +0000 UTC m=+65.232796818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:05:45.832025 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.831978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:45.832221 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.832151 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:05:45.832221 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.832170 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:05:45.832221 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.832180 2561 projected.go:196] Error preparing data for projected volume kube-api-access-6clb6 for pod openshift-network-diagnostics/network-check-target-scsm9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:45.832320 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.832227 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6 podName:17ca6bb4-dc40-47ed-97df-abdc439fd0a3 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:17.832214138 +0000 UTC m=+65.333778421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6clb6" (UniqueName: "kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6") pod "network-check-target-scsm9" (UID: "17ca6bb4-dc40-47ed-97df-abdc439fd0a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:05:45.937770 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.937672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:45.937770 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.937709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:45.937770 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:45.937678 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:45.937980 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.937795 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:45.937980 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.937868 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:45.937980 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:45.937925 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:47.938009 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:47.937980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:47.938009 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:47.938001 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:47.938693 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:47.937980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:47.938693 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:47.938099 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:47.938693 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:47.938178 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:47.938693 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:47.938263 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:49.937796 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:49.937609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:49.937796 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:49.937722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:49.937796 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:49.937735 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-scsm9" podUID="17ca6bb4-dc40-47ed-97df-abdc439fd0a3" Jul 01 18:05:49.937796 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:49.937741 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:49.937796 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:49.937796 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lfk6" podUID="4a0c55c6-b31b-4351-be70-1634dc904f25" Jul 01 18:05:49.938546 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:49.937873 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:05:50.357488 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.357458 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-128.ec2.internal" event="NodeReady" Jul 01 18:05:50.357660 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.357608 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 18:05:50.394537 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.394493 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg"] Jul 01 18:05:50.400879 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.400850 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57cb9cbd86-sd5x7"] Jul 01 18:05:50.401034 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.400982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.404518 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.403423 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 18:05:50.404518 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.403635 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 18:05:50.404518 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.403924 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 18:05:50.404518 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.403926 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 18:05:50.408690 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.408655 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69"] Jul 01 18:05:50.409548 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.409399 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.413572 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.413551 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rc2wq\"" Jul 01 18:05:50.413756 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.413742 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 18:05:50.413929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.413916 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 18:05:50.414435 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.414417 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 18:05:50.415807 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.415783 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8"] Jul 01 18:05:50.415946 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.415923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.421530 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.420347 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 01 18:05:50.421530 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.420546 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 01 18:05:50.421727 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.421610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 01 18:05:50.422044 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.422020 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 01 18:05:50.423768 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.423588 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 18:05:50.424553 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.424415 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg"] Jul 01 18:05:50.424553 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.424468 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69"] Jul 01 18:05:50.424553 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.424494 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ljdmk"] Jul 01 18:05:50.425771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.424562 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.426845 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.426794 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 18:05:50.426845 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.426833 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rf4g8\"" Jul 01 18:05:50.431333 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.430518 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rktcp"] Jul 01 18:05:50.431434 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.431376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.433746 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.433671 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x5l6c\"" Jul 01 18:05:50.435702 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.434260 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 18:05:50.435702 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.434641 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 18:05:50.441847 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.441826 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57cb9cbd86-sd5x7"] Jul 01 18:05:50.441970 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.441860 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ljdmk"] Jul 01 18:05:50.441970 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.441885 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8"] Jul 01 18:05:50.441970 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.441899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rktcp"] Jul 01 18:05:50.441970 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.441955 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:50.444972 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.444516 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 18:05:50.444972 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.444614 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 18:05:50.444972 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.444779 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 18:05:50.444972 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.444833 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-54pz9\"" Jul 01 18:05:50.465493 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.465462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/111da0d6-c98a-4ee8-a340-6c0c94957d20-klusterlet-config\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.465646 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.465526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/111da0d6-c98a-4ee8-a340-6c0c94957d20-tmp\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.465646 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.465567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxm6b\" (UniqueName: \"kubernetes.io/projected/111da0d6-c98a-4ee8-a340-6c0c94957d20-kube-api-access-sxm6b\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.476977 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.476719 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:50.566264 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/111da0d6-c98a-4ee8-a340-6c0c94957d20-tmp\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.566436 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-ca\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.566436 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxm6b\" (UniqueName: \"kubernetes.io/projected/111da0d6-c98a-4ee8-a340-6c0c94957d20-kube-api-access-sxm6b\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.566436 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsn74\" (UniqueName: \"kubernetes.io/projected/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-kube-api-access-lsn74\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.566577 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlhx5\" (UniqueName: \"kubernetes.io/projected/3d93168c-1532-41f1-89f8-29054315f5e4-kube-api-access-zlhx5\") pod \"managed-serviceaccount-addon-agent-58779bfff6-m79w8\" (UID: \"3d93168c-1532-41f1-89f8-29054315f5e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.566577 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-hub\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.566577 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1896050-27d3-4cd3-8227-46210fcd69f6-tmp-dir\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.566577 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.566741 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-certificates\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.566741 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.566741 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ffx\" (UniqueName: \"kubernetes.io/projected/d1896050-27d3-4cd3-8227-46210fcd69f6-kube-api-access-k4ffx\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.566741 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.566741 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-bound-sa-token\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.566741 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.566741 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-installation-pull-secrets\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-ca-trust-extracted\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-trusted-ca\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1896050-27d3-4cd3-8227-46210fcd69f6-config-volume\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d93168c-1532-41f1-89f8-29054315f5e4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58779bfff6-m79w8\" (UID: \"3d93168c-1532-41f1-89f8-29054315f5e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566897 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5wt\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-kube-api-access-5s5wt\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566923 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqfjf\" (UniqueName: \"kubernetes.io/projected/6f5aca4d-043e-44a1-8a2a-d3430fb0d773-kube-api-access-lqfjf\") pod \"ingress-canary-rktcp\" (UID: \"6f5aca4d-043e-44a1-8a2a-d3430fb0d773\") " pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.566990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/111da0d6-c98a-4ee8-a340-6c0c94957d20-klusterlet-config\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.567014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.567015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-image-registry-private-configuration\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.567373 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.567039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5aca4d-043e-44a1-8a2a-d3430fb0d773-cert\") pod \"ingress-canary-rktcp\" (UID: \"6f5aca4d-043e-44a1-8a2a-d3430fb0d773\") " pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:50.569285 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.569256 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:50.570515 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.570492 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/111da0d6-c98a-4ee8-a340-6c0c94957d20-tmp\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.571840 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.571809 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/111da0d6-c98a-4ee8-a340-6c0c94957d20-klusterlet-config\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.575011 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.574963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxm6b\" (UniqueName: \"kubernetes.io/projected/111da0d6-c98a-4ee8-a340-6c0c94957d20-kube-api-access-sxm6b\") pod \"klusterlet-addon-workmgr-894595b9c-7nfhg\" (UID: \"111da0d6-c98a-4ee8-a340-6c0c94957d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.668176 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.668176 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-image-registry-private-configuration\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.668176 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5aca4d-043e-44a1-8a2a-d3430fb0d773-cert\") pod \"ingress-canary-rktcp\" (UID: \"6f5aca4d-043e-44a1-8a2a-d3430fb0d773\") " pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:50.668428 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:50.668238 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:05:50.668428 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:50.668263 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:05:50.668428 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-ca\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.668428 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsn74\" (UniqueName: \"kubernetes.io/projected/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-kube-api-access-lsn74\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.668428 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:50.668332 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:05:51.168310875 +0000 UTC m=+38.669875185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:05:50.668428 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlhx5\" (UniqueName: \"kubernetes.io/projected/3d93168c-1532-41f1-89f8-29054315f5e4-kube-api-access-zlhx5\") pod \"managed-serviceaccount-addon-agent-58779bfff6-m79w8\" (UID: \"3d93168c-1532-41f1-89f8-29054315f5e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.668428 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668430 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-hub\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1896050-27d3-4cd3-8227-46210fcd69f6-tmp-dir\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-certificates\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ffx\" (UniqueName: \"kubernetes.io/projected/d1896050-27d3-4cd3-8227-46210fcd69f6-kube-api-access-k4ffx\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-bound-sa-token\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-installation-pull-secrets\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-ca-trust-extracted\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668727 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-trusted-ca\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1896050-27d3-4cd3-8227-46210fcd69f6-config-volume\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.668775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.668780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d93168c-1532-41f1-89f8-29054315f5e4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58779bfff6-m79w8\" (UID: \"3d93168c-1532-41f1-89f8-29054315f5e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.669402 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.669373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-certificates\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.669528 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.669504 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.669590 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.669559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5wt\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-kube-api-access-5s5wt\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.669590 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.669586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqfjf\" (UniqueName: \"kubernetes.io/projected/6f5aca4d-043e-44a1-8a2a-d3430fb0d773-kube-api-access-lqfjf\") pod \"ingress-canary-rktcp\" (UID: \"6f5aca4d-043e-44a1-8a2a-d3430fb0d773\") " pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:50.669691 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.669534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-ca-trust-extracted\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.669894 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.669876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1896050-27d3-4cd3-8227-46210fcd69f6-tmp-dir\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.670106 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:50.670060 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:05:50.670229 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:50.670151 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:51.170115795 +0000 UTC m=+38.671680078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:05:50.671916 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.671878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-image-registry-private-configuration\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.672025 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.671920 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5aca4d-043e-44a1-8a2a-d3430fb0d773-cert\") pod \"ingress-canary-rktcp\" (UID: \"6f5aca4d-043e-44a1-8a2a-d3430fb0d773\") " pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:50.672519 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.672275 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-hub\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.672519 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.672451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1896050-27d3-4cd3-8227-46210fcd69f6-config-volume\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.672519 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.672467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d93168c-1532-41f1-89f8-29054315f5e4-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58779bfff6-m79w8\" (UID: \"3d93168c-1532-41f1-89f8-29054315f5e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.672728 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.672606 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-trusted-ca\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.672784 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.672753 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-ca\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.673072 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.673041 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-installation-pull-secrets\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.673738 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.673695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.674539 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.674520 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.677924 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.677876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsn74\" (UniqueName: \"kubernetes.io/projected/6f56d968-4c1b-4b66-bb52-58a9cd62c09f-kube-api-access-lsn74\") pod \"cluster-proxy-proxy-agent-558f6987-m8w69\" (UID: \"6f56d968-4c1b-4b66-bb52-58a9cd62c09f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.678716 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.678662 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlhx5\" (UniqueName: \"kubernetes.io/projected/3d93168c-1532-41f1-89f8-29054315f5e4-kube-api-access-zlhx5\") pod \"managed-serviceaccount-addon-agent-58779bfff6-m79w8\" (UID: \"3d93168c-1532-41f1-89f8-29054315f5e4\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.679790 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.679446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqfjf\" (UniqueName: \"kubernetes.io/projected/6f5aca4d-043e-44a1-8a2a-d3430fb0d773-kube-api-access-lqfjf\") pod \"ingress-canary-rktcp\" (UID: \"6f5aca4d-043e-44a1-8a2a-d3430fb0d773\") " pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:50.679790 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.679746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-bound-sa-token\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.680117 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.680099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5wt\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-kube-api-access-5s5wt\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:50.680403 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.680359 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ffx\" (UniqueName: \"kubernetes.io/projected/d1896050-27d3-4cd3-8227-46210fcd69f6-kube-api-access-k4ffx\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:50.723484 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.723451 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:05:50.744797 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.744757 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:05:50.752901 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.752869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:05:50.775971 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:50.775930 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rktcp" Jul 01 18:05:51.173227 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.173186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:51.173644 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.173313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:51.173644 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:51.173385 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:05:51.173644 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:51.173409 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:05:51.173644 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:51.173436 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:05:51.173644 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:51.173474 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:05:52.173453253 +0000 UTC m=+39.675017539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:05:51.173644 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:51.173494 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:52.173484955 +0000 UTC m=+39.675049242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:05:51.391587 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.391538 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:51.451958 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.451863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:51.938209 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.938169 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:05:51.938389 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.938183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:05:51.938389 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.938183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:05:51.941228 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.941206 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:05:51.942095 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.942075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bpwcg\"" Jul 01 18:05:51.942095 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.942086 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n65jl\"" Jul 01 18:05:51.942095 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.942092 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:05:51.942315 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.942092 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:05:51.942315 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:51.942096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:05:52.165944 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.163364 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8"] Jul 01 18:05:52.184109 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.184079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:52.184526 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.184204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:52.184526 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:52.184298 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:05:52.184526 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:52.184385 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:54.18436054 +0000 UTC m=+41.685924825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:05:52.184526 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:52.184300 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:05:52.184526 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:52.184404 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:05:52.184526 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:52.184442 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:05:54.184430137 +0000 UTC m=+41.685994421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:05:52.195809 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.195711 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69"] Jul 01 18:05:52.198775 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.198749 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rktcp"] Jul 01 18:05:52.209828 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.209802 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg"] Jul 01 18:05:52.211003 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.210981 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:52.274546 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:52.274509 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d93168c_1532_41f1_89f8_29054315f5e4.slice/crio-13f16c4da9e8112d5aac91e174975b03aae45992ca889454dd9f18d9c55494c5 WatchSource:0}: Error finding container 13f16c4da9e8112d5aac91e174975b03aae45992ca889454dd9f18d9c55494c5: Status 404 returned error can't find the container with id 13f16c4da9e8112d5aac91e174975b03aae45992ca889454dd9f18d9c55494c5 Jul 01 18:05:52.276605 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:52.275208 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f56d968_4c1b_4b66_bb52_58a9cd62c09f.slice/crio-63876d50607d50f0e39dac691b5a86416b9d32cfae2b7abc3b31aaa09bd7de4c WatchSource:0}: Error finding container 63876d50607d50f0e39dac691b5a86416b9d32cfae2b7abc3b31aaa09bd7de4c: Status 404 returned error can't find the container with id 63876d50607d50f0e39dac691b5a86416b9d32cfae2b7abc3b31aaa09bd7de4c Jul 01 18:05:52.276605 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:52.276327 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5aca4d_043e_44a1_8a2a_d3430fb0d773.slice/crio-b2c57acb662d5dbee385239f9227962f9f4839260664fd1a6c93e62b36f849b5 WatchSource:0}: Error finding container b2c57acb662d5dbee385239f9227962f9f4839260664fd1a6c93e62b36f849b5: Status 404 returned error can't find the container with id b2c57acb662d5dbee385239f9227962f9f4839260664fd1a6c93e62b36f849b5 Jul 01 18:05:52.277033 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:05:52.277013 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111da0d6_c98a_4ee8_a340_6c0c94957d20.slice/crio-1745e14500e961ca5ba2a32f3f82fe36c8e830ce6295ab4d1d13b27876152edc WatchSource:0}: Error finding container 1745e14500e961ca5ba2a32f3f82fe36c8e830ce6295ab4d1d13b27876152edc: Status 404 returned error can't find the container with id 1745e14500e961ca5ba2a32f3f82fe36c8e830ce6295ab4d1d13b27876152edc Jul 01 18:05:52.283885 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:52.283859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:53.045372 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.045335 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:53.107158 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.106991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rktcp" event={"ID":"6f5aca4d-043e-44a1-8a2a-d3430fb0d773","Type":"ContainerStarted","Data":"b2c57acb662d5dbee385239f9227962f9f4839260664fd1a6c93e62b36f849b5"} Jul 01 18:05:53.107158 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.107118 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:53.108455 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.108425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" event={"ID":"3d93168c-1532-41f1-89f8-29054315f5e4","Type":"ContainerStarted","Data":"13f16c4da9e8112d5aac91e174975b03aae45992ca889454dd9f18d9c55494c5"} Jul 01 18:05:53.111483 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.111454 2561 generic.go:356] "Generic (PLEG): container finished" podID="5b6bb22e-bafd-46fa-92e2-855947e4f9fe" containerID="8af1af728f1867369d6cceb374d31a951de25160a1bfb1de44ce3585ab394d2a" exitCode=0 Jul 01 18:05:53.111619 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.111544 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerDied","Data":"8af1af728f1867369d6cceb374d31a951de25160a1bfb1de44ce3585ab394d2a"} Jul 01 18:05:53.112759 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.112734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" event={"ID":"6f56d968-4c1b-4b66-bb52-58a9cd62c09f","Type":"ContainerStarted","Data":"63876d50607d50f0e39dac691b5a86416b9d32cfae2b7abc3b31aaa09bd7de4c"} Jul 01 18:05:53.114351 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:53.114331 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" event={"ID":"111da0d6-c98a-4ee8-a340-6c0c94957d20","Type":"ContainerStarted","Data":"1745e14500e961ca5ba2a32f3f82fe36c8e830ce6295ab4d1d13b27876152edc"} Jul 01 18:05:54.124950 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:54.124916 2561 generic.go:356] "Generic (PLEG): container finished" podID="5b6bb22e-bafd-46fa-92e2-855947e4f9fe" containerID="e9b48dc90c2e116475f58111c55c2a8c13f1838bc1671f7fb36efb859beefea9" exitCode=0 Jul 01 18:05:54.125419 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:54.125000 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerDied","Data":"e9b48dc90c2e116475f58111c55c2a8c13f1838bc1671f7fb36efb859beefea9"} Jul 01 18:05:54.200293 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:54.200060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:54.200992 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:54.200599 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:05:54.200992 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:54.200623 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:05:54.200992 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:54.200680 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:05:58.200660221 +0000 UTC m=+45.702224508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:05:54.200992 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:54.200686 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:05:54.200992 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:54.200744 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:05:58.200729269 +0000 UTC m=+45.702293572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:05:54.200992 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:54.200597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:55.134229 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:55.134187 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" event={"ID":"5b6bb22e-bafd-46fa-92e2-855947e4f9fe","Type":"ContainerStarted","Data":"5ce909f75031d697a222c5a636c4df8c4209691991e3bc45516dcf8ce608a081"} Jul 01 18:05:55.160400 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:55.160240 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lhcjg" podStartSLOduration=7.402147802 podStartE2EDuration="41.160223692s" totalImagesPullingTime="33.75807589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:05:55.159447305 +0000 UTC m=+42.661011649" watchObservedRunningTime="2026-07-01 18:05:55.160223692 +0000 UTC m=+42.661787997" Jul 01 18:05:55.287580 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:55.287487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:55.372014 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:55.371977 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:05:58.241590 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:58.241544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:05:58.242073 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:58.241643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:05:58.242073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:58.241728 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:05:58.242073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:58.241798 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:06.241781999 +0000 UTC m=+53.743346285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:05:58.242073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:58.241811 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:05:58.242073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:58.241831 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:05:58.242073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:05:58.241894 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:06:06.241875247 +0000 UTC m=+53.743439546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:05:58.720166 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:05:58.720108 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" limit=1024 Jul 01 18:06:01.154386 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.154346 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" event={"ID":"6f56d968-4c1b-4b66-bb52-58a9cd62c09f","Type":"ContainerStarted","Data":"c48232a000ae7e799910cff1cc75d448dcb908779a4c7a1eabbc0eb25f431e07"} Jul 01 18:06:01.154920 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.154394 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" event={"ID":"6f56d968-4c1b-4b66-bb52-58a9cd62c09f","Type":"ContainerStarted","Data":"96c435dfa4e109ae3c8027f8078f23e51b0f334363e3f7e9794198b4d24d0988"} Jul 01 18:06:01.154920 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.154414 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" event={"ID":"6f56d968-4c1b-4b66-bb52-58a9cd62c09f","Type":"ContainerStarted","Data":"4a5000b2020e0643afdb5a30996aeb24113c3b9d231a349b37065862b068239d"} Jul 01 18:06:01.155896 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.155869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" event={"ID":"111da0d6-c98a-4ee8-a340-6c0c94957d20","Type":"ContainerStarted","Data":"70d2acb094c645b06c653f0004e44e51fe53f1477330e0f913f9f948b2fcaaed"} Jul 01 18:06:01.156066 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.156046 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:06:01.157477 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.157446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rktcp" event={"ID":"6f5aca4d-043e-44a1-8a2a-d3430fb0d773","Type":"ContainerStarted","Data":"9621c7c788b83f762b0141051a104b007dd1dad486cc9520ea329783aafc7c2f"} Jul 01 18:06:01.158525 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.158508 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:06:01.159632 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.159610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" event={"ID":"3d93168c-1532-41f1-89f8-29054315f5e4","Type":"ContainerStarted","Data":"a3dabe278bdf78ac446c772bc4b5e1dc6acc24d3f815f1a5586e5217f370bd21"} Jul 01 18:06:01.174351 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.174295 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" podStartSLOduration=24.982256531 podStartE2EDuration="33.174279884s" totalImagesPullingTime="8.192023353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:01.173505433 +0000 UTC m=+48.675069738" watchObservedRunningTime="2026-07-01 18:06:01.174279884 +0000 UTC m=+48.675844225" Jul 01 18:06:01.190383 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.190331 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" podStartSLOduration=25.012097327 podStartE2EDuration="33.19031423s" totalImagesPullingTime="8.178216903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:01.189644395 +0000 UTC m=+48.691208702" watchObservedRunningTime="2026-07-01 18:06:01.19031423 +0000 UTC m=+48.691878535" Jul 01 18:06:01.205059 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.205009 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" podStartSLOduration=25.026763526 podStartE2EDuration="33.204993887s" totalImagesPullingTime="8.178230361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:01.204081173 +0000 UTC m=+48.705645480" watchObservedRunningTime="2026-07-01 18:06:01.204993887 +0000 UTC m=+48.706558192" Jul 01 18:06:01.220220 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:01.220153 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rktcp" podStartSLOduration=3.590378717 podStartE2EDuration="11.220109677s" totalImagesPullingTime="7.62973096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:01.219957689 +0000 UTC m=+48.721521994" watchObservedRunningTime="2026-07-01 18:06:01.220109677 +0000 UTC m=+48.721673983" Jul 01 18:06:06.307173 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:06.307107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:06:06.307632 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:06.307217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:06:06.307632 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:06.307330 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:06:06.307632 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:06.307375 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:22.307363188 +0000 UTC m=+69.808927472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:06:06.307739 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:06.307705 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:06:06.307739 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:06.307715 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:06:06.307802 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:06.307745 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:06:22.307735381 +0000 UTC m=+69.809299664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:06:15.087594 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:15.087564 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-khzgt" Jul 01 18:06:17.694992 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.694945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:06:17.697645 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.697622 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:06:17.708641 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.708609 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a0c55c6-b31b-4351-be70-1634dc904f25-original-pull-secret\") pod \"global-pull-secret-syncer-7lfk6\" (UID: \"4a0c55c6-b31b-4351-be70-1634dc904f25\") " pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:06:17.759303 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.759245 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lfk6" Jul 01 18:06:17.795447 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.795411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:06:17.798106 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.798079 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:06:17.806275 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:17.806244 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 18:06:17.806427 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:17.806336 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:07:21.806314582 +0000 UTC m=+129.307878865 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : secret "metrics-daemon-secret" not found Jul 01 18:06:17.888527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.888495 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7lfk6"] Jul 01 18:06:17.891559 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:06:17.891535 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0c55c6_b31b_4351_be70_1634dc904f25.slice/crio-fc9bfa47e087307b799b6cfb3fc9e34b260d7a7af6c253b2c2867b8a71cdc7a3 WatchSource:0}: Error finding container fc9bfa47e087307b799b6cfb3fc9e34b260d7a7af6c253b2c2867b8a71cdc7a3: Status 404 returned error can't find the container with id fc9bfa47e087307b799b6cfb3fc9e34b260d7a7af6c253b2c2867b8a71cdc7a3 Jul 01 18:06:17.896372 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.896350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:06:17.898919 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.898902 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:06:17.909203 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.909173 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:06:17.922397 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:17.922357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clb6\" (UniqueName: \"kubernetes.io/projected/17ca6bb4-dc40-47ed-97df-abdc439fd0a3-kube-api-access-6clb6\") pod \"network-check-target-scsm9\" (UID: \"17ca6bb4-dc40-47ed-97df-abdc439fd0a3\") " pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:06:18.050976 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:18.050885 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n65jl\"" Jul 01 18:06:18.059119 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:18.059088 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:06:18.188280 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:18.188242 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-scsm9"] Jul 01 18:06:18.191001 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:06:18.190976 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ca6bb4_dc40_47ed_97df_abdc439fd0a3.slice/crio-890819a00857936ea26cd7cf66d2f0167661e3c5d6a3a0ab4da033fc2992fd40 WatchSource:0}: Error finding container 890819a00857936ea26cd7cf66d2f0167661e3c5d6a3a0ab4da033fc2992fd40: Status 404 returned error can't find the container with id 890819a00857936ea26cd7cf66d2f0167661e3c5d6a3a0ab4da033fc2992fd40 Jul 01 18:06:18.213560 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:18.213523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scsm9" event={"ID":"17ca6bb4-dc40-47ed-97df-abdc439fd0a3","Type":"ContainerStarted","Data":"890819a00857936ea26cd7cf66d2f0167661e3c5d6a3a0ab4da033fc2992fd40"} Jul 01 18:06:18.214633 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:18.214611 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7lfk6" event={"ID":"4a0c55c6-b31b-4351-be70-1634dc904f25","Type":"ContainerStarted","Data":"fc9bfa47e087307b799b6cfb3fc9e34b260d7a7af6c253b2c2867b8a71cdc7a3"} Jul 01 18:06:22.231941 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:22.231903 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-scsm9" event={"ID":"17ca6bb4-dc40-47ed-97df-abdc439fd0a3","Type":"ContainerStarted","Data":"2662b50ff0fa69b8321a627d391ff141848634d42d6fa1337b0e768fb6dba620"} Jul 01 18:06:22.232429 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:22.232035 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:06:22.248110 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:22.248058 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-scsm9" podStartSLOduration=65.202454235 podStartE2EDuration="1m8.248039813s" totalImagesPullingTime="3.045585578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:22.246792775 +0000 UTC m=+69.748357080" watchObservedRunningTime="2026-07-01 18:06:22.248039813 +0000 UTC m=+69.749604117" Jul 01 18:06:22.333847 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:22.333808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:06:22.334038 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:22.333885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:06:22.334038 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:22.333995 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:06:22.334165 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:22.334055 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:06:22.334165 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:22.334073 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:06:22.334165 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:22.334065 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:06:54.334047304 +0000 UTC m=+101.835611587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:06:22.334165 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:22.334147 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:06:54.334112592 +0000 UTC m=+101.835676887 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:06:24.243190 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:24.243143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7lfk6" event={"ID":"4a0c55c6-b31b-4351-be70-1634dc904f25","Type":"ContainerStarted","Data":"5d974ce0a22e57b67207c4bb61067a8fb10c44b915f940a1b6667ae383373806"} Jul 01 18:06:24.258287 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:24.258228 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7lfk6" podStartSLOduration=64.820889215 podStartE2EDuration="1m10.258211261s" totalImagesPullingTime="5.437322046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:06:24.257769458 +0000 UTC m=+71.759333764" watchObservedRunningTime="2026-07-01 18:06:24.258211261 +0000 UTC m=+71.759775565" Jul 01 18:06:53.239353 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:53.239242 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-scsm9" Jul 01 18:06:54.372951 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:54.372911 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:06:54.373371 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:06:54.372980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:06:54.373371 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:54.373057 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:06:54.373371 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:54.373075 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:06:54.373371 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:54.373072 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:06:54.373371 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:54.373158 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:07:58.373121376 +0000 UTC m=+165.874685664 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:06:54.373371 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:06:54.373184 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:07:58.373173339 +0000 UTC m=+165.874737624 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:07:21.862296 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:07:21.862244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:07:21.862773 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:21.862411 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 18:07:21.862773 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:21.862491 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:23.862474251 +0000 UTC m=+251.364038539 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : secret "metrics-daemon-secret" not found Jul 01 18:07:53.428199 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:53.428121 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" Jul 01 18:07:53.470416 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:53.470362 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ljdmk" podUID="d1896050-27d3-4cd3-8227-46210fcd69f6" Jul 01 18:07:53.504933 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:07:53.504906 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:07:53.505056 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:07:53.504947 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljdmk" Jul 01 18:07:54.954356 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:54.954311 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:07:58.435122 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:07:58.435060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:07:58.435601 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:07:58.435173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:07:58.435601 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:58.435245 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:07:58.435601 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:58.435287 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 18:07:58.435601 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:58.435305 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57cb9cbd86-sd5x7: secret "image-registry-tls" not found Jul 01 18:07:58.435601 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:58.435340 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls podName:d1896050-27d3-4cd3-8227-46210fcd69f6 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:00.435323788 +0000 UTC m=+287.936888071 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls") pod "dns-default-ljdmk" (UID: "d1896050-27d3-4cd3-8227-46210fcd69f6") : secret "dns-default-metrics-tls" not found Jul 01 18:07:58.435601 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:07:58.435364 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls podName:d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f nodeName:}" failed. No retries permitted until 2026-07-01 18:10:00.435348485 +0000 UTC m=+287.936912782 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls") pod "image-registry-57cb9cbd86-sd5x7" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f") : secret "image-registry-tls" not found Jul 01 18:08:00.724361 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:00.724318 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" podUID="111da0d6-c98a-4ee8-a340-6c0c94957d20" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/healthz\": dial tcp 10.132.0.6:8000: connect: connection refused" Jul 01 18:08:00.753873 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:00.753837 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" podUID="3d93168c-1532-41f1-89f8-29054315f5e4" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/healthz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jul 01 18:08:01.156475 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:01.156432 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" podUID="111da0d6-c98a-4ee8-a340-6c0c94957d20" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/readyz\": dial tcp 10.132.0.6:8000: connect: connection refused" Jul 01 18:08:01.528892 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:01.528807 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d93168c-1532-41f1-89f8-29054315f5e4" containerID="a3dabe278bdf78ac446c772bc4b5e1dc6acc24d3f815f1a5586e5217f370bd21" exitCode=255 Jul 01 18:08:01.528892 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:01.528884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" event={"ID":"3d93168c-1532-41f1-89f8-29054315f5e4","Type":"ContainerDied","Data":"a3dabe278bdf78ac446c772bc4b5e1dc6acc24d3f815f1a5586e5217f370bd21"} Jul 01 18:08:01.529255 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:01.529241 2561 scope.go:117] "RemoveContainer" containerID="a3dabe278bdf78ac446c772bc4b5e1dc6acc24d3f815f1a5586e5217f370bd21" Jul 01 18:08:01.530570 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:01.530554 2561 generic.go:356] "Generic (PLEG): container finished" podID="111da0d6-c98a-4ee8-a340-6c0c94957d20" containerID="70d2acb094c645b06c653f0004e44e51fe53f1477330e0f913f9f948b2fcaaed" exitCode=1 Jul 01 18:08:01.530631 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:01.530606 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" event={"ID":"111da0d6-c98a-4ee8-a340-6c0c94957d20","Type":"ContainerDied","Data":"70d2acb094c645b06c653f0004e44e51fe53f1477330e0f913f9f948b2fcaaed"} Jul 01 18:08:01.530852 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:01.530838 2561 scope.go:117] "RemoveContainer" containerID="70d2acb094c645b06c653f0004e44e51fe53f1477330e0f913f9f948b2fcaaed" Jul 01 18:08:02.535505 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:02.535469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" event={"ID":"3d93168c-1532-41f1-89f8-29054315f5e4","Type":"ContainerStarted","Data":"22054b700ed08c99d7ba687ba3bc668a4adbe4ceda834a1f61be6daa9c2e1ce8"} Jul 01 18:08:02.537166 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:02.537144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" event={"ID":"111da0d6-c98a-4ee8-a340-6c0c94957d20","Type":"ContainerStarted","Data":"8dd9f327983268409e7cb33eba3c54e3d9a749e332bee48f9750f9a4e2a6a00c"} Jul 01 18:08:02.537428 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:02.537410 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:08:02.538343 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:02.538324 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:08:09.937765 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:08:09.937731 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:09:23.872948 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:23.872905 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:09:23.873455 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:23.873057 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 18:09:23.873455 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:23.873179 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs podName:007188c8-8039-4d6a-8dc6-e80b4698e864 nodeName:}" failed. No retries permitted until 2026-07-01 18:11:25.873162204 +0000 UTC m=+373.374726487 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs") pod "network-metrics-daemon-88zx4" (UID: "007188c8-8039-4d6a-8dc6-e80b4698e864") : secret "metrics-daemon-secret" not found Jul 01 18:09:31.106943 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.106904 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-92l4g"] Jul 01 18:09:31.109000 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.108982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.115080 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.114890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 18:09:31.115195 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.115165 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 18:09:31.115258 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.115217 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 18:09:31.115316 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.115273 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 18:09:31.116346 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.116326 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kr6bt\"" Jul 01 18:09:31.183017 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.182978 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-92l4g"] Jul 01 18:09:31.222400 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.222360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/359cb70d-175a-42f3-8179-8b38cf746b34-crio-socket\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.222572 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.222410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7bcs\" (UniqueName: \"kubernetes.io/projected/359cb70d-175a-42f3-8179-8b38cf746b34-kube-api-access-b7bcs\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.222572 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.222438 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.222572 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.222527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.222694 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.222588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/359cb70d-175a-42f3-8179-8b38cf746b34-data-volume\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.323270 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.323216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7bcs\" (UniqueName: \"kubernetes.io/projected/359cb70d-175a-42f3-8179-8b38cf746b34-kube-api-access-b7bcs\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.323270 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.323281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.323522 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.323335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.323522 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.323358 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:09:31.323522 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.323391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/359cb70d-175a-42f3-8179-8b38cf746b34-data-volume\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.323522 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.323427 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:31.823411894 +0000 UTC m=+259.324976177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : configmap "kube-rbac-proxy" not found Jul 01 18:09:31.323522 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.323470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/359cb70d-175a-42f3-8179-8b38cf746b34-crio-socket\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.323522 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.323490 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:09:31.323755 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.323541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/359cb70d-175a-42f3-8179-8b38cf746b34-crio-socket\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.323755 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.323567 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:31.823548522 +0000 UTC m=+259.325112806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : secret "insights-runtime-extractor-tls" not found Jul 01 18:09:31.323755 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.323720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/359cb70d-175a-42f3-8179-8b38cf746b34-data-volume\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.331477 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.331454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7bcs\" (UniqueName: \"kubernetes.io/projected/359cb70d-175a-42f3-8179-8b38cf746b34-kube-api-access-b7bcs\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.828377 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.828331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.828563 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:31.828395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:31.828563 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.828461 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:09:31.828563 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.828495 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:09:31.828563 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.828527 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:32.828510401 +0000 UTC m=+260.330074691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : configmap "kube-rbac-proxy" not found Jul 01 18:09:31.828563 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:31.828559 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:32.828546167 +0000 UTC m=+260.330110450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : secret "insights-runtime-extractor-tls" not found Jul 01 18:09:32.838628 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:32.838583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:32.838628 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:32.838634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:32.839073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:32.838720 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:09:32.839073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:32.838744 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:09:32.839073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:32.838789 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:34.838773982 +0000 UTC m=+262.340338265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : configmap "kube-rbac-proxy" not found Jul 01 18:09:32.839073 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:32.838803 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:34.838797318 +0000 UTC m=+262.340361600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : secret "insights-runtime-extractor-tls" not found Jul 01 18:09:33.724323 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:33.724258 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5cftj_b27d60be-b9f0-43ac-a658-dbbba04242eb/dns-node-resolver/0.log" Jul 01 18:09:34.855247 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:34.855204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:34.855623 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:34.855259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:34.855623 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:34.855329 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:09:34.855623 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:34.855347 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:09:34.855623 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:34.855401 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:38.855388793 +0000 UTC m=+266.356953075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : secret "insights-runtime-extractor-tls" not found Jul 01 18:09:34.855623 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:34.855416 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:38.855410306 +0000 UTC m=+266.356974589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : configmap "kube-rbac-proxy" not found Jul 01 18:09:35.101671 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:35.101641 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhmvd_ef74ef40-28d4-4fe1-9e39-4585c07719c5/node-ca/0.log" Jul 01 18:09:35.902641 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:35.902614 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rktcp_6f5aca4d-043e-44a1-8a2a-d3430fb0d773/serve-healthcheck-canary/0.log" Jul 01 18:09:38.885579 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:38.885534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:38.885961 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:38.885589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:38.885961 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:38.885656 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:09:38.885961 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:38.885700 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:09:38.885961 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:38.885720 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:46.885703273 +0000 UTC m=+274.387267560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : configmap "kube-rbac-proxy" not found Jul 01 18:09:38.885961 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:38.885738 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls podName:359cb70d-175a-42f3-8179-8b38cf746b34 nodeName:}" failed. No retries permitted until 2026-07-01 18:09:46.885727305 +0000 UTC m=+274.387291587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls") pod "insights-runtime-extractor-92l4g" (UID: "359cb70d-175a-42f3-8179-8b38cf746b34") : secret "insights-runtime-extractor-tls" not found Jul 01 18:09:40.746337 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:40.746299 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" podUID="6f56d968-4c1b-4b66-bb52-58a9cd62c09f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 01 18:09:46.954111 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:46.954072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:46.954497 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:46.954145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:46.954597 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:46.954577 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/359cb70d-175a-42f3-8179-8b38cf746b34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:46.956506 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:46.956488 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/359cb70d-175a-42f3-8179-8b38cf746b34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-92l4g\" (UID: \"359cb70d-175a-42f3-8179-8b38cf746b34\") " pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:47.017229 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:47.017178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-92l4g" Jul 01 18:09:47.149254 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:47.149220 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-92l4g"] Jul 01 18:09:47.152918 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:09:47.152890 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359cb70d_175a_42f3_8179_8b38cf746b34.slice/crio-32f4af9f3135f2edcefb0440fc96acf487afb3dd2804966905f519efafb628b8 WatchSource:0}: Error finding container 32f4af9f3135f2edcefb0440fc96acf487afb3dd2804966905f519efafb628b8: Status 404 returned error can't find the container with id 32f4af9f3135f2edcefb0440fc96acf487afb3dd2804966905f519efafb628b8 Jul 01 18:09:47.853280 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:47.853250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92l4g" event={"ID":"359cb70d-175a-42f3-8179-8b38cf746b34","Type":"ContainerStarted","Data":"32f4af9f3135f2edcefb0440fc96acf487afb3dd2804966905f519efafb628b8"} Jul 01 18:09:50.746215 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:50.746158 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" podUID="6f56d968-4c1b-4b66-bb52-58a9cd62c09f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 01 18:09:51.473498 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:51.473456 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image" image="quay.io/openshift/origin-kube-rbac-proxy:latest" Jul 01 18:09:51.473681 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:51.473564 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy start failed in pod insights-runtime-extractor-92l4g_openshift-insights(359cb70d-175a-42f3-8179-8b38cf746b34): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 01 18:09:53.874908 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:53.874864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92l4g" event={"ID":"359cb70d-175a-42f3-8179-8b38cf746b34","Type":"ContainerStarted","Data":"c3744f6df454e17864e3ea6e0f01953ea83e9882f360369988b31a981fff1ea6"} Jul 01 18:09:55.666774 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:55.666744 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-92l4g" podUID="359cb70d-175a-42f3-8179-8b38cf746b34" Jul 01 18:09:55.887150 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:55.887092 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92l4g" event={"ID":"359cb70d-175a-42f3-8179-8b38cf746b34","Type":"ContainerStarted","Data":"8c6b8f7bba64fd4cc6589b6fa7e9e5b8e34b7673ba2ac67f97896b37ae5303a3"} Jul 01 18:09:55.887794 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:55.887769 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-92l4g" podUID="359cb70d-175a-42f3-8179-8b38cf746b34" Jul 01 18:09:56.506170 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:56.506093 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ljdmk" podUID="d1896050-27d3-4cd3-8227-46210fcd69f6" Jul 01 18:09:56.506351 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:56.506122 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" Jul 01 18:09:56.890504 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:56.890473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:09:56.890504 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:09:56.890495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljdmk" Jul 01 18:09:56.891368 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:09:56.891339 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-kube-rbac-proxy:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:9e52074c0d83354691642410dcd96770c3d39a04e2a483011757fc219d666d9f: fetching blob: received unexpected HTTP status: 500 Internal Server Error; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-92l4g" podUID="359cb70d-175a-42f3-8179-8b38cf746b34" Jul 01 18:10:00.466479 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.466438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:10:00.466953 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.466508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:10:00.469086 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.469059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"image-registry-57cb9cbd86-sd5x7\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:10:00.469200 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.469058 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1896050-27d3-4cd3-8227-46210fcd69f6-metrics-tls\") pod \"dns-default-ljdmk\" (UID: \"d1896050-27d3-4cd3-8227-46210fcd69f6\") " pod="openshift-dns/dns-default-ljdmk" Jul 01 18:10:00.494753 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.494723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x5l6c\"" Jul 01 18:10:00.494753 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.494723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rc2wq\"" Jul 01 18:10:00.501825 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.501803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:10:00.501929 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.501901 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljdmk" Jul 01 18:10:00.640394 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.640346 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ljdmk"] Jul 01 18:10:00.643548 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:10:00.643526 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1896050_27d3_4cd3_8227_46210fcd69f6.slice/crio-bd8ffa1862e8488303af675b1ba334011da521058f9cc4995cdc6b2f0da07368 WatchSource:0}: Error finding container bd8ffa1862e8488303af675b1ba334011da521058f9cc4995cdc6b2f0da07368: Status 404 returned error can't find the container with id bd8ffa1862e8488303af675b1ba334011da521058f9cc4995cdc6b2f0da07368 Jul 01 18:10:00.658625 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.658598 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57cb9cbd86-sd5x7"] Jul 01 18:10:00.662475 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:10:00.662451 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d7a5b2_652c_45e8_8908_9d6a4d2fa96f.slice/crio-48b506c6a4b6adc4a5d1879746095b71656f5994a1a6472b3ee3785cad365949 WatchSource:0}: Error finding container 48b506c6a4b6adc4a5d1879746095b71656f5994a1a6472b3ee3785cad365949: Status 404 returned error can't find the container with id 48b506c6a4b6adc4a5d1879746095b71656f5994a1a6472b3ee3785cad365949 Jul 01 18:10:00.746193 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.746155 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" podUID="6f56d968-4c1b-4b66-bb52-58a9cd62c09f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 01 18:10:00.746347 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.746220 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" Jul 01 18:10:00.746720 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.746682 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c48232a000ae7e799910cff1cc75d448dcb908779a4c7a1eabbc0eb25f431e07"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 01 18:10:00.746767 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.746742 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" podUID="6f56d968-4c1b-4b66-bb52-58a9cd62c09f" containerName="service-proxy" containerID="cri-o://c48232a000ae7e799910cff1cc75d448dcb908779a4c7a1eabbc0eb25f431e07" gracePeriod=30 Jul 01 18:10:00.905092 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.905062 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljdmk" event={"ID":"d1896050-27d3-4cd3-8227-46210fcd69f6","Type":"ContainerStarted","Data":"bd8ffa1862e8488303af675b1ba334011da521058f9cc4995cdc6b2f0da07368"} Jul 01 18:10:00.906862 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.906830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" event={"ID":"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f","Type":"ContainerStarted","Data":"2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0"} Jul 01 18:10:00.906985 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.906877 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" event={"ID":"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f","Type":"ContainerStarted","Data":"48b506c6a4b6adc4a5d1879746095b71656f5994a1a6472b3ee3785cad365949"} Jul 01 18:10:00.906985 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.906960 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:10:00.908992 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.908968 2561 generic.go:356] "Generic (PLEG): container finished" podID="6f56d968-4c1b-4b66-bb52-58a9cd62c09f" containerID="c48232a000ae7e799910cff1cc75d448dcb908779a4c7a1eabbc0eb25f431e07" exitCode=2 Jul 01 18:10:00.909140 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.909016 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" event={"ID":"6f56d968-4c1b-4b66-bb52-58a9cd62c09f","Type":"ContainerDied","Data":"c48232a000ae7e799910cff1cc75d448dcb908779a4c7a1eabbc0eb25f431e07"} Jul 01 18:10:00.925492 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:00.925441 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" podStartSLOduration=286.925425441 podStartE2EDuration="4m46.925425441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:00.924499038 +0000 UTC m=+288.426063347" watchObservedRunningTime="2026-07-01 18:10:00.925425441 +0000 UTC m=+288.426989746" Jul 01 18:10:01.917479 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.917439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-558f6987-m8w69" event={"ID":"6f56d968-4c1b-4b66-bb52-58a9cd62c09f","Type":"ContainerStarted","Data":"d430320cce761271cf0164892a9c144939c6340ee381c729c58517515c8ded9a"} Jul 01 18:10:01.919024 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.919001 2561 generic.go:356] "Generic (PLEG): container finished" podID="111da0d6-c98a-4ee8-a340-6c0c94957d20" containerID="8dd9f327983268409e7cb33eba3c54e3d9a749e332bee48f9750f9a4e2a6a00c" exitCode=1 Jul 01 18:10:01.919166 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.919072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" event={"ID":"111da0d6-c98a-4ee8-a340-6c0c94957d20","Type":"ContainerDied","Data":"8dd9f327983268409e7cb33eba3c54e3d9a749e332bee48f9750f9a4e2a6a00c"} Jul 01 18:10:01.919166 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.919163 2561 scope.go:117] "RemoveContainer" containerID="70d2acb094c645b06c653f0004e44e51fe53f1477330e0f913f9f948b2fcaaed" Jul 01 18:10:01.919440 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.919416 2561 scope.go:117] "RemoveContainer" containerID="8dd9f327983268409e7cb33eba3c54e3d9a749e332bee48f9750f9a4e2a6a00c" Jul 01 18:10:01.919607 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:01.919584 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-894595b9c-7nfhg_open-cluster-management-agent-addon(111da0d6-c98a-4ee8-a340-6c0c94957d20)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" podUID="111da0d6-c98a-4ee8-a340-6c0c94957d20" Jul 01 18:10:01.920690 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.920671 2561 generic.go:356] "Generic (PLEG): container finished" podID="3d93168c-1532-41f1-89f8-29054315f5e4" containerID="22054b700ed08c99d7ba687ba3bc668a4adbe4ceda834a1f61be6daa9c2e1ce8" exitCode=255 Jul 01 18:10:01.920768 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.920749 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" event={"ID":"3d93168c-1532-41f1-89f8-29054315f5e4","Type":"ContainerDied","Data":"22054b700ed08c99d7ba687ba3bc668a4adbe4ceda834a1f61be6daa9c2e1ce8"} Jul 01 18:10:01.921017 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.921005 2561 scope.go:117] "RemoveContainer" containerID="22054b700ed08c99d7ba687ba3bc668a4adbe4ceda834a1f61be6daa9c2e1ce8" Jul 01 18:10:01.921150 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:01.921113 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-58779bfff6-m79w8_open-cluster-management-agent-addon(3d93168c-1532-41f1-89f8-29054315f5e4)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" podUID="3d93168c-1532-41f1-89f8-29054315f5e4" Jul 01 18:10:01.928959 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:01.928941 2561 scope.go:117] "RemoveContainer" containerID="a3dabe278bdf78ac446c772bc4b5e1dc6acc24d3f815f1a5586e5217f370bd21" Jul 01 18:10:02.537524 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:02.537490 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:10:02.926633 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:02.926608 2561 scope.go:117] "RemoveContainer" containerID="8dd9f327983268409e7cb33eba3c54e3d9a749e332bee48f9750f9a4e2a6a00c" Jul 01 18:10:02.927069 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:02.926750 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-894595b9c-7nfhg_open-cluster-management-agent-addon(111da0d6-c98a-4ee8-a340-6c0c94957d20)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" podUID="111da0d6-c98a-4ee8-a340-6c0c94957d20" Jul 01 18:10:04.935856 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:04.935818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljdmk" event={"ID":"d1896050-27d3-4cd3-8227-46210fcd69f6","Type":"ContainerStarted","Data":"63d29209972ff6662323ca35dc3c0c287778d09a0c8e6c4679360741273c1249"} Jul 01 18:10:04.936293 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:04.935878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljdmk" event={"ID":"d1896050-27d3-4cd3-8227-46210fcd69f6","Type":"ContainerStarted","Data":"caf2ca93ef883400cbfc874625a09e99685c80d4f6ced7e64949cd9504f0b916"} Jul 01 18:10:04.936293 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:04.935917 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ljdmk" Jul 01 18:10:04.952046 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:04.951989 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ljdmk" podStartSLOduration=251.349362334 podStartE2EDuration="4m14.951973811s" totalImagesPullingTime="3.602611477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:04.951951898 +0000 UTC m=+292.453516203" watchObservedRunningTime="2026-07-01 18:10:04.951973811 +0000 UTC m=+292.453538094" Jul 01 18:10:10.724224 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:10.724186 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:10:10.724605 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:10.724584 2561 scope.go:117] "RemoveContainer" containerID="8dd9f327983268409e7cb33eba3c54e3d9a749e332bee48f9750f9a4e2a6a00c" Jul 01 18:10:10.724750 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:10.724730 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-894595b9c-7nfhg_open-cluster-management-agent-addon(111da0d6-c98a-4ee8-a340-6c0c94957d20)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" podUID="111da0d6-c98a-4ee8-a340-6c0c94957d20" Jul 01 18:10:10.753810 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:10.753778 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" Jul 01 18:10:10.754154 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:10.754139 2561 scope.go:117] "RemoveContainer" containerID="22054b700ed08c99d7ba687ba3bc668a4adbe4ceda834a1f61be6daa9c2e1ce8" Jul 01 18:10:10.754302 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:10.754283 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-58779bfff6-m79w8_open-cluster-management-agent-addon(3d93168c-1532-41f1-89f8-29054315f5e4)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" podUID="3d93168c-1532-41f1-89f8-29054315f5e4" Jul 01 18:10:10.957502 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:10.957466 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-92l4g" event={"ID":"359cb70d-175a-42f3-8179-8b38cf746b34","Type":"ContainerStarted","Data":"030c9c412f43b5133f36fdc706f9f6b9cba08f4bb49448b8042fe0f251554520"} Jul 01 18:10:10.976985 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:10.976889 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-92l4g" podStartSLOduration=16.891216411 podStartE2EDuration="39.976872337s" totalImagesPullingTime="23.085655926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:09:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-01 18:10:10.975624771 +0000 UTC m=+298.477189079" watchObservedRunningTime="2026-07-01 18:10:10.976872337 +0000 UTC m=+298.478436642" Jul 01 18:10:12.886490 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:12.886458 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:10:12.886963 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:12.886729 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:10:12.892226 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:12.892206 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 18:10:12.938909 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:12.938746 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-88zx4" podUID="007188c8-8039-4d6a-8dc6-e80b4698e864" Jul 01 18:10:14.941414 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:14.941385 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ljdmk" Jul 01 18:10:17.332121 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.332085 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vhnn5"] Jul 01 18:10:17.335378 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.335352 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.338052 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.338023 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 18:10:17.338217 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.338066 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 18:10:17.339110 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.339091 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 18:10:17.339251 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.339120 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 18:10:17.339251 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.339150 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 18:10:17.339251 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.339092 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 18:10:17.339251 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.339239 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rtf57\"" Jul 01 18:10:17.392616 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-sys\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392616 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392820 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392641 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdxr\" (UniqueName: \"kubernetes.io/projected/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-kube-api-access-dxdxr\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392820 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392664 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-tls\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392820 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-metrics-client-ca\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392820 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-wtmp\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392939 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392939 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-textfile\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.392939 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.392870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-root\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494144 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-wtmp\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494311 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494311 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-textfile\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494311 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-root\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494311 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-sys\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494311 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-wtmp\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494311 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494576 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdxr\" (UniqueName: \"kubernetes.io/projected/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-kube-api-access-dxdxr\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494576 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-tls\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494576 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-metrics-client-ca\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494576 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494401 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-root\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494576 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494356 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-sys\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.494576 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:17.494506 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 18:10:17.494782 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:17.494578 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-tls podName:bc1dd7bb-3833-4234-a2a7-f5adca7456b8 nodeName:}" failed. No retries permitted until 2026-07-01 18:10:17.994555706 +0000 UTC m=+305.496120003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-tls") pod "node-exporter-vhnn5" (UID: "bc1dd7bb-3833-4234-a2a7-f5adca7456b8") : secret "node-exporter-tls" not found Jul 01 18:10:17.494782 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.494589 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-textfile\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.499498 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.495326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.499498 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.495393 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-metrics-client-ca\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.499498 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.497349 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.505016 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.504990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdxr\" (UniqueName: \"kubernetes.io/projected/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-kube-api-access-dxdxr\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.997246 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.997206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-tls\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:17.999668 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:17.999644 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc1dd7bb-3833-4234-a2a7-f5adca7456b8-node-exporter-tls\") pod \"node-exporter-vhnn5\" (UID: \"bc1dd7bb-3833-4234-a2a7-f5adca7456b8\") " pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:18.244369 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:18.244329 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhnn5" Jul 01 18:10:18.260261 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:10:18.260229 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1dd7bb_3833_4234_a2a7_f5adca7456b8.slice/crio-c97523cbf982e5592ef9adb42af06d19d9963f61942715f374c4d356c0efc57f WatchSource:0}: Error finding container c97523cbf982e5592ef9adb42af06d19d9963f61942715f374c4d356c0efc57f: Status 404 returned error can't find the container with id c97523cbf982e5592ef9adb42af06d19d9963f61942715f374c4d356c0efc57f Jul 01 18:10:18.262221 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:18.262200 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:10:18.985537 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:18.985504 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhnn5" event={"ID":"bc1dd7bb-3833-4234-a2a7-f5adca7456b8","Type":"ContainerStarted","Data":"c97523cbf982e5592ef9adb42af06d19d9963f61942715f374c4d356c0efc57f"} Jul 01 18:10:19.990694 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:19.990656 2561 generic.go:356] "Generic (PLEG): container finished" podID="bc1dd7bb-3833-4234-a2a7-f5adca7456b8" containerID="039df2dec4cedfef760e0e43a91f5f95879b03f7e5844025afe72e567ad19e8d" exitCode=0 Jul 01 18:10:19.991167 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:19.990746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhnn5" event={"ID":"bc1dd7bb-3833-4234-a2a7-f5adca7456b8","Type":"ContainerDied","Data":"039df2dec4cedfef760e0e43a91f5f95879b03f7e5844025afe72e567ad19e8d"} Jul 01 18:10:20.506972 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:20.506940 2561 patch_prober.go:28] interesting pod/image-registry-57cb9cbd86-sd5x7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 18:10:20.507159 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:20.506988 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:10:20.554405 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:20.554371 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57cb9cbd86-sd5x7"] Jul 01 18:10:20.558668 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:20.558639 2561 patch_prober.go:28] interesting pod/image-registry-57cb9cbd86-sd5x7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 18:10:20.558834 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:20.558682 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:10:20.996263 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:20.996225 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhnn5" event={"ID":"bc1dd7bb-3833-4234-a2a7-f5adca7456b8","Type":"ContainerStarted","Data":"4398ba07436244b95d855eb0e398e5362d05cd6e3c345eb27d060dade467f79e"} Jul 01 18:10:20.996624 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:20.996278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhnn5" event={"ID":"bc1dd7bb-3833-4234-a2a7-f5adca7456b8","Type":"ContainerStarted","Data":"2e8982fb4e094762c6786e089797b9f53af5fe3201e49c0460353176eaa10786"} Jul 01 18:10:21.016196 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:21.016140 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vhnn5" podStartSLOduration=2.8863410309999997 podStartE2EDuration="4.016105874s" totalImagesPullingTime="1.056186464s" totalInitContainerRuntime="73.578379ms" isStatefulPod=true podCreationTimestamp="2026-07-01 18:10:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:10:21.015374979 +0000 UTC m=+308.516939285" watchObservedRunningTime="2026-07-01 18:10:21.016105874 +0000 UTC m=+308.517670225" Jul 01 18:10:23.938806 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:23.938765 2561 scope.go:117] "RemoveContainer" containerID="8dd9f327983268409e7cb33eba3c54e3d9a749e332bee48f9750f9a4e2a6a00c" Jul 01 18:10:24.938455 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:24.938423 2561 scope.go:117] "RemoveContainer" containerID="22054b700ed08c99d7ba687ba3bc668a4adbe4ceda834a1f61be6daa9c2e1ce8" Jul 01 18:10:25.013317 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:25.013284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" event={"ID":"111da0d6-c98a-4ee8-a340-6c0c94957d20","Type":"ContainerStarted","Data":"4551213bd1760e41b40de580545839365a71cf1a65860bf486ee963862e8e2fc"} Jul 01 18:10:25.013720 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:25.013570 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:10:25.015230 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:25.015210 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-894595b9c-7nfhg" Jul 01 18:10:26.017968 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:26.017930 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58779bfff6-m79w8" event={"ID":"3d93168c-1532-41f1-89f8-29054315f5e4","Type":"ContainerStarted","Data":"33b58fc59d2ffecb8490494c9ba98ce4c9022db7a179191073fc4f69912c05e5"} Jul 01 18:10:26.938388 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:26.938350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:10:30.558624 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:30.558596 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:10:45.574723 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.574672 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" containerName="registry" containerID="cri-o://2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0" gracePeriod=30 Jul 01 18:10:45.825701 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.825639 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:10:45.905375 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905339 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-installation-pull-secrets\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905375 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905385 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-certificates\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905642 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905411 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905642 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905441 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-ca-trust-extracted\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905642 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905456 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-trusted-ca\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905642 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905474 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-image-registry-private-configuration\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905642 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905516 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-bound-sa-token\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905642 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905534 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s5wt\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-kube-api-access-5s5wt\") pod \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\" (UID: \"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f\") " Jul 01 18:10:45.905994 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.905961 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:10:45.906234 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.906202 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 18:10:45.908286 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.908252 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-kube-api-access-5s5wt" (OuterVolumeSpecName: "kube-api-access-5s5wt") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "kube-api-access-5s5wt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:10:45.908407 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.908319 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:10:45.908407 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.908388 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:10:45.908551 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.908530 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:10:45.908551 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.908541 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:10:45.914287 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:45.914255 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" (UID: "d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:10:46.006844 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006804 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-installation-pull-secrets\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.006844 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006838 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-certificates\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.006844 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006849 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-registry-tls\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.006844 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006858 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-ca-trust-extracted\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.007092 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006866 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-trusted-ca\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.007092 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006875 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-image-registry-private-configuration\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.007092 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006885 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-bound-sa-token\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.007092 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.006893 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s5wt\" (UniqueName: \"kubernetes.io/projected/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f-kube-api-access-5s5wt\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:10:46.081747 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.081659 2561 generic.go:356] "Generic (PLEG): container finished" podID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" containerID="2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0" exitCode=0 Jul 01 18:10:46.081747 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.081709 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" Jul 01 18:10:46.081921 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.081745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" event={"ID":"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f","Type":"ContainerDied","Data":"2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0"} Jul 01 18:10:46.081921 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.081799 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57cb9cbd86-sd5x7" event={"ID":"d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f","Type":"ContainerDied","Data":"48b506c6a4b6adc4a5d1879746095b71656f5994a1a6472b3ee3785cad365949"} Jul 01 18:10:46.081921 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.081818 2561 scope.go:117] "RemoveContainer" containerID="2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0" Jul 01 18:10:46.089998 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.089978 2561 scope.go:117] "RemoveContainer" containerID="2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0" Jul 01 18:10:46.090345 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:10:46.090322 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0\": container with ID starting with 2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0 not found: ID does not exist" containerID="2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0" Jul 01 18:10:46.090393 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.090353 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0"} err="failed to get container status \"2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0\": rpc error: code = NotFound desc = could not find container \"2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0\": container with ID starting with 2c63b531f4456d409aa9e19a0633bbf0f6b787015c2cedc4af5909f5505a5ef0 not found: ID does not exist" Jul 01 18:10:46.101413 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.101391 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57cb9cbd86-sd5x7"] Jul 01 18:10:46.105511 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.105487 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57cb9cbd86-sd5x7"] Jul 01 18:10:46.941806 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:10:46.941775 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" path="/var/lib/kubelet/pods/d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f/volumes" Jul 01 18:11:25.903859 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:25.903818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:11:25.906265 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:25.906246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/007188c8-8039-4d6a-8dc6-e80b4698e864-metrics-certs\") pod \"network-metrics-daemon-88zx4\" (UID: \"007188c8-8039-4d6a-8dc6-e80b4698e864\") " pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:11:26.041695 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:26.041658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bpwcg\"" Jul 01 18:11:26.050007 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:26.049988 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-88zx4" Jul 01 18:11:26.185395 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:26.185321 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-88zx4"] Jul 01 18:11:26.188432 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:11:26.188404 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007188c8_8039_4d6a_8dc6_e80b4698e864.slice/crio-086bd4c7802eba168b1ba93592bd03c3af9bcace8aff86018a9eb81dca2b04b6 WatchSource:0}: Error finding container 086bd4c7802eba168b1ba93592bd03c3af9bcace8aff86018a9eb81dca2b04b6: Status 404 returned error can't find the container with id 086bd4c7802eba168b1ba93592bd03c3af9bcace8aff86018a9eb81dca2b04b6 Jul 01 18:11:26.217063 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:26.217029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-88zx4" event={"ID":"007188c8-8039-4d6a-8dc6-e80b4698e864","Type":"ContainerStarted","Data":"086bd4c7802eba168b1ba93592bd03c3af9bcace8aff86018a9eb81dca2b04b6"} Jul 01 18:11:27.222024 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:27.221955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-88zx4" event={"ID":"007188c8-8039-4d6a-8dc6-e80b4698e864","Type":"ContainerStarted","Data":"6de1c0f1a85398d1b3d08632d56a1b68a96426b6c68cd3fd7d5071a8bbc5d629"} Jul 01 18:11:28.226845 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:28.226809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-88zx4" event={"ID":"007188c8-8039-4d6a-8dc6-e80b4698e864","Type":"ContainerStarted","Data":"b3cc2e0c27389eeefb3d916d172230c00fb5d4bf677606e6ba473c9b649f5d9b"} Jul 01 18:11:28.242303 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:11:28.242255 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-88zx4" podStartSLOduration=373.380519 podStartE2EDuration="6m14.242239074s" totalImagesPullingTime="861.720074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:11:28.241085642 +0000 UTC m=+375.742649948" watchObservedRunningTime="2026-07-01 18:11:28.242239074 +0000 UTC m=+375.743803409" Jul 01 18:14:03.478527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.478487 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn"] Jul 01 18:14:03.478979 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.478776 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" containerName="registry" Jul 01 18:14:03.478979 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.478793 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" containerName="registry" Jul 01 18:14:03.478979 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.478841 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d7a5b2-652c-45e8-8908-9d6a4d2fa96f" containerName="registry" Jul 01 18:14:03.480888 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.480845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.483328 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.483306 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 01 18:14:03.483461 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.483337 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 01 18:14:03.484352 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.484329 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 01 18:14:03.484471 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.484355 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-q7p4h\"" Jul 01 18:14:03.484471 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.484355 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 01 18:14:03.484471 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.484335 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 01 18:14:03.490465 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.490438 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn"] Jul 01 18:14:03.652403 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.652366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.652579 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.652421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpqfk\" (UniqueName: \"kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-kube-api-access-dpqfk\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.652579 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.652473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-certificates\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.753253 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.753163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpqfk\" (UniqueName: \"kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-kube-api-access-dpqfk\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.753253 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.753202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-certificates\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.753253 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.753243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.753560 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:14:03.753390 2561 secret.go:281] references non-existent secret key: tls.crt Jul 01 18:14:03.753560 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:14:03.753416 2561 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 01 18:14:03.753560 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:14:03.753438 2561 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn: references non-existent secret key: tls.crt Jul 01 18:14:03.753560 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:14:03.753504 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-certificates podName:dc3f0f6a-57df-4544-9ab1-94af73de9ccd nodeName:}" failed. No retries permitted until 2026-07-01 18:14:04.253481938 +0000 UTC m=+531.755046224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-certificates") pod "keda-metrics-apiserver-559f75f947-c7mnn" (UID: "dc3f0f6a-57df-4544-9ab1-94af73de9ccd") : references non-existent secret key: tls.crt Jul 01 18:14:03.753560 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.753553 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.763426 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.763392 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpqfk\" (UniqueName: \"kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-kube-api-access-dpqfk\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:03.912525 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.912487 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-k6xgc"] Jul 01 18:14:03.914656 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.914640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:03.917052 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.917032 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 01 18:14:03.924182 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:03.924148 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-k6xgc"] Jul 01 18:14:04.055366 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.055271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6kz2\" (UniqueName: \"kubernetes.io/projected/c4e100b1-c37d-43d4-86d5-0f507f91021c-kube-api-access-s6kz2\") pod \"keda-admission-5fbd5c4644-k6xgc\" (UID: \"c4e100b1-c37d-43d4-86d5-0f507f91021c\") " pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:04.055366 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.055313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c4e100b1-c37d-43d4-86d5-0f507f91021c-certificates\") pod \"keda-admission-5fbd5c4644-k6xgc\" (UID: \"c4e100b1-c37d-43d4-86d5-0f507f91021c\") " pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:04.155837 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.155798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6kz2\" (UniqueName: \"kubernetes.io/projected/c4e100b1-c37d-43d4-86d5-0f507f91021c-kube-api-access-s6kz2\") pod \"keda-admission-5fbd5c4644-k6xgc\" (UID: \"c4e100b1-c37d-43d4-86d5-0f507f91021c\") " pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:04.156021 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.155849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c4e100b1-c37d-43d4-86d5-0f507f91021c-certificates\") pod \"keda-admission-5fbd5c4644-k6xgc\" (UID: \"c4e100b1-c37d-43d4-86d5-0f507f91021c\") " pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:04.158576 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.158554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/c4e100b1-c37d-43d4-86d5-0f507f91021c-certificates\") pod \"keda-admission-5fbd5c4644-k6xgc\" (UID: \"c4e100b1-c37d-43d4-86d5-0f507f91021c\") " pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:04.164585 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.164554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6kz2\" (UniqueName: \"kubernetes.io/projected/c4e100b1-c37d-43d4-86d5-0f507f91021c-kube-api-access-s6kz2\") pod \"keda-admission-5fbd5c4644-k6xgc\" (UID: \"c4e100b1-c37d-43d4-86d5-0f507f91021c\") " pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:04.225395 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.225357 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:04.256531 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.256498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-certificates\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:04.259158 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.259120 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/dc3f0f6a-57df-4544-9ab1-94af73de9ccd-certificates\") pod \"keda-metrics-apiserver-559f75f947-c7mnn\" (UID: \"dc3f0f6a-57df-4544-9ab1-94af73de9ccd\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:04.356403 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.356290 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-k6xgc"] Jul 01 18:14:04.360920 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:14:04.360892 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e100b1_c37d_43d4_86d5_0f507f91021c.slice/crio-44b0ae444287c5c09d66cb42dcec31d35648d12a0b44d8a8becfc2bf7656b34a WatchSource:0}: Error finding container 44b0ae444287c5c09d66cb42dcec31d35648d12a0b44d8a8becfc2bf7656b34a: Status 404 returned error can't find the container with id 44b0ae444287c5c09d66cb42dcec31d35648d12a0b44d8a8becfc2bf7656b34a Jul 01 18:14:04.391098 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.391061 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:04.524971 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.524937 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn"] Jul 01 18:14:04.528442 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:14:04.528408 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3f0f6a_57df_4544_9ab1_94af73de9ccd.slice/crio-fdbdd4a386cdec646f02dc0099c3a84f2c0aa70d994490a9857ce213d10ef936 WatchSource:0}: Error finding container fdbdd4a386cdec646f02dc0099c3a84f2c0aa70d994490a9857ce213d10ef936: Status 404 returned error can't find the container with id fdbdd4a386cdec646f02dc0099c3a84f2c0aa70d994490a9857ce213d10ef936 Jul 01 18:14:04.743737 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.743697 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" event={"ID":"c4e100b1-c37d-43d4-86d5-0f507f91021c","Type":"ContainerStarted","Data":"44b0ae444287c5c09d66cb42dcec31d35648d12a0b44d8a8becfc2bf7656b34a"} Jul 01 18:14:04.744740 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:04.744715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" event={"ID":"dc3f0f6a-57df-4544-9ab1-94af73de9ccd","Type":"ContainerStarted","Data":"fdbdd4a386cdec646f02dc0099c3a84f2c0aa70d994490a9857ce213d10ef936"} Jul 01 18:14:07.758746 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:07.758643 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" event={"ID":"c4e100b1-c37d-43d4-86d5-0f507f91021c","Type":"ContainerStarted","Data":"a947418beafd3b256c70947b4d084cb7dfd331c90f1f76b2b43a970ebd597fd0"} Jul 01 18:14:07.758746 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:07.758740 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:14:07.775398 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:07.775346 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" podStartSLOduration=1.745221394 podStartE2EDuration="4.77532668s" totalImagesPullingTime="3.030105286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:14:07.773975694 +0000 UTC m=+535.275540023" watchObservedRunningTime="2026-07-01 18:14:07.77532668 +0000 UTC m=+535.276890986" Jul 01 18:14:09.767712 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:09.767677 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" event={"ID":"dc3f0f6a-57df-4544-9ab1-94af73de9ccd","Type":"ContainerStarted","Data":"da8a72585a66906620321132ac21b7d99fc5756846022793de272336a6edd10b"} Jul 01 18:14:09.768151 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:09.767750 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:09.785778 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:09.785726 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" podStartSLOduration=1.770553063 podStartE2EDuration="6.785709205s" totalImagesPullingTime="5.015156142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:14:09.783919065 +0000 UTC m=+537.285483348" watchObservedRunningTime="2026-07-01 18:14:09.785709205 +0000 UTC m=+537.287273510" Jul 01 18:14:20.774917 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:20.774886 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-c7mnn" Jul 01 18:14:28.764642 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:14:28.764613 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-k6xgc" Jul 01 18:15:08.491433 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.491397 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-h6ndw"] Jul 01 18:15:08.494333 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.494314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.496826 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.496801 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 01 18:15:08.497972 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.497949 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 18:15:08.498073 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.497951 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-wgm24\"" Jul 01 18:15:08.498073 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.497956 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 18:15:08.504030 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.504008 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-h6ndw"] Jul 01 18:15:08.534658 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.534629 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-x528k"] Jul 01 18:15:08.536847 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.536830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.539432 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.539406 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 18:15:08.539542 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.539433 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-w57gl\"" Jul 01 18:15:08.548673 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.548649 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-x528k"] Jul 01 18:15:08.577794 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.577758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j26qw\" (UniqueName: \"kubernetes.io/projected/0879d7df-3974-4630-b65b-b894b8733135-kube-api-access-j26qw\") pod \"kserve-controller-manager-776d68c7c4-h6ndw\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.577977 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.577817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c31d423-b198-4cc0-8ec3-fe17ab456410-data\") pod \"seaweedfs-64568bcd49-x528k\" (UID: \"3c31d423-b198-4cc0-8ec3-fe17ab456410\") " pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.577977 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.577847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd7vq\" (UniqueName: \"kubernetes.io/projected/3c31d423-b198-4cc0-8ec3-fe17ab456410-kube-api-access-cd7vq\") pod \"seaweedfs-64568bcd49-x528k\" (UID: \"3c31d423-b198-4cc0-8ec3-fe17ab456410\") " pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.577977 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.577866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879d7df-3974-4630-b65b-b894b8733135-cert\") pod \"kserve-controller-manager-776d68c7c4-h6ndw\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.678438 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.678407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j26qw\" (UniqueName: \"kubernetes.io/projected/0879d7df-3974-4630-b65b-b894b8733135-kube-api-access-j26qw\") pod \"kserve-controller-manager-776d68c7c4-h6ndw\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.678644 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.678463 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c31d423-b198-4cc0-8ec3-fe17ab456410-data\") pod \"seaweedfs-64568bcd49-x528k\" (UID: \"3c31d423-b198-4cc0-8ec3-fe17ab456410\") " pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.678644 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.678493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd7vq\" (UniqueName: \"kubernetes.io/projected/3c31d423-b198-4cc0-8ec3-fe17ab456410-kube-api-access-cd7vq\") pod \"seaweedfs-64568bcd49-x528k\" (UID: \"3c31d423-b198-4cc0-8ec3-fe17ab456410\") " pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.678644 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.678521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879d7df-3974-4630-b65b-b894b8733135-cert\") pod \"kserve-controller-manager-776d68c7c4-h6ndw\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.678875 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.678852 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3c31d423-b198-4cc0-8ec3-fe17ab456410-data\") pod \"seaweedfs-64568bcd49-x528k\" (UID: \"3c31d423-b198-4cc0-8ec3-fe17ab456410\") " pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.681098 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.681078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879d7df-3974-4630-b65b-b894b8733135-cert\") pod \"kserve-controller-manager-776d68c7c4-h6ndw\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.687168 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.687118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd7vq\" (UniqueName: \"kubernetes.io/projected/3c31d423-b198-4cc0-8ec3-fe17ab456410-kube-api-access-cd7vq\") pod \"seaweedfs-64568bcd49-x528k\" (UID: \"3c31d423-b198-4cc0-8ec3-fe17ab456410\") " pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.687364 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.687345 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j26qw\" (UniqueName: \"kubernetes.io/projected/0879d7df-3974-4630-b65b-b894b8733135-kube-api-access-j26qw\") pod \"kserve-controller-manager-776d68c7c4-h6ndw\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.805179 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.805071 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:08.848733 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.848698 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:08.945909 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.945817 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-h6ndw"] Jul 01 18:15:08.950702 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:15:08.950657 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0879d7df_3974_4630_b65b_b894b8733135.slice/crio-6b8f18c822ff1686a5ae41f140ea8968b80637263ece4d68890d84914bf8cecb WatchSource:0}: Error finding container 6b8f18c822ff1686a5ae41f140ea8968b80637263ece4d68890d84914bf8cecb: Status 404 returned error can't find the container with id 6b8f18c822ff1686a5ae41f140ea8968b80637263ece4d68890d84914bf8cecb Jul 01 18:15:08.968073 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.968041 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" event={"ID":"0879d7df-3974-4630-b65b-b894b8733135","Type":"ContainerStarted","Data":"6b8f18c822ff1686a5ae41f140ea8968b80637263ece4d68890d84914bf8cecb"} Jul 01 18:15:08.990285 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:08.990254 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-x528k"] Jul 01 18:15:08.993979 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:15:08.993949 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c31d423_b198_4cc0_8ec3_fe17ab456410.slice/crio-d04ae9a6442ba8051d4017382b225855c29fa6b2fdfc6889c8ca35ce7d035ac4 WatchSource:0}: Error finding container d04ae9a6442ba8051d4017382b225855c29fa6b2fdfc6889c8ca35ce7d035ac4: Status 404 returned error can't find the container with id d04ae9a6442ba8051d4017382b225855c29fa6b2fdfc6889c8ca35ce7d035ac4 Jul 01 18:15:09.973989 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:09.973949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-x528k" event={"ID":"3c31d423-b198-4cc0-8ec3-fe17ab456410","Type":"ContainerStarted","Data":"d04ae9a6442ba8051d4017382b225855c29fa6b2fdfc6889c8ca35ce7d035ac4"} Jul 01 18:15:12.870029 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:12.870002 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 18:15:12.911558 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:12.911523 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:15:12.912358 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:12.912329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:15:12.988898 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:12.988857 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-x528k" event={"ID":"3c31d423-b198-4cc0-8ec3-fe17ab456410","Type":"ContainerStarted","Data":"a63aa70eb7608ac489e46c6b730380220908e7069e6033d4510c480735bee308"} Jul 01 18:15:12.989144 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:12.988922 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:12.990409 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:12.990382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" event={"ID":"0879d7df-3974-4630-b65b-b894b8733135","Type":"ContainerStarted","Data":"ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598"} Jul 01 18:15:12.990527 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:12.990511 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:13.004997 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:13.004943 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-x528k" podStartSLOduration=1.132557134 podStartE2EDuration="5.004928123s" totalImagesPullingTime="3.872370989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:15:13.003671675 +0000 UTC m=+600.505235993" watchObservedRunningTime="2026-07-01 18:15:13.004928123 +0000 UTC m=+600.506492427" Jul 01 18:15:13.018414 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:13.018368 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" podStartSLOduration=1.168180019 podStartE2EDuration="5.018352628s" totalImagesPullingTime="3.850172609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:15:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:15:13.01758692 +0000 UTC m=+600.519151216" watchObservedRunningTime="2026-07-01 18:15:13.018352628 +0000 UTC m=+600.519916932" Jul 01 18:15:18.996340 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:18.996304 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-x528k" Jul 01 18:15:43.618927 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.618889 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-h6ndw"] Jul 01 18:15:43.619428 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.619081 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" podUID="0879d7df-3974-4630-b65b-b894b8733135" containerName="manager" containerID="cri-o://ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598" gracePeriod=10 Jul 01 18:15:43.623994 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.623966 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:43.650891 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.650860 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-dq64h"] Jul 01 18:15:43.653972 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.653956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:43.663083 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.663058 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-dq64h"] Jul 01 18:15:43.734479 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.734448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d44c1641-a625-46fb-9f6f-16777efd4594-cert\") pod \"kserve-controller-manager-776d68c7c4-dq64h\" (UID: \"d44c1641-a625-46fb-9f6f-16777efd4594\") " pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:43.734641 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.734488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c4mq\" (UniqueName: \"kubernetes.io/projected/d44c1641-a625-46fb-9f6f-16777efd4594-kube-api-access-5c4mq\") pod \"kserve-controller-manager-776d68c7c4-dq64h\" (UID: \"d44c1641-a625-46fb-9f6f-16777efd4594\") " pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:43.835593 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.835556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d44c1641-a625-46fb-9f6f-16777efd4594-cert\") pod \"kserve-controller-manager-776d68c7c4-dq64h\" (UID: \"d44c1641-a625-46fb-9f6f-16777efd4594\") " pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:43.835593 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.835599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c4mq\" (UniqueName: \"kubernetes.io/projected/d44c1641-a625-46fb-9f6f-16777efd4594-kube-api-access-5c4mq\") pod \"kserve-controller-manager-776d68c7c4-dq64h\" (UID: \"d44c1641-a625-46fb-9f6f-16777efd4594\") " pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:43.838100 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.838060 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d44c1641-a625-46fb-9f6f-16777efd4594-cert\") pod \"kserve-controller-manager-776d68c7c4-dq64h\" (UID: \"d44c1641-a625-46fb-9f6f-16777efd4594\") " pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:43.844528 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.844506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c4mq\" (UniqueName: \"kubernetes.io/projected/d44c1641-a625-46fb-9f6f-16777efd4594-kube-api-access-5c4mq\") pod \"kserve-controller-manager-776d68c7c4-dq64h\" (UID: \"d44c1641-a625-46fb-9f6f-16777efd4594\") " pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:43.860839 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.860817 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:43.936142 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.936037 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j26qw\" (UniqueName: \"kubernetes.io/projected/0879d7df-3974-4630-b65b-b894b8733135-kube-api-access-j26qw\") pod \"0879d7df-3974-4630-b65b-b894b8733135\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " Jul 01 18:15:43.936142 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.936083 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879d7df-3974-4630-b65b-b894b8733135-cert\") pod \"0879d7df-3974-4630-b65b-b894b8733135\" (UID: \"0879d7df-3974-4630-b65b-b894b8733135\") " Jul 01 18:15:43.938369 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.938336 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0879d7df-3974-4630-b65b-b894b8733135-kube-api-access-j26qw" (OuterVolumeSpecName: "kube-api-access-j26qw") pod "0879d7df-3974-4630-b65b-b894b8733135" (UID: "0879d7df-3974-4630-b65b-b894b8733135"). InnerVolumeSpecName "kube-api-access-j26qw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:15:43.938476 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:43.938424 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0879d7df-3974-4630-b65b-b894b8733135-cert" (OuterVolumeSpecName: "cert") pod "0879d7df-3974-4630-b65b-b894b8733135" (UID: "0879d7df-3974-4630-b65b-b894b8733135"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:15:44.018097 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.018054 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:44.037178 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.037150 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j26qw\" (UniqueName: \"kubernetes.io/projected/0879d7df-3974-4630-b65b-b894b8733135-kube-api-access-j26qw\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:15:44.037178 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.037177 2561 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0879d7df-3974-4630-b65b-b894b8733135-cert\") on node \"ip-10-0-139-128.ec2.internal\" DevicePath \"\"" Jul 01 18:15:44.099497 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.099463 2561 generic.go:356] "Generic (PLEG): container finished" podID="0879d7df-3974-4630-b65b-b894b8733135" containerID="ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598" exitCode=0 Jul 01 18:15:44.099666 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.099521 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" Jul 01 18:15:44.099666 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.099522 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" event={"ID":"0879d7df-3974-4630-b65b-b894b8733135","Type":"ContainerDied","Data":"ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598"} Jul 01 18:15:44.099764 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.099669 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-h6ndw" event={"ID":"0879d7df-3974-4630-b65b-b894b8733135","Type":"ContainerDied","Data":"6b8f18c822ff1686a5ae41f140ea8968b80637263ece4d68890d84914bf8cecb"} Jul 01 18:15:44.099764 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.099716 2561 scope.go:117] "RemoveContainer" containerID="ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598" Jul 01 18:15:44.109708 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.109687 2561 scope.go:117] "RemoveContainer" containerID="ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598" Jul 01 18:15:44.110039 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:15:44.110015 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598\": container with ID starting with ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598 not found: ID does not exist" containerID="ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598" Jul 01 18:15:44.110101 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.110056 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598"} err="failed to get container status \"ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598\": rpc error: code = NotFound desc = could not find container \"ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598\": container with ID starting with ff4dbe8834971208141aebe7b439dda4edf509d47c8d714b8059991258403598 not found: ID does not exist" Jul 01 18:15:44.122674 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.122641 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-h6ndw"] Jul 01 18:15:44.128182 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.128150 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-h6ndw"] Jul 01 18:15:44.151179 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.151119 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-776d68c7c4-dq64h"] Jul 01 18:15:44.154179 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:15:44.154148 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44c1641_a625_46fb_9f6f_16777efd4594.slice/crio-e6bbf8514284c12e5f82d10f4639fc57a9de36fb9ca096f11010f63e7a4eed56 WatchSource:0}: Error finding container e6bbf8514284c12e5f82d10f4639fc57a9de36fb9ca096f11010f63e7a4eed56: Status 404 returned error can't find the container with id e6bbf8514284c12e5f82d10f4639fc57a9de36fb9ca096f11010f63e7a4eed56 Jul 01 18:15:44.155376 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.155358 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:15:44.942584 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:44.942510 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0879d7df-3974-4630-b65b-b894b8733135" path="/var/lib/kubelet/pods/0879d7df-3974-4630-b65b-b894b8733135/volumes" Jul 01 18:15:45.105627 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:45.105592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" event={"ID":"d44c1641-a625-46fb-9f6f-16777efd4594","Type":"ContainerStarted","Data":"b91aae7bb9a53a3572cc7341b407dcab1dcd7df4d93b5825052106e7954b50f8"} Jul 01 18:15:45.105800 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:45.105647 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" event={"ID":"d44c1641-a625-46fb-9f6f-16777efd4594","Type":"ContainerStarted","Data":"e6bbf8514284c12e5f82d10f4639fc57a9de36fb9ca096f11010f63e7a4eed56"} Jul 01 18:15:45.105800 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:45.105716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:15:45.122574 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:15:45.122503 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" podStartSLOduration=1.648824193 podStartE2EDuration="2.122485807s" totalImagesPullingTime="473.661614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:15:45.121513772 +0000 UTC m=+632.623078074" watchObservedRunningTime="2026-07-01 18:15:45.122485807 +0000 UTC m=+632.624050123" Jul 01 18:16:16.113257 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:16.113228 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-776d68c7c4-dq64h" Jul 01 18:16:17.153868 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.153830 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-t8mj4"] Jul 01 18:16:17.154281 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.154078 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0879d7df-3974-4630-b65b-b894b8733135" containerName="manager" Jul 01 18:16:17.154281 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.154089 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0879d7df-3974-4630-b65b-b894b8733135" containerName="manager" Jul 01 18:16:17.154281 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.154154 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0879d7df-3974-4630-b65b-b894b8733135" containerName="manager" Jul 01 18:16:17.156619 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.156603 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:17.161568 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.161547 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 01 18:16:17.161753 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.161732 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-jh92s\"" Jul 01 18:16:17.175217 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.175187 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-t8mj4"] Jul 01 18:16:17.269173 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.269108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e667a5-17e0-4562-b8f9-1f3d551b781c-tls-certs\") pod \"model-serving-api-fd65d7d6-t8mj4\" (UID: \"73e667a5-17e0-4562-b8f9-1f3d551b781c\") " pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:17.269343 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.269198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rxwm\" (UniqueName: \"kubernetes.io/projected/73e667a5-17e0-4562-b8f9-1f3d551b781c-kube-api-access-5rxwm\") pod \"model-serving-api-fd65d7d6-t8mj4\" (UID: \"73e667a5-17e0-4562-b8f9-1f3d551b781c\") " pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:17.369903 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.369864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e667a5-17e0-4562-b8f9-1f3d551b781c-tls-certs\") pod \"model-serving-api-fd65d7d6-t8mj4\" (UID: \"73e667a5-17e0-4562-b8f9-1f3d551b781c\") " pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:17.370072 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.369923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rxwm\" (UniqueName: \"kubernetes.io/projected/73e667a5-17e0-4562-b8f9-1f3d551b781c-kube-api-access-5rxwm\") pod \"model-serving-api-fd65d7d6-t8mj4\" (UID: \"73e667a5-17e0-4562-b8f9-1f3d551b781c\") " pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:17.370072 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:16:17.370032 2561 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 18:16:17.370173 ip-10-0-139-128 kubenswrapper[2561]: E0701 18:16:17.370102 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73e667a5-17e0-4562-b8f9-1f3d551b781c-tls-certs podName:73e667a5-17e0-4562-b8f9-1f3d551b781c nodeName:}" failed. No retries permitted until 2026-07-01 18:16:17.870086014 +0000 UTC m=+665.371650298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/73e667a5-17e0-4562-b8f9-1f3d551b781c-tls-certs") pod "model-serving-api-fd65d7d6-t8mj4" (UID: "73e667a5-17e0-4562-b8f9-1f3d551b781c") : secret "model-serving-api-tls" not found Jul 01 18:16:17.381441 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.381416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rxwm\" (UniqueName: \"kubernetes.io/projected/73e667a5-17e0-4562-b8f9-1f3d551b781c-kube-api-access-5rxwm\") pod \"model-serving-api-fd65d7d6-t8mj4\" (UID: \"73e667a5-17e0-4562-b8f9-1f3d551b781c\") " pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:17.873824 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.873789 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e667a5-17e0-4562-b8f9-1f3d551b781c-tls-certs\") pod \"model-serving-api-fd65d7d6-t8mj4\" (UID: \"73e667a5-17e0-4562-b8f9-1f3d551b781c\") " pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:17.876437 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:17.876415 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73e667a5-17e0-4562-b8f9-1f3d551b781c-tls-certs\") pod \"model-serving-api-fd65d7d6-t8mj4\" (UID: \"73e667a5-17e0-4562-b8f9-1f3d551b781c\") " pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:18.066620 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:18.066578 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:18.198996 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:18.198855 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-t8mj4"] Jul 01 18:16:18.201784 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:16:18.201753 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e667a5_17e0_4562_b8f9_1f3d551b781c.slice/crio-d3c10a051f767dcdb2b8a0b3b0540ee7a61677e7cc1acdc1ab3c10b596e2b492 WatchSource:0}: Error finding container d3c10a051f767dcdb2b8a0b3b0540ee7a61677e7cc1acdc1ab3c10b596e2b492: Status 404 returned error can't find the container with id d3c10a051f767dcdb2b8a0b3b0540ee7a61677e7cc1acdc1ab3c10b596e2b492 Jul 01 18:16:18.221622 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:18.221589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-t8mj4" event={"ID":"73e667a5-17e0-4562-b8f9-1f3d551b781c","Type":"ContainerStarted","Data":"d3c10a051f767dcdb2b8a0b3b0540ee7a61677e7cc1acdc1ab3c10b596e2b492"} Jul 01 18:16:21.234682 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:21.234609 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-t8mj4" event={"ID":"73e667a5-17e0-4562-b8f9-1f3d551b781c","Type":"ContainerStarted","Data":"1cc12847b103f2c2153ba62c0bd8ff1b380083a8cbee2c310db9342c1ea618fc"} Jul 01 18:16:21.235164 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:21.234704 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:16:21.264331 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:21.264282 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-t8mj4" podStartSLOduration=2.074062761 podStartE2EDuration="4.264264861s" totalImagesPullingTime="2.1902021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:16:21.262978079 +0000 UTC m=+668.764542383" watchObservedRunningTime="2026-07-01 18:16:21.264264861 +0000 UTC m=+668.765829165" Jul 01 18:16:32.242547 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:16:32.242517 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-t8mj4" Jul 01 18:20:12.939673 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:20:12.939642 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:20:12.940627 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:20:12.940535 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:25:12.959818 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:25:12.959708 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:25:12.962872 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:25:12.960965 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:30:12.980176 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:30:12.980044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:30:12.987709 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:30:12.982190 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:34:30.466118 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:30.466092 2561 ???:1] "http: TLS handshake error from 10.0.140.183:33466: EOF" Jul 01 18:34:30.470255 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:30.470232 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7lfk6_4a0c55c6-b31b-4351-be70-1634dc904f25/global-pull-secret-syncer/0.log" Jul 01 18:34:30.564099 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:30.564068 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cgzqv_8ac15a45-8118-4b27-8a47-4f43c83b48db/konnectivity-agent/0.log" Jul 01 18:34:30.650039 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:30.650002 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-128.ec2.internal_75ff5128bd579c311d860ae653b44e0c/haproxy/0.log" Jul 01 18:34:34.832751 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:34.832718 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhnn5_bc1dd7bb-3833-4234-a2a7-f5adca7456b8/node-exporter/0.log" Jul 01 18:34:34.856212 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:34.856193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhnn5_bc1dd7bb-3833-4234-a2a7-f5adca7456b8/kube-rbac-proxy/0.log" Jul 01 18:34:34.879737 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:34.879715 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhnn5_bc1dd7bb-3833-4234-a2a7-f5adca7456b8/init-textfile/0.log" Jul 01 18:34:38.732753 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.732719 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4"] Jul 01 18:34:38.735853 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.735829 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.738681 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.738658 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vfjm\"/\"kube-root-ca.crt\"" Jul 01 18:34:38.739598 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.739577 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9vfjm\"/\"default-dockercfg-ph8jm\"" Jul 01 18:34:38.739669 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.739598 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vfjm\"/\"openshift-service-ca.crt\"" Jul 01 18:34:38.746656 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.746628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4"] Jul 01 18:34:38.792521 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.792481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-proc\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.792521 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.792520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwdhm\" (UniqueName: \"kubernetes.io/projected/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-kube-api-access-rwdhm\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.792771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.792583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-podres\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.792771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.792630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-lib-modules\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.792771 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.792673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-sys\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.893648 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-proc\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.893648 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwdhm\" (UniqueName: \"kubernetes.io/projected/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-kube-api-access-rwdhm\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.893879 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-podres\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.893879 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-lib-modules\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.893879 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893745 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-proc\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.893879 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-sys\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.894009 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-podres\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.894009 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-lib-modules\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.894009 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.893886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-sys\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:38.902567 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:38.902540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwdhm\" (UniqueName: \"kubernetes.io/projected/2550e09f-33d2-4baf-ab0f-bbadcd00fe9a-kube-api-access-rwdhm\") pod \"perf-node-gather-daemonset-56bt4\" (UID: \"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a\") " pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:39.046342 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:39.046245 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:39.181029 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:39.180996 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4"] Jul 01 18:34:39.184394 ip-10-0-139-128 kubenswrapper[2561]: W0701 18:34:39.184362 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2550e09f_33d2_4baf_ab0f_bbadcd00fe9a.slice/crio-72332e62c410a6c08bd832ad571eb8a4ce65c25eca6fa6d6a8b5620861d59082 WatchSource:0}: Error finding container 72332e62c410a6c08bd832ad571eb8a4ce65c25eca6fa6d6a8b5620861d59082: Status 404 returned error can't find the container with id 72332e62c410a6c08bd832ad571eb8a4ce65c25eca6fa6d6a8b5620861d59082 Jul 01 18:34:39.356265 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:39.356236 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ljdmk_d1896050-27d3-4cd3-8227-46210fcd69f6/dns/0.log" Jul 01 18:34:39.377597 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:39.377568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ljdmk_d1896050-27d3-4cd3-8227-46210fcd69f6/kube-rbac-proxy/0.log" Jul 01 18:34:39.497444 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:39.497409 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5cftj_b27d60be-b9f0-43ac-a658-dbbba04242eb/dns-node-resolver/0.log" Jul 01 18:34:40.062889 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:40.062849 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" event={"ID":"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a","Type":"ContainerStarted","Data":"077d0ffe3f67af1f7208ab5692bbd90c24b13a12d286a6d30205fc15470448b0"} Jul 01 18:34:40.063327 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:40.062901 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" event={"ID":"2550e09f-33d2-4baf-ab0f-bbadcd00fe9a","Type":"ContainerStarted","Data":"72332e62c410a6c08bd832ad571eb8a4ce65c25eca6fa6d6a8b5620861d59082"} Jul 01 18:34:40.063327 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:40.062941 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:40.078021 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:40.077969 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" podStartSLOduration=2.077949452 podStartE2EDuration="2.077949452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:34:40.076670804 +0000 UTC m=+1767.578235110" watchObservedRunningTime="2026-07-01 18:34:40.077949452 +0000 UTC m=+1767.579513757" Jul 01 18:34:40.105902 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:40.105872 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhmvd_ef74ef40-28d4-4fe1-9e39-4585c07719c5/node-ca/0.log" Jul 01 18:34:41.292478 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:41.292449 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rktcp_6f5aca4d-043e-44a1-8a2a-d3430fb0d773/serve-healthcheck-canary/0.log" Jul 01 18:34:41.696026 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:41.695988 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-92l4g_359cb70d-175a-42f3-8179-8b38cf746b34/kube-rbac-proxy/0.log" Jul 01 18:34:41.718083 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:41.718053 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-92l4g_359cb70d-175a-42f3-8179-8b38cf746b34/exporter/0.log" Jul 01 18:34:41.743083 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:41.743052 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-92l4g_359cb70d-175a-42f3-8179-8b38cf746b34/extractor/0.log" Jul 01 18:34:43.880991 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:43.880953 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-776d68c7c4-dq64h_d44c1641-a625-46fb-9f6f-16777efd4594/manager/0.log" Jul 01 18:34:43.922735 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:43.922703 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-t8mj4_73e667a5-17e0-4562-b8f9-1f3d551b781c/server/0.log" Jul 01 18:34:44.173460 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:44.173376 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-x528k_3c31d423-b198-4cc0-8ec3-fe17ab456410/seaweedfs/0.log" Jul 01 18:34:46.076593 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:46.076564 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9vfjm/perf-node-gather-daemonset-56bt4" Jul 01 18:34:49.631745 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.631719 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhcjg_5b6bb22e-bafd-46fa-92e2-855947e4f9fe/kube-multus-additional-cni-plugins/0.log" Jul 01 18:34:49.652705 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.652681 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhcjg_5b6bb22e-bafd-46fa-92e2-855947e4f9fe/egress-router-binary-copy/0.log" Jul 01 18:34:49.672856 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.672828 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhcjg_5b6bb22e-bafd-46fa-92e2-855947e4f9fe/cni-plugins/0.log" Jul 01 18:34:49.693671 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.693641 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhcjg_5b6bb22e-bafd-46fa-92e2-855947e4f9fe/bond-cni-plugin/0.log" Jul 01 18:34:49.713799 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.713772 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhcjg_5b6bb22e-bafd-46fa-92e2-855947e4f9fe/routeoverride-cni/0.log" Jul 01 18:34:49.736809 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.736779 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhcjg_5b6bb22e-bafd-46fa-92e2-855947e4f9fe/whereabouts-cni-bincopy/0.log" Jul 01 18:34:49.758679 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.758653 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lhcjg_5b6bb22e-bafd-46fa-92e2-855947e4f9fe/whereabouts-cni/0.log" Jul 01 18:34:49.955557 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:49.955522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gj55x_258a0859-f254-49cc-adff-c015d01b1954/kube-multus/0.log" Jul 01 18:34:50.012079 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:50.012051 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-88zx4_007188c8-8039-4d6a-8dc6-e80b4698e864/network-metrics-daemon/0.log" Jul 01 18:34:50.035942 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:50.035916 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-88zx4_007188c8-8039-4d6a-8dc6-e80b4698e864/kube-rbac-proxy/0.log" Jul 01 18:34:51.022250 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.022218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-controller/0.log" Jul 01 18:34:51.040568 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.040533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/1.log" Jul 01 18:34:51.040754 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.040638 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovn-acl-logging/0.log" Jul 01 18:34:51.061539 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.061513 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/kube-rbac-proxy-node/0.log" Jul 01 18:34:51.081934 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.081909 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 18:34:51.098670 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.098644 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/northd/0.log" Jul 01 18:34:51.117889 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.117865 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/nbdb/0.log" Jul 01 18:34:51.138552 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.138515 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/sbdb/0.log" Jul 01 18:34:51.173867 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:51.173836 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-khzgt_0da551ab-27cc-48d2-a260-4c3606a43976/ovnkube-controller/0.log" Jul 01 18:34:52.461618 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:52.461579 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-scsm9_17ca6bb4-dc40-47ed-97df-abdc439fd0a3/network-check-target-container/0.log" Jul 01 18:34:53.489619 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:53.489588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4vxkh_a4ee8c01-8c60-4607-9feb-13224e0e1b41/iptables-alerter/0.log" Jul 01 18:34:54.179274 ip-10-0-139-128 kubenswrapper[2561]: I0701 18:34:54.179244 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8gqkk_32c1ea41-21e5-4d23-a152-f780441562d9/tuned/0.log"