Jun 03 09:43:01.311453 ip-10-0-129-86 systemd[1]: Starting Kubernetes Kubelet... Jun 03 09:43:01.784878 ip-10-0-129-86 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 09:43:01.784878 ip-10-0-129-86 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 09:43:01.784878 ip-10-0-129-86 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 09:43:01.784878 ip-10-0-129-86 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 09:43:01.784878 ip-10-0-129-86 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 09:43:01.786527 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.786390 2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 09:43:01.791984 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.791968 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:01.791984 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.791984 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.791988 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.791994 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.791997 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792000 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792003 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792006 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792009 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792012 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792014 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792017 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792020 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792023 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792027 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792030 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792033 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792035 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792038 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792041 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792044 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:01.792050 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792047 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792049 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792052 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792061 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792065 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792068 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792071 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792074 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792078 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792081 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792085 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792088 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792091 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792093 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792096 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792099 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792102 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792104 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792107 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:01.792543 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792110 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792112 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792115 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792118 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792120 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792123 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792125 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792128 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792131 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792133 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792136 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792139 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792142 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792157 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792160 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792163 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792167 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792170 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792172 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:01.793002 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792175 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792178 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792180 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792183 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792185 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792188 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792191 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792194 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792196 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792198 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792201 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792204 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792206 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792209 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792211 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792214 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792217 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792220 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792222 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792225 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:01.793514 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792227 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792230 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792232 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792235 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792237 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792240 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792243 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792624 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792629 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792632 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792635 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792638 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792641 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792643 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792646 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792648 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792651 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792654 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792656 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:01.793987 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792659 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792662 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792664 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792666 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792669 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792672 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792674 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792677 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792679 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792682 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792685 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792688 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792690 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792693 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792695 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792698 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792700 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792702 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792705 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:01.794462 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792708 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792711 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792714 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792718 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792720 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792723 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792725 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792728 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792730 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792733 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792735 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792738 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792741 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792744 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792746 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792748 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792751 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792754 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792756 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792758 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:01.795016 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792761 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792764 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792766 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792769 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792772 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792774 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792776 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792779 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792781 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792784 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792787 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792790 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792793 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792796 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792798 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792801 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792803 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792806 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792808 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:01.795519 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792811 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792815 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792818 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792821 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792825 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792828 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792830 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792833 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792835 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792838 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792840 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792843 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792845 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792848 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792850 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.792853 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792936 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792947 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792957 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792963 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792970 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 09:43:01.795997 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792976 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792981 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792986 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792990 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792994 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.792998 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793002 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793006 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793010 2558 flags.go:64] FLAG: --cgroup-root="" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793013 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793016 2558 flags.go:64] FLAG: --client-ca-file="" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793019 2558 flags.go:64] FLAG: --cloud-config="" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793022 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793025 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793030 2558 flags.go:64] FLAG: --cluster-domain="" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793033 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793036 2558 flags.go:64] FLAG: --config-dir="" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793038 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793042 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793046 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793049 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793052 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793055 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793058 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 03 09:43:01.796529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793062 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793065 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793068 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793071 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793076 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793079 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793084 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793087 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793090 2558 flags.go:64] FLAG: --enable-server="true" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793093 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793097 2558 flags.go:64] FLAG: --event-burst="100" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793101 2558 flags.go:64] FLAG: --event-qps="50" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793104 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793107 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793110 2558 flags.go:64] FLAG: --eviction-hard="" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793114 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793117 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793120 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793123 2558 flags.go:64] FLAG: --eviction-soft="" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793126 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793129 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793132 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793135 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793138 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793141 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 09:43:01.797104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793143 2558 flags.go:64] FLAG: --feature-gates="" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793159 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793162 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793165 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793169 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793172 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793175 2558 flags.go:64] FLAG: --help="false" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793178 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-129-86.ec2.internal" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793181 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793185 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793188 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793191 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793195 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793198 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793201 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793204 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793207 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793210 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793213 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793216 2558 flags.go:64] FLAG: --kube-reserved="" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793219 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793222 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793225 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793228 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 09:43:01.797727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793230 2558 flags.go:64] FLAG: --lock-file="" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793233 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793236 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793239 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793245 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793248 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793251 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793253 2558 flags.go:64] FLAG: --logging-format="text" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793256 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793260 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793262 2558 flags.go:64] FLAG: --manifest-url="" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793265 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793269 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793273 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793277 2558 flags.go:64] FLAG: --max-pods="110" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793280 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793283 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793286 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793289 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793292 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793296 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793299 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793307 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793310 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793313 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 09:43:01.798348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793316 2558 flags.go:64] FLAG: --pod-cidr="" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793319 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793326 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793328 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793332 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793335 2558 flags.go:64] FLAG: --port="10250" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793338 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793341 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08e860a340611d358" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793344 2558 flags.go:64] FLAG: --qos-reserved="" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793347 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793350 2558 flags.go:64] FLAG: --register-node="true" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793353 2558 flags.go:64] FLAG: --register-schedulable="true" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793356 2558 flags.go:64] FLAG: --register-with-taints="" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793359 2558 flags.go:64] FLAG: --registry-burst="10" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793362 2558 flags.go:64] FLAG: --registry-qps="5" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793365 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793368 2558 flags.go:64] FLAG: --reserved-memory="" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793372 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793383 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793386 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793389 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793393 2558 flags.go:64] FLAG: --runonce="false" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793398 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793403 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793408 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 03 09:43:01.798982 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793416 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793419 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793422 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793425 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793428 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793432 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793435 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793438 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793441 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793444 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793447 2558 flags.go:64] FLAG: --system-cgroups="" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793449 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793455 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793458 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793460 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793465 2558 flags.go:64] FLAG: --tls-min-version="" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793468 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793471 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793473 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793477 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793479 2558 flags.go:64] FLAG: --v="2" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793484 2558 flags.go:64] FLAG: --version="false" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793488 2558 flags.go:64] FLAG: --vmodule="" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793492 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.793495 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 09:43:01.799594 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793589 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793593 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793598 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793602 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793604 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793607 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793610 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793614 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793616 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793619 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793622 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793624 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793627 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793630 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793633 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793636 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793639 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793641 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793644 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793646 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:01.800193 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793649 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793652 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793654 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793657 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793660 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793662 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793665 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793668 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793671 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793673 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793676 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793678 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793681 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793683 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793686 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793688 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793691 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793693 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793696 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793699 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:01.800692 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793702 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793704 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793707 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793710 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793714 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793717 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793721 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793724 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793727 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793730 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793733 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793736 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793739 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793741 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793744 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793747 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793749 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793752 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793755 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:01.801198 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793758 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793760 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793763 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793766 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793770 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793773 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793775 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793778 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793780 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793783 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793785 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793788 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793791 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793794 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793797 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793800 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793802 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793805 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793807 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:01.801676 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793809 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793812 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793815 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793818 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793820 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793823 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793826 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.793829 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.794703 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.801679 2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.801694 2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801740 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801746 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801749 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801752 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801755 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:01.802170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801759 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801762 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801765 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801769 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801771 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801774 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801777 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801779 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801782 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801784 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801787 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801790 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801792 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801795 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801798 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801801 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801803 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801807 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801810 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801813 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:01.802591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801816 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801818 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801821 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801824 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801826 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801829 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801831 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801834 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801836 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801839 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801841 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801844 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801846 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801849 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801851 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801854 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801857 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801859 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801862 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801864 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:01.803080 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801867 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801869 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801873 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801877 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801880 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801882 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801885 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801888 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801890 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801893 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801897 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801899 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801902 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801905 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801907 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801910 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801912 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801915 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801917 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:01.803591 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801920 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801923 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801925 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801927 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801930 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801934 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801938 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801941 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801944 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801946 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801949 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801951 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801954 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801956 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801959 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801962 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801964 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801967 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801969 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:01.804055 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801972 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801975 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.801978 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.801982 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802086 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802092 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802095 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802098 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802100 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802103 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802106 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802108 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802111 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802113 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802116 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802118 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 09:43:01.804539 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802121 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802123 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802126 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802129 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802131 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802134 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802136 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802139 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802141 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802157 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802162 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802166 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802169 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802172 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802175 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802178 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802181 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802183 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802186 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802189 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 09:43:01.804937 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802191 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802196 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802200 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802203 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802206 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802209 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802212 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802214 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802217 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802219 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802222 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802224 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802227 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802229 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802232 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802235 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802237 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802240 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802242 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 09:43:01.805463 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802244 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802247 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802249 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802252 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802254 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802257 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802267 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802272 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802274 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802277 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802279 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802282 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802286 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802288 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802291 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802294 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802297 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802300 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802302 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 09:43:01.805925 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802305 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802307 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802310 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802312 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802315 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802317 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802320 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802322 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802325 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802327 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802330 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802332 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802335 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802337 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802339 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:01.802342 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 09:43:01.806399 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.802347 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 09:43:01.806838 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.802918 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 09:43:01.806838 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.806645 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 09:43:01.807828 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.807814 2558 server.go:1019] "Starting client certificate rotation" Jun 03 09:43:01.807933 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.807915 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 09:43:01.807966 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.807949 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 09:43:01.831459 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.831435 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 09:43:01.837129 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.837104 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 09:43:01.853920 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.853896 2558 log.go:25] "Validated CRI v1 runtime API" Jun 03 09:43:01.861196 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.861172 2558 log.go:25] "Validated CRI v1 image API" Jun 03 09:43:01.862383 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.862367 2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 09:43:01.865944 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.865916 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7eb1953d-bfab-445c-94d4-a66e66a5e646:/dev/nvme0n1p3 c158b910-bdb7-4793-ae26-78131a211eaa:/dev/nvme0n1p4] Jun 03 09:43:01.866001 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.865943 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 09:43:01.868567 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.868550 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 09:43:01.870287 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.870172 2558 manager.go:217] Machine: {Timestamp:2026-06-03 09:43:01.869669311 +0000 UTC m=+0.422020687 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106087 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26b53dd4625c9f20437d609a4eb596 SystemUUID:ec26b53d-d462-5c9f-2043-7d609a4eb596 BootID:4987198e-bd7b-41d2-81eb-f971eee63434 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:51:ab:51:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:51:ab:51:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:79:14:38:69:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 09:43:01.870682 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.870672 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 09:43:01.870805 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.870793 2558 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 09:43:01.874170 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.874136 2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 09:43:01.874331 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.874173 2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 09:43:01.874379 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.874341 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 09:43:01.874379 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.874351 2558 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 09:43:01.874379 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.874358 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 09:43:01.875226 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.875215 2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 09:43:01.876471 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.876459 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 09:43:01.876766 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.876757 2558 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 09:43:01.879370 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.879357 2558 kubelet.go:491] "Attempting to sync node with API server" Jun 03 09:43:01.879409 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.879374 2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 09:43:01.879409 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.879387 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 09:43:01.879466 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.879429 2558 kubelet.go:397] "Adding apiserver pod source" Jun 03 09:43:01.879466 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.879441 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 09:43:01.880638 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.880626 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 09:43:01.880676 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.880645 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 09:43:01.883692 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.883677 2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 09:43:01.887144 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.887119 2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 09:43:01.889099 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889081 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889102 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889109 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889115 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889124 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889130 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889135 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889141 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889168 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889176 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889185 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 09:43:01.889189 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.889191 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 09:43:01.890045 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.890031 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 09:43:01.890076 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.890047 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 09:43:01.893257 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.893242 2558 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 09:43:01.893334 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.893282 2558 server.go:1295] "Started kubelet" Jun 03 09:43:01.893391 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.893367 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 09:43:01.893435 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.893364 2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 09:43:01.893482 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.893442 2558 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 09:43:01.894053 ip-10-0-129-86 systemd[1]: Started Kubernetes Kubelet. Jun 03 09:43:01.894683 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.894512 2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 09:43:01.895126 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.895106 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 09:43:01.895220 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.895105 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 09:43:01.895272 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.895217 2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 09:43:01.895929 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.895917 2558 server.go:317] "Adding debug handlers to kubelet server" Jun 03 09:43:01.898653 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.898624 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 09:43:01.899398 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.899187 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 09:43:01.900239 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.898413 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-86.ec2.internal.18b588eda183353b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-86.ec2.internal,UID:ip-10-0-129-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-86.ec2.internal,},FirstTimestamp:2026-06-03 09:43:01.893256507 +0000 UTC m=+0.445607868,LastTimestamp:2026-06-03 09:43:01.893256507 +0000 UTC m=+0.445607868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-86.ec2.internal,}" Jun 03 09:43:01.900405 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.900376 2558 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 09:43:01.900405 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.900402 2558 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 09:43:01.900562 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.900519 2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 09:43:01.900612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.900598 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 03 09:43:01.900612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.900607 2558 reconciler.go:26] "Reconciler: start to sync state" Jun 03 09:43:01.900738 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.900722 2558 factory.go:55] Registering systemd factory Jun 03 09:43:01.900807 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.900741 2558 factory.go:223] Registration of the systemd container factory successfully Jun 03 09:43:01.901321 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.901298 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:01.901415 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.901324 2558 factory.go:153] Registering CRI-O factory Jun 03 09:43:01.901415 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.901339 2558 factory.go:223] Registration of the crio container factory successfully Jun 03 09:43:01.901511 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.901428 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 09:43:01.901511 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.901455 2558 factory.go:103] Registering Raw factory Jun 03 09:43:01.901511 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.901492 2558 manager.go:1196] Started watching for new ooms in manager Jun 03 09:43:01.901917 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.901901 2558 manager.go:319] Starting recovery of all containers Jun 03 09:43:01.903930 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.903905 2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 09:43:01.911622 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.911592 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 09:43:01.911924 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.911895 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 09:43:01.913487 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.913466 2558 manager.go:324] Recovery completed Jun 03 09:43:01.918585 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.918561 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvnwm" Jun 03 09:43:01.919164 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.919134 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:01.921442 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.921427 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:01.921489 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.921457 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:01.921489 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.921468 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:01.921962 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.921947 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 09:43:01.921962 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.921960 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 09:43:01.922070 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.921980 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 03 09:43:01.923737 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.923671 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-86.ec2.internal.18b588eda33150c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-86.ec2.internal,UID:ip-10-0-129-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-86.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-86.ec2.internal,},FirstTimestamp:2026-06-03 09:43:01.92144404 +0000 UTC m=+0.473795396,LastTimestamp:2026-06-03 09:43:01.92144404 +0000 UTC m=+0.473795396,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-86.ec2.internal,}" Jun 03 09:43:01.924224 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.924210 2558 policy_none.go:49] "None policy: Start" Jun 03 09:43:01.924224 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.924227 2558 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 09:43:01.924348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.924240 2558 state_mem.go:35] "Initializing new in-memory state store" Jun 03 09:43:01.928018 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.928001 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvnwm" Jun 03 09:43:01.957811 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.957795 2558 manager.go:341] "Starting Device Plugin manager" Jun 03 09:43:01.957907 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.957838 2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 09:43:01.957907 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.957849 2558 server.go:85] "Starting device plugin registration server" Jun 03 09:43:01.958111 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.958097 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 09:43:01.958221 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.958111 2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 09:43:01.958292 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.958230 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 09:43:01.958349 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.958329 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 09:43:01.958349 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:01.958338 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 09:43:01.958849 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.958825 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 09:43:01.958933 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:01.958857 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.011562 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.011524 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 09:43:02.012769 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.012754 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 09:43:02.012827 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.012776 2558 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 09:43:02.012827 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.012802 2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 09:43:02.012827 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.012814 2558 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 09:43:02.012976 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.012861 2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 09:43:02.017469 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.017451 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:02.058821 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.058741 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:02.059782 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.059767 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:02.059870 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.059798 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:02.059870 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.059810 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:02.059870 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.059833 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.070562 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.070540 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.070562 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.070564 2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-86.ec2.internal\": node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.096216 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.096183 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.113512 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.113477 2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal"] Jun 03 09:43:02.113653 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.113560 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:02.114642 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.114605 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:02.114642 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.114634 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:02.114761 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.114648 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:02.115887 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.115871 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:02.116013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.115997 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.116071 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.116040 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:02.117937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.117920 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:02.118020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.117937 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:02.118020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.117954 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:02.118020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.117958 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:02.118020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.117967 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:02.118020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.117972 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:02.119227 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.119211 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.119305 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.119240 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 09:43:02.119906 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.119886 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientMemory" Jun 03 09:43:02.119993 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.119909 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 09:43:02.119993 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.119921 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeHasSufficientPID" Jun 03 09:43:02.135743 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.135717 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-86.ec2.internal\" not found" node="ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.140193 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.140177 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-86.ec2.internal\" not found" node="ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.197026 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.196988 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.201302 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.201278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45422955502318a5047bb59bbc8eb301-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"45422955502318a5047bb59bbc8eb301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.201401 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.201313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45422955502318a5047bb59bbc8eb301-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"45422955502318a5047bb59bbc8eb301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.201401 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.201337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12c1570f7ab0a1ed0359aa488a0bf8bb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-86.ec2.internal\" (UID: \"12c1570f7ab0a1ed0359aa488a0bf8bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.297613 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.297580 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.301876 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.301861 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45422955502318a5047bb59bbc8eb301-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"45422955502318a5047bb59bbc8eb301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.301935 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.301892 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45422955502318a5047bb59bbc8eb301-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"45422955502318a5047bb59bbc8eb301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.301935 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.301911 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12c1570f7ab0a1ed0359aa488a0bf8bb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-86.ec2.internal\" (UID: \"12c1570f7ab0a1ed0359aa488a0bf8bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.302006 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.301942 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12c1570f7ab0a1ed0359aa488a0bf8bb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-86.ec2.internal\" (UID: \"12c1570f7ab0a1ed0359aa488a0bf8bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.302006 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.301970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45422955502318a5047bb59bbc8eb301-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"45422955502318a5047bb59bbc8eb301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.302006 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.301969 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45422955502318a5047bb59bbc8eb301-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal\" (UID: \"45422955502318a5047bb59bbc8eb301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.398332 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.398268 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.438308 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.438282 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.443844 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.443822 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.498695 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.498658 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.599255 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.599214 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.699801 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.699714 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.800253 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.800214 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-86.ec2.internal\" not found" Jun 03 09:43:02.807687 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.807660 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 09:43:02.807839 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.807824 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 09:43:02.876633 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.876602 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:02.880343 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.880325 2558 apiserver.go:52] "Watching apiserver" Jun 03 09:43:02.895686 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.895653 2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 09:43:02.895992 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.895969 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-n46bq","openshift-cluster-node-tuning-operator/tuned-jsfhl","openshift-image-registry/node-ca-cfh7n","openshift-multus/multus-additional-cni-plugins-sjwtz","openshift-network-operator/iptables-alerter-jccsk","openshift-ovn-kubernetes/ovnkube-node-m4bz9","kube-system/konnectivity-agent-nbjzb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6","openshift-dns/node-resolver-fxl8b","openshift-multus/multus-vkssk","openshift-multus/network-metrics-daemon-6d6zm"] Jun 03 09:43:02.897332 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.897313 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:02.897438 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.897416 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:02.900927 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.898675 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.900927 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.899436 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 09:43:02.900927 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.900087 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:02.900927 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.900695 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.901857 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.901838 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.903012 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.902992 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:02.904394 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904377 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:02.904664 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904635 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-cnibin\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.904775 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904678 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-os-release\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.904775 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-run\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.904775 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-host\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.904775 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.904987 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b63c2ca1-03a8-4462-9f80-83826a7fba19-tmp\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.904987 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-system-cni-dir\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.904987 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchpl\" (UniqueName: \"kubernetes.io/projected/7ec91163-9154-4ae3-8cee-4f3b26098114-kube-api-access-kchpl\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.904987 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysconfig\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.904987 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysctl-d\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.904989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-systemd\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-tuned\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905040 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b7q5\" (UniqueName: \"kubernetes.io/projected/b63c2ca1-03a8-4462-9f80-83826a7fba19-kube-api-access-4b7q5\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-host\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905096 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-serviceca\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905111 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-kubernetes\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.905218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-modprobe-d\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-sys\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-var-lib-kubelet\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkfnl\" (UniqueName: \"kubernetes.io/projected/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-kube-api-access-gkfnl\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905377 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-lib-modules\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysctl-conf\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:02.905608 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.905422 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:02.906698 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.906682 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:02.907761 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.907746 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:02.908362 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.908345 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 09:43:02.908513 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.908494 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 09:43:02.908929 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.908915 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vkssk" Jun 03 09:43:02.910107 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.910089 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:02.910200 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:02.910180 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:02.915732 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.915707 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 09:43:02.915826 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.915710 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pkb8x\"" Jun 03 09:43:02.915826 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.915757 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 09:43:02.915826 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.915761 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 09:43:02.915974 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.915922 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 09:43:02.916027 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916008 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 09:43:02.916078 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916062 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 09:43:02.916193 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916172 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 09:43:02.916289 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916204 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 09:43:02.916289 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916229 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 09:43:02.916289 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916237 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 09:43:02.916432 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916379 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 09:43:02.916486 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.916465 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 09:43:02.917730 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.917710 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ldtqx\"" Jun 03 09:43:02.917849 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.917831 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8vrj8\"" Jun 03 09:43:02.917849 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.917844 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 09:43:02.917968 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.917873 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 09:43:02.917968 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.917895 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 09:43:02.917968 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.917900 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918135 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918179 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918199 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918226 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918244 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918247 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x5k76\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918179 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918179 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918359 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 09:43:02.918434 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918371 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9x97t\"" Jun 03 09:43:02.918913 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918559 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wjgjr\"" Jun 03 09:43:02.918913 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918660 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tzhlt\"" Jun 03 09:43:02.918913 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918667 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9cx6g\"" Jun 03 09:43:02.918913 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.918705 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7kl5d\"" Jun 03 09:43:02.919509 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.919492 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 09:43:02.929700 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.929665 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 09:38:01 +0000 UTC" deadline="2027-10-31 11:59:01.007961821 +0000 UTC" Jun 03 09:43:02.929700 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.929694 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12362h15m58.078271965s" Jun 03 09:43:02.930046 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.930027 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal"] Jun 03 09:43:02.930784 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.930767 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 09:43:02.930859 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.930834 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" Jun 03 09:43:02.936212 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.936193 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 09:43:02.968048 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.968028 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 09:43:02.970171 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.968464 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal"] Jun 03 09:43:02.978311 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:02.978275 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45422955502318a5047bb59bbc8eb301.slice/crio-42f653103993750dd2d6e62ff210bd36b29497d7bc31ff19138cdb4960713af9 WatchSource:0}: Error finding container 42f653103993750dd2d6e62ff210bd36b29497d7bc31ff19138cdb4960713af9: Status 404 returned error can't find the container with id 42f653103993750dd2d6e62ff210bd36b29497d7bc31ff19138cdb4960713af9 Jun 03 09:43:02.982680 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:02.982656 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c1570f7ab0a1ed0359aa488a0bf8bb.slice/crio-3ba1bca7fa85767d98b798eda57f03d3b33f70d37a7259931d60ed0e6ae663a1 WatchSource:0}: Error finding container 3ba1bca7fa85767d98b798eda57f03d3b33f70d37a7259931d60ed0e6ae663a1: Status 404 returned error can't find the container with id 3ba1bca7fa85767d98b798eda57f03d3b33f70d37a7259931d60ed0e6ae663a1 Jun 03 09:43:02.983243 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:02.983190 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 09:43:03.002030 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.002012 2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 09:43:03.005687 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005669 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-env-overrides\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.005785 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005698 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-run\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.005785 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005716 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.005785 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005735 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrjp9\" (UniqueName: \"kubernetes.io/projected/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-kube-api-access-vrjp9\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.005785 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-os-release\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.005785 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005770 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-systemd\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.005785 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-etc-selinux\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005801 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kchpl\" (UniqueName: \"kubernetes.io/projected/7ec91163-9154-4ae3-8cee-4f3b26098114-kube-api-access-kchpl\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-run\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a76aef5d-d213-4de9-a607-90783cff0866-multus-daemon-config\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005862 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-ovn\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005964 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-systemd\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.005989 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-tuned\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006008 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b7q5\" (UniqueName: \"kubernetes.io/projected/b63c2ca1-03a8-4462-9f80-83826a7fba19-kube-api-access-4b7q5\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.006053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006042 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-host\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-systemd\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006117 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006126 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-host\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006188 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-kubelet\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006310 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-kubernetes\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98j9p\" (UniqueName: \"kubernetes.io/projected/0ae11697-e620-40a9-ae34-580e652f61b7-kube-api-access-98j9p\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006348 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-node-log\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-kubernetes\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-log-socket\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovnkube-script-lib\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006486 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:03.006506 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006512 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-modprobe-d\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ae11697-e620-40a9-ae34-580e652f61b7-hosts-file\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-var-lib-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006585 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-cni-bin\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovnkube-config\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006610 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-modprobe-d\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006636 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkfnl\" (UniqueName: \"kubernetes.io/projected/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-kube-api-access-gkfnl\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006660 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-cnibin\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-socket-dir-parent\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-etc-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-cni-bin\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006767 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006770 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1aa8ec22-da2a-4632-9f10-c2ab5690c805-agent-certs\") pod \"konnectivity-agent-nbjzb\" (UID: \"1aa8ec22-da2a-4632-9f10-c2ab5690c805\") " pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006815 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-cnibin\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-conf-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-cnibin\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.007013 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006870 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-host\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a76aef5d-d213-4de9-a607-90783cff0866-cni-binary-copy\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-device-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-sys-fs\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006947 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-host\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006974 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b63c2ca1-03a8-4462-9f80-83826a7fba19-tmp\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.006990 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-system-cni-dir\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-host-slash\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007024 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-cni-multus\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-systemd-units\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007057 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-system-cni-dir\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovn-node-metrics-cert\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007103 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysconfig\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007120 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysctl-d\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007135 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-serviceca\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007170 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-system-cni-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.007572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysconfig\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8ec22-da2a-4632-9f10-c2ab5690c805-konnectivity-ca\") pod \"konnectivity-agent-nbjzb\" (UID: \"1aa8ec22-da2a-4632-9f10-c2ab5690c805\") " pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-registration-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007249 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysctl-d\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hllkg\" (UniqueName: \"kubernetes.io/projected/27abf46b-2e55-4eab-ae20-a7feb144f14d-kube-api-access-hllkg\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae11697-e620-40a9-ae34-580e652f61b7-tmp-dir\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-k8s-cni-cncf-io\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-kubelet\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-slash\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007391 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-run-netns\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007475 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-sys\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007500 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-var-lib-kubelet\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007557 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-var-lib-kubelet\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-sys\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007576 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-serviceca\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:03.008135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007579 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007614 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-netns\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-multus-certs\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-cni-netd\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-socket-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007700 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-lib-modules\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007721 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysctl-conf\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-iptables-alerter-script\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-hostroot\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4skc\" (UniqueName: \"kubernetes.io/projected/8c8ab655-3307-4063-9f37-de4d81468c22-kube-api-access-d4skc\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-lib-modules\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gh4z\" (UniqueName: \"kubernetes.io/projected/78bfa0a1-e57b-458a-b820-2a6a47362c9b-kube-api-access-6gh4z\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007835 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-os-release\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-cni-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-etc-kubernetes\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-sysctl-conf\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.008612 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007906 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvzfn\" (UniqueName: \"kubernetes.io/projected/a76aef5d-d213-4de9-a607-90783cff0866-kube-api-access-mvzfn\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.009131 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.007925 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ec91163-9154-4ae3-8cee-4f3b26098114-os-release\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.009131 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.008037 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ec91163-9154-4ae3-8cee-4f3b26098114-cni-binary-copy\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.009131 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.008888 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b63c2ca1-03a8-4462-9f80-83826a7fba19-etc-tuned\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.009131 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.009086 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b63c2ca1-03a8-4462-9f80-83826a7fba19-tmp\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.015876 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.015834 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" event={"ID":"12c1570f7ab0a1ed0359aa488a0bf8bb","Type":"ContainerStarted","Data":"3ba1bca7fa85767d98b798eda57f03d3b33f70d37a7259931d60ed0e6ae663a1"} Jun 03 09:43:03.016688 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.016670 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" event={"ID":"45422955502318a5047bb59bbc8eb301","Type":"ContainerStarted","Data":"42f653103993750dd2d6e62ff210bd36b29497d7bc31ff19138cdb4960713af9"} Jun 03 09:43:03.030560 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.030539 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:03.030560 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.030561 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:03.030560 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.030571 2558 projected.go:194] Error preparing data for projected volume kube-api-access-xrv6p for pod openshift-network-diagnostics/network-check-target-n46bq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:03.030757 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.030658 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p podName:76c8a6bd-cc16-4b6a-8be9-6043f75e1430 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:03.530628017 +0000 UTC m=+2.082979374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xrv6p" (UniqueName: "kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p") pod "network-check-target-n46bq" (UID: "76c8a6bd-cc16-4b6a-8be9-6043f75e1430") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:03.032962 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.032940 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b7q5\" (UniqueName: \"kubernetes.io/projected/b63c2ca1-03a8-4462-9f80-83826a7fba19-kube-api-access-4b7q5\") pod \"tuned-jsfhl\" (UID: \"b63c2ca1-03a8-4462-9f80-83826a7fba19\") " pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.033542 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.033526 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchpl\" (UniqueName: \"kubernetes.io/projected/7ec91163-9154-4ae3-8cee-4f3b26098114-kube-api-access-kchpl\") pod \"multus-additional-cni-plugins-sjwtz\" (UID: \"7ec91163-9154-4ae3-8cee-4f3b26098114\") " pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.034398 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.034382 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9js98" Jun 03 09:43:03.038894 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.038878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkfnl\" (UniqueName: \"kubernetes.io/projected/e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb-kube-api-access-gkfnl\") pod \"node-ca-cfh7n\" (UID: \"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb\") " pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:03.056619 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.056590 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9js98" Jun 03 09:43:03.108295 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108263 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovn-node-metrics-cert\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.108295 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108299 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-system-cni-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108323 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8ec22-da2a-4632-9f10-c2ab5690c805-konnectivity-ca\") pod \"konnectivity-agent-nbjzb\" (UID: \"1aa8ec22-da2a-4632-9f10-c2ab5690c805\") " pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108346 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-registration-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108370 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hllkg\" (UniqueName: \"kubernetes.io/projected/27abf46b-2e55-4eab-ae20-a7feb144f14d-kube-api-access-hllkg\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108391 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae11697-e620-40a9-ae34-580e652f61b7-tmp-dir\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108403 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-system-cni-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108411 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-k8s-cni-cncf-io\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-k8s-cni-cncf-io\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108465 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-kubelet\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108491 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-slash\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108514 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-run-netns\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.108531 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-kubelet\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108538 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108565 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108576 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-slash\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-run-netns\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108593 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-netns\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108618 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-multus-certs\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108636 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-registration-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108644 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-cni-netd\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-kubelet-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-netns\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108674 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-run-multus-certs\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108719 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-socket-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108725 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ae11697-e620-40a9-ae34-580e652f61b7-tmp-dir\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-cni-netd\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109020 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108757 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-iptables-alerter-script\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108782 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-hostroot\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108805 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4skc\" (UniqueName: \"kubernetes.io/projected/8c8ab655-3307-4063-9f37-de4d81468c22-kube-api-access-d4skc\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108809 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-socket-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108743 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-run-ovn-kubernetes\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108832 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gh4z\" (UniqueName: \"kubernetes.io/projected/78bfa0a1-e57b-458a-b820-2a6a47362c9b-kube-api-access-6gh4z\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108856 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-cni-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108877 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-etc-kubernetes\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108900 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvzfn\" (UniqueName: \"kubernetes.io/projected/a76aef5d-d213-4de9-a607-90783cff0866-kube-api-access-mvzfn\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108856 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-hostroot\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1aa8ec22-da2a-4632-9f10-c2ab5690c805-konnectivity-ca\") pod \"konnectivity-agent-nbjzb\" (UID: \"1aa8ec22-da2a-4632-9f10-c2ab5690c805\") " pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-etc-kubernetes\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108939 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-env-overrides\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.108986 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjp9\" (UniqueName: \"kubernetes.io/projected/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-kube-api-access-vrjp9\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109047 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-os-release\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-cni-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109111 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-os-release\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109196 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-systemd\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.109667 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109257 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-etc-selinux\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-iptables-alerter-script\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109294 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a76aef5d-d213-4de9-a607-90783cff0866-multus-daemon-config\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109319 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-ovn\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109326 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-systemd\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109346 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109349 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-etc-selinux\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109365 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-env-overrides\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109376 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-ovn\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109389 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-kubelet\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109415 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98j9p\" (UniqueName: \"kubernetes.io/projected/0ae11697-e620-40a9-ae34-580e652f61b7-kube-api-access-98j9p\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.109421 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109439 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-node-log\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109463 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-log-socket\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.109480 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:03.609463329 +0000 UTC m=+2.161814695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109481 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-kubelet\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109497 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-node-log\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-log-socket\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109518 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovnkube-script-lib\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109562 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ae11697-e620-40a9-ae34-580e652f61b7-hosts-file\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109590 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-var-lib-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109655 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ae11697-e620-40a9-ae34-580e652f61b7-hosts-file\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109686 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-var-lib-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109693 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-cni-bin\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-host-cni-bin\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109729 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovnkube-config\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109776 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-cnibin\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109802 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-socket-dir-parent\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109826 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-etc-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-cnibin\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109852 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-cni-bin\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109868 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-etc-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109877 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1aa8ec22-da2a-4632-9f10-c2ab5690c805-agent-certs\") pod \"konnectivity-agent-nbjzb\" (UID: \"1aa8ec22-da2a-4632-9f10-c2ab5690c805\") " pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109904 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a76aef5d-d213-4de9-a607-90783cff0866-multus-daemon-config\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109908 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-socket-dir-parent\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.110937 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109941 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-cni-bin\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109966 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-conf-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.109990 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a76aef5d-d213-4de9-a607-90783cff0866-cni-binary-copy\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110015 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110018 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-multus-conf-dir\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110041 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-device-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovnkube-script-lib\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-run-openvswitch\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110068 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-sys-fs\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110095 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-host-slash\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110120 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-cni-multus\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-device-dir\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110107 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c8ab655-3307-4063-9f37-de4d81468c22-sys-fs\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a76aef5d-d213-4de9-a607-90783cff0866-host-var-lib-cni-multus\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110192 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-host-slash\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110161 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-systemd-units\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27abf46b-2e55-4eab-ae20-a7feb144f14d-systemd-units\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovnkube-config\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.111525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110611 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a76aef5d-d213-4de9-a607-90783cff0866-cni-binary-copy\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.112071 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.110835 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27abf46b-2e55-4eab-ae20-a7feb144f14d-ovn-node-metrics-cert\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.112071 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.111858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1aa8ec22-da2a-4632-9f10-c2ab5690c805-agent-certs\") pod \"konnectivity-agent-nbjzb\" (UID: \"1aa8ec22-da2a-4632-9f10-c2ab5690c805\") " pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:03.130501 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.130465 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvzfn\" (UniqueName: \"kubernetes.io/projected/a76aef5d-d213-4de9-a607-90783cff0866-kube-api-access-mvzfn\") pod \"multus-vkssk\" (UID: \"a76aef5d-d213-4de9-a607-90783cff0866\") " pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.130501 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.130489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gh4z\" (UniqueName: \"kubernetes.io/projected/78bfa0a1-e57b-458a-b820-2a6a47362c9b-kube-api-access-6gh4z\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:03.132044 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.132022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98j9p\" (UniqueName: \"kubernetes.io/projected/0ae11697-e620-40a9-ae34-580e652f61b7-kube-api-access-98j9p\") pod \"node-resolver-fxl8b\" (UID: \"0ae11697-e620-40a9-ae34-580e652f61b7\") " pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.135195 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.135177 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hllkg\" (UniqueName: \"kubernetes.io/projected/27abf46b-2e55-4eab-ae20-a7feb144f14d-kube-api-access-hllkg\") pod \"ovnkube-node-m4bz9\" (UID: \"27abf46b-2e55-4eab-ae20-a7feb144f14d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.144438 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.144415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjp9\" (UniqueName: \"kubernetes.io/projected/d40ca2ad-eba2-43af-bddc-d7bb07693a2c-kube-api-access-vrjp9\") pod \"iptables-alerter-jccsk\" (UID: \"d40ca2ad-eba2-43af-bddc-d7bb07693a2c\") " pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.144529 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.144456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4skc\" (UniqueName: \"kubernetes.io/projected/8c8ab655-3307-4063-9f37-de4d81468c22-kube-api-access-d4skc\") pod \"aws-ebs-csi-driver-node-snbc6\" (UID: \"8c8ab655-3307-4063-9f37-de4d81468c22\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.224419 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.224334 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" Jun 03 09:43:03.230447 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.230418 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63c2ca1_03a8_4462_9f80_83826a7fba19.slice/crio-48f139137c7a12967de34be06337422345507f9ee4ddf06e040918488e2e78c7 WatchSource:0}: Error finding container 48f139137c7a12967de34be06337422345507f9ee4ddf06e040918488e2e78c7: Status 404 returned error can't find the container with id 48f139137c7a12967de34be06337422345507f9ee4ddf06e040918488e2e78c7 Jun 03 09:43:03.231527 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.231507 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfh7n" Jun 03 09:43:03.237086 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.236928 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20d0ed3_a4e7_4e34_bc88_7edbf00e8afb.slice/crio-49adcb804b3722a0e9d81e577dd506177c83dfe9f99ff76f3942dd75b36fa579 WatchSource:0}: Error finding container 49adcb804b3722a0e9d81e577dd506177c83dfe9f99ff76f3942dd75b36fa579: Status 404 returned error can't find the container with id 49adcb804b3722a0e9d81e577dd506177c83dfe9f99ff76f3942dd75b36fa579 Jun 03 09:43:03.242992 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.242976 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" Jun 03 09:43:03.249244 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.249216 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec91163_9154_4ae3_8cee_4f3b26098114.slice/crio-e58a50428899988b8d5eeee19cbe19a96062364698eb334a0d0cd3f4caf7651b WatchSource:0}: Error finding container e58a50428899988b8d5eeee19cbe19a96062364698eb334a0d0cd3f4caf7651b: Status 404 returned error can't find the container with id e58a50428899988b8d5eeee19cbe19a96062364698eb334a0d0cd3f4caf7651b Jun 03 09:43:03.254355 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.254339 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jccsk" Jun 03 09:43:03.261434 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.261411 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40ca2ad_eba2_43af_bddc_d7bb07693a2c.slice/crio-feaca694399879665984a3396903c5cf604eeb3eff43e45e71397a03a010a01d WatchSource:0}: Error finding container feaca694399879665984a3396903c5cf604eeb3eff43e45e71397a03a010a01d: Status 404 returned error can't find the container with id feaca694399879665984a3396903c5cf604eeb3eff43e45e71397a03a010a01d Jun 03 09:43:03.276094 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.276077 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:03.281734 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.281710 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27abf46b_2e55_4eab_ae20_a7feb144f14d.slice/crio-3c11e64f8f987867046a1625decca7ee24a4dd2dea6277503b27456a4a2baf27 WatchSource:0}: Error finding container 3c11e64f8f987867046a1625decca7ee24a4dd2dea6277503b27456a4a2baf27: Status 404 returned error can't find the container with id 3c11e64f8f987867046a1625decca7ee24a4dd2dea6277503b27456a4a2baf27 Jun 03 09:43:03.286570 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.286555 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:03.291767 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.291747 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" Jun 03 09:43:03.291973 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.291953 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa8ec22_da2a_4632_9f10_c2ab5690c805.slice/crio-ed0542d2c3e5a57f6605a49d77cdbb47c85917ff0da476f6165aa28599ca462b WatchSource:0}: Error finding container ed0542d2c3e5a57f6605a49d77cdbb47c85917ff0da476f6165aa28599ca462b: Status 404 returned error can't find the container with id ed0542d2c3e5a57f6605a49d77cdbb47c85917ff0da476f6165aa28599ca462b Jun 03 09:43:03.297207 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.297187 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fxl8b" Jun 03 09:43:03.297497 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.297475 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8ab655_3307_4063_9f37_de4d81468c22.slice/crio-94222cd118a932e478648afbc132f216c0f29388aafa3a1b3832c36ebed8fd92 WatchSource:0}: Error finding container 94222cd118a932e478648afbc132f216c0f29388aafa3a1b3832c36ebed8fd92: Status 404 returned error can't find the container with id 94222cd118a932e478648afbc132f216c0f29388aafa3a1b3832c36ebed8fd92 Jun 03 09:43:03.302474 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.302453 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vkssk" Jun 03 09:43:03.302714 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.302687 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae11697_e620_40a9_ae34_580e652f61b7.slice/crio-37f9aebd76b6a9ea946d7672a0703d109b6022826a1af9ef627010447744e509 WatchSource:0}: Error finding container 37f9aebd76b6a9ea946d7672a0703d109b6022826a1af9ef627010447744e509: Status 404 returned error can't find the container with id 37f9aebd76b6a9ea946d7672a0703d109b6022826a1af9ef627010447744e509 Jun 03 09:43:03.308406 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:03.308384 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76aef5d_d213_4de9_a607_90783cff0866.slice/crio-a7351981fb9bc92ef89421bb4ea1786f90ad561745cbd08d370e2e70b22aa725 WatchSource:0}: Error finding container a7351981fb9bc92ef89421bb4ea1786f90ad561745cbd08d370e2e70b22aa725: Status 404 returned error can't find the container with id a7351981fb9bc92ef89421bb4ea1786f90ad561745cbd08d370e2e70b22aa725 Jun 03 09:43:03.324261 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.324234 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:03.342163 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.342127 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:03.615592 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.615560 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:03.615789 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.615634 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:03.615789 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.615701 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:03.615789 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.615740 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:03.615789 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.615753 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:03.615789 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.615760 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:04.615741383 +0000 UTC m=+3.168092742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:03.615789 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.615765 2558 projected.go:194] Error preparing data for projected volume kube-api-access-xrv6p for pod openshift-network-diagnostics/network-check-target-n46bq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:03.616090 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:03.615813 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p podName:76c8a6bd-cc16-4b6a-8be9-6043f75e1430 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:04.615787267 +0000 UTC m=+3.168138610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xrv6p" (UniqueName: "kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p") pod "network-check-target-n46bq" (UID: "76c8a6bd-cc16-4b6a-8be9-6043f75e1430") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:03.787488 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:03.787453 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 09:43:04.045222 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.044887 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fxl8b" event={"ID":"0ae11697-e620-40a9-ae34-580e652f61b7","Type":"ContainerStarted","Data":"37f9aebd76b6a9ea946d7672a0703d109b6022826a1af9ef627010447744e509"} Jun 03 09:43:04.058041 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.058002 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 09:38:03 +0000 UTC" deadline="2028-01-20 19:29:18.589773485 +0000 UTC" Jun 03 09:43:04.058041 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.058040 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14313h46m14.531738004s" Jun 03 09:43:04.066491 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.066458 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbjzb" event={"ID":"1aa8ec22-da2a-4632-9f10-c2ab5690c805","Type":"ContainerStarted","Data":"ed0542d2c3e5a57f6605a49d77cdbb47c85917ff0da476f6165aa28599ca462b"} Jun 03 09:43:04.086453 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.086417 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"3c11e64f8f987867046a1625decca7ee24a4dd2dea6277503b27456a4a2baf27"} Jun 03 09:43:04.097682 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.097643 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerStarted","Data":"e58a50428899988b8d5eeee19cbe19a96062364698eb334a0d0cd3f4caf7651b"} Jun 03 09:43:04.110255 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.110190 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfh7n" event={"ID":"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb","Type":"ContainerStarted","Data":"49adcb804b3722a0e9d81e577dd506177c83dfe9f99ff76f3942dd75b36fa579"} Jun 03 09:43:04.128306 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.128270 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" event={"ID":"b63c2ca1-03a8-4462-9f80-83826a7fba19","Type":"ContainerStarted","Data":"48f139137c7a12967de34be06337422345507f9ee4ddf06e040918488e2e78c7"} Jun 03 09:43:04.144249 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.144193 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vkssk" event={"ID":"a76aef5d-d213-4de9-a607-90783cff0866","Type":"ContainerStarted","Data":"a7351981fb9bc92ef89421bb4ea1786f90ad561745cbd08d370e2e70b22aa725"} Jun 03 09:43:04.166582 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.166519 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" event={"ID":"8c8ab655-3307-4063-9f37-de4d81468c22","Type":"ContainerStarted","Data":"94222cd118a932e478648afbc132f216c0f29388aafa3a1b3832c36ebed8fd92"} Jun 03 09:43:04.179942 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.179901 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jccsk" event={"ID":"d40ca2ad-eba2-43af-bddc-d7bb07693a2c","Type":"ContainerStarted","Data":"feaca694399879665984a3396903c5cf604eeb3eff43e45e71397a03a010a01d"} Jun 03 09:43:04.623965 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.623922 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:04.624165 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:04.623991 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:04.624293 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:04.624274 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:04.624357 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:04.624348 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:06.624328062 +0000 UTC m=+5.176679413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:04.624744 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:04.624724 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:04.624835 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:04.624757 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:04.624835 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:04.624780 2558 projected.go:194] Error preparing data for projected volume kube-api-access-xrv6p for pod openshift-network-diagnostics/network-check-target-n46bq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:04.624935 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:04.624836 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p podName:76c8a6bd-cc16-4b6a-8be9-6043f75e1430 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:06.624817237 +0000 UTC m=+5.177168624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xrv6p" (UniqueName: "kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p") pod "network-check-target-n46bq" (UID: "76c8a6bd-cc16-4b6a-8be9-6043f75e1430") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:05.013363 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:05.013244 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:05.013501 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:05.013396 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:05.013821 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:05.013803 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:05.013925 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:05.013901 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:05.058429 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:05.058387 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 09:38:03 +0000 UTC" deadline="2028-02-18 18:54:48.499199424 +0000 UTC" Jun 03 09:43:05.058429 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:05.058425 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15009h11m43.440777693s" Jun 03 09:43:06.643360 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:06.643306 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:06.643763 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:06.643373 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:06.643763 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:06.643562 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:06.643763 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:06.643582 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:06.643763 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:06.643595 2558 projected.go:194] Error preparing data for projected volume kube-api-access-xrv6p for pod openshift-network-diagnostics/network-check-target-n46bq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:06.643763 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:06.643654 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p podName:76c8a6bd-cc16-4b6a-8be9-6043f75e1430 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:10.643634826 +0000 UTC m=+9.195986181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xrv6p" (UniqueName: "kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p") pod "network-check-target-n46bq" (UID: "76c8a6bd-cc16-4b6a-8be9-6043f75e1430") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:06.643949 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:06.643784 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:06.643949 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:06.643860 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:10.643838562 +0000 UTC m=+9.196189905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:06.851907 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:06.851169 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xfmvr"] Jun 03 09:43:06.853436 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:06.852995 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:06.853436 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:06.853068 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:06.945957 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:06.945662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:06.945957 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:06.945719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bc2b457-33ce-4fb0-96fc-88999b7338ae-kubelet-config\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:06.945957 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:06.945774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bc2b457-33ce-4fb0-96fc-88999b7338ae-dbus\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:07.013609 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.013185 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:07.013609 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.013212 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:07.013609 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:07.013328 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:07.013609 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:07.013418 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:07.046138 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.046107 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:07.046329 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.046172 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bc2b457-33ce-4fb0-96fc-88999b7338ae-kubelet-config\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:07.046329 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.046241 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bc2b457-33ce-4fb0-96fc-88999b7338ae-dbus\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:07.046485 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.046465 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bc2b457-33ce-4fb0-96fc-88999b7338ae-dbus\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:07.046677 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:07.046595 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:07.046677 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:07.046656 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret podName:3bc2b457-33ce-4fb0-96fc-88999b7338ae nodeName:}" failed. No retries permitted until 2026-06-03 09:43:07.546636249 +0000 UTC m=+6.098987603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret") pod "global-pull-secret-syncer-xfmvr" (UID: "3bc2b457-33ce-4fb0-96fc-88999b7338ae") : object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:07.046922 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.046900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bc2b457-33ce-4fb0-96fc-88999b7338ae-kubelet-config\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:07.551341 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:07.551295 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:07.551519 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:07.551467 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:07.551576 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:07.551538 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret podName:3bc2b457-33ce-4fb0-96fc-88999b7338ae nodeName:}" failed. No retries permitted until 2026-06-03 09:43:08.551518776 +0000 UTC m=+7.103870139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret") pod "global-pull-secret-syncer-xfmvr" (UID: "3bc2b457-33ce-4fb0-96fc-88999b7338ae") : object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:08.013363 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:08.013328 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:08.013826 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:08.013460 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:08.559813 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:08.559649 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:08.559813 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:08.559792 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:08.560060 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:08.559861 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret podName:3bc2b457-33ce-4fb0-96fc-88999b7338ae nodeName:}" failed. No retries permitted until 2026-06-03 09:43:10.559842867 +0000 UTC m=+9.112194221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret") pod "global-pull-secret-syncer-xfmvr" (UID: "3bc2b457-33ce-4fb0-96fc-88999b7338ae") : object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:09.013400 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:09.013305 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:09.013810 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:09.013438 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:09.013810 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:09.013792 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:09.013932 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:09.013902 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:10.013963 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:10.013917 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:10.014488 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.014064 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:10.577435 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:10.577339 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:10.577608 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.577490 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:10.577608 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.577554 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret podName:3bc2b457-33ce-4fb0-96fc-88999b7338ae nodeName:}" failed. No retries permitted until 2026-06-03 09:43:14.577536217 +0000 UTC m=+13.129887582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret") pod "global-pull-secret-syncer-xfmvr" (UID: "3bc2b457-33ce-4fb0-96fc-88999b7338ae") : object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:10.678794 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:10.678533 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:10.678794 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:10.678629 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:10.678794 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.678736 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:10.678794 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.678752 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:10.678794 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.678777 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:10.678794 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.678790 2558 projected.go:194] Error preparing data for projected volume kube-api-access-xrv6p for pod openshift-network-diagnostics/network-check-target-n46bq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:10.679163 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.678791 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:18.678774224 +0000 UTC m=+17.231125572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:10.679163 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:10.678850 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p podName:76c8a6bd-cc16-4b6a-8be9-6043f75e1430 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:18.678835392 +0000 UTC m=+17.231186736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xrv6p" (UniqueName: "kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p") pod "network-check-target-n46bq" (UID: "76c8a6bd-cc16-4b6a-8be9-6043f75e1430") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:11.013469 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:11.013382 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:11.013632 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:11.013382 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:11.013632 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:11.013528 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:11.013786 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:11.013620 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:12.014212 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:12.014176 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:12.014637 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:12.014308 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:13.013062 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:13.013032 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:13.013244 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:13.013180 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:13.013244 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:13.013036 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:13.013319 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:13.013296 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:14.013536 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:14.013497 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:14.013897 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:14.013638 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:14.612368 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:14.612329 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:14.612558 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:14.612506 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:14.612625 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:14.612583 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret podName:3bc2b457-33ce-4fb0-96fc-88999b7338ae nodeName:}" failed. No retries permitted until 2026-06-03 09:43:22.612562843 +0000 UTC m=+21.164914202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret") pod "global-pull-secret-syncer-xfmvr" (UID: "3bc2b457-33ce-4fb0-96fc-88999b7338ae") : object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:15.013649 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:15.013567 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:15.014050 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:15.013698 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:15.014050 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:15.013772 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:15.014050 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:15.013909 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:16.013256 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:16.013216 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:16.013452 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:16.013334 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:17.013967 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:17.013931 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:17.014438 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:17.013931 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:17.014438 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:17.014062 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:17.014438 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:17.014140 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:18.014089 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:18.014052 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:18.014564 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:18.014189 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:18.740878 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:18.740839 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:18.741124 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:18.740924 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:18.741124 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:18.741023 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:18.741124 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:18.741029 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:18.741124 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:18.741054 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:18.741124 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:18.741068 2558 projected.go:194] Error preparing data for projected volume kube-api-access-xrv6p for pod openshift-network-diagnostics/network-check-target-n46bq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:18.741124 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:18.741088 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:34.741069499 +0000 UTC m=+33.293420854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:18.741124 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:18.741119 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p podName:76c8a6bd-cc16-4b6a-8be9-6043f75e1430 nodeName:}" failed. No retries permitted until 2026-06-03 09:43:34.741104797 +0000 UTC m=+33.293456157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xrv6p" (UniqueName: "kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p") pod "network-check-target-n46bq" (UID: "76c8a6bd-cc16-4b6a-8be9-6043f75e1430") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:19.014082 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:19.014005 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:19.014253 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:19.014012 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:19.014253 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:19.014108 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:19.014583 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:19.014255 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:20.013257 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:20.013231 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:20.013419 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:20.013343 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:21.013600 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:21.013559 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:21.013600 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:21.013592 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:21.014067 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:21.013710 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:21.014067 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:21.013794 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:22.014131 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:22.013968 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:22.014671 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:22.014129 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:22.670326 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:22.669619 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:22.670326 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:22.669776 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:22.670326 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:22.669952 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret podName:3bc2b457-33ce-4fb0-96fc-88999b7338ae nodeName:}" failed. No retries permitted until 2026-06-03 09:43:38.669930657 +0000 UTC m=+37.222282013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret") pod "global-pull-secret-syncer-xfmvr" (UID: "3bc2b457-33ce-4fb0-96fc-88999b7338ae") : object "kube-system"/"original-pull-secret" not registered Jun 03 09:43:23.014207 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.014010 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:23.014965 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.014035 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:23.014965 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:23.014327 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:23.014965 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:23.014344 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:23.216345 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.216312 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" event={"ID":"12c1570f7ab0a1ed0359aa488a0bf8bb","Type":"ContainerStarted","Data":"a9e421afe07969ee815f6a965a71608d67e967677d1a5dfe04f1d413bf4b969f"} Jun 03 09:43:23.218200 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.218159 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fxl8b" event={"ID":"0ae11697-e620-40a9-ae34-580e652f61b7","Type":"ContainerStarted","Data":"be921bd493ea838c21e35b6c2608f74ee7ef4172d8c4c742dbfeeb542abfc7b7"} Jun 03 09:43:23.219595 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.219569 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nbjzb" event={"ID":"1aa8ec22-da2a-4632-9f10-c2ab5690c805","Type":"ContainerStarted","Data":"c2cb96f5a968badc632397054118b6751d9d1f6195fa21b2eead9d0261e45a80"} Jun 03 09:43:23.222221 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/0.log" Jun 03 09:43:23.222564 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222543 2558 generic.go:358] "Generic (PLEG): container finished" podID="27abf46b-2e55-4eab-ae20-a7feb144f14d" containerID="c59fb3f3f51aa18941974cb34f468a5318843c5e0a097d35cc80d48dc34f4347" exitCode=1 Jun 03 09:43:23.222642 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222622 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"70078525b45129ed2cd44d8a43db2fee4060ca77ccf332e5789fa04921b5110d"} Jun 03 09:43:23.222691 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222651 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"91a1a351bcacaec72528b1271f11009a706fae96b678d941110467a66ad993d7"} Jun 03 09:43:23.222691 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222664 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"1932409c599196944e510554db61e04963ffa76f363868f79305093f7f2ebbdb"} Jun 03 09:43:23.222691 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222677 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"871c83d6466da4a665a98cc02e6df80d9bfed26934df571ef13a2a4ca345ee1e"} Jun 03 09:43:23.222691 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222690 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerDied","Data":"c59fb3f3f51aa18941974cb34f468a5318843c5e0a097d35cc80d48dc34f4347"} Jun 03 09:43:23.222862 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.222705 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"fc015394d0c79514fe38578049944065f40b1d3bd8162a857b041d80fe835967"} Jun 03 09:43:23.224046 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.224024 2558 generic.go:358] "Generic (PLEG): container finished" podID="7ec91163-9154-4ae3-8cee-4f3b26098114" containerID="69d73129d36247b184e82a5db7e6494924e21a0326141a94c653a4a5c00e1802" exitCode=0 Jun 03 09:43:23.224163 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.224085 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerDied","Data":"69d73129d36247b184e82a5db7e6494924e21a0326141a94c653a4a5c00e1802"} Jun 03 09:43:23.225571 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.225551 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfh7n" event={"ID":"e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb","Type":"ContainerStarted","Data":"aed6e7760431e727b517e638b24e8865b53e22bc16da209395945371ac41d814"} Jun 03 09:43:23.227113 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.227049 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" event={"ID":"b63c2ca1-03a8-4462-9f80-83826a7fba19","Type":"ContainerStarted","Data":"373e54785b67376e7047faecaacb478347a5e73f33b92d82202a41dc919f7855"} Jun 03 09:43:23.228642 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.228622 2558 generic.go:358] "Generic (PLEG): container finished" podID="45422955502318a5047bb59bbc8eb301" containerID="85b28d5afcef84a2086b4224a3b36d504db7f506a1fb5e917638f3c8741c9cb0" exitCode=0 Jun 03 09:43:23.228733 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.228684 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" event={"ID":"45422955502318a5047bb59bbc8eb301","Type":"ContainerDied","Data":"85b28d5afcef84a2086b4224a3b36d504db7f506a1fb5e917638f3c8741c9cb0"} Jun 03 09:43:23.230089 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.230070 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vkssk" event={"ID":"a76aef5d-d213-4de9-a607-90783cff0866","Type":"ContainerStarted","Data":"f73cea641363fc7192660a3248397c83b368e93bc8b63d730dc23768199ef442"} Jun 03 09:43:23.231494 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.231471 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" event={"ID":"8c8ab655-3307-4063-9f37-de4d81468c22","Type":"ContainerStarted","Data":"da5b974f186f95b5035fdbbd1e48ebf86bfc88355d36c6113c5ea89e947592d0"} Jun 03 09:43:23.236180 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.236089 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-86.ec2.internal" podStartSLOduration=21.236073537 podStartE2EDuration="21.236073537s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:43:23.235554891 +0000 UTC m=+21.787906250" watchObservedRunningTime="2026-06-03 09:43:23.236073537 +0000 UTC m=+21.788424903" Jun 03 09:43:23.276658 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.276594 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nbjzb" podStartSLOduration=7.115912511 podStartE2EDuration="21.276576462s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.294436781 +0000 UTC m=+1.846788124" lastFinishedPulling="2026-06-03 09:43:17.455100718 +0000 UTC m=+16.007452075" observedRunningTime="2026-06-03 09:43:23.258094457 +0000 UTC m=+21.810445838" watchObservedRunningTime="2026-06-03 09:43:23.276576462 +0000 UTC m=+21.828927828" Jun 03 09:43:23.276817 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.276785 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fxl8b" podStartSLOduration=2.480088196 podStartE2EDuration="21.276778761s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.305309716 +0000 UTC m=+1.857661059" lastFinishedPulling="2026-06-03 09:43:22.102000274 +0000 UTC m=+20.654351624" observedRunningTime="2026-06-03 09:43:23.276162867 +0000 UTC m=+21.828514227" watchObservedRunningTime="2026-06-03 09:43:23.276778761 +0000 UTC m=+21.829130130" Jun 03 09:43:23.299981 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.299934 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vkssk" podStartSLOduration=2.094420001 podStartE2EDuration="21.299920422s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.30987619 +0000 UTC m=+1.862227539" lastFinishedPulling="2026-06-03 09:43:22.515376615 +0000 UTC m=+21.067727960" observedRunningTime="2026-06-03 09:43:23.299625721 +0000 UTC m=+21.851977146" watchObservedRunningTime="2026-06-03 09:43:23.299920422 +0000 UTC m=+21.852271788" Jun 03 09:43:23.363240 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.363189 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jsfhl" podStartSLOduration=2.431934513 podStartE2EDuration="21.36317372s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.232800505 +0000 UTC m=+1.785151848" lastFinishedPulling="2026-06-03 09:43:22.164039706 +0000 UTC m=+20.716391055" observedRunningTime="2026-06-03 09:43:23.340015468 +0000 UTC m=+21.892366833" watchObservedRunningTime="2026-06-03 09:43:23.36317372 +0000 UTC m=+21.915525120" Jun 03 09:43:23.363384 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.363306 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cfh7n" podStartSLOduration=2.49954599 podStartE2EDuration="21.363299854s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.238298786 +0000 UTC m=+1.790650128" lastFinishedPulling="2026-06-03 09:43:22.102052643 +0000 UTC m=+20.654403992" observedRunningTime="2026-06-03 09:43:23.362957193 +0000 UTC m=+21.915308557" watchObservedRunningTime="2026-06-03 09:43:23.363299854 +0000 UTC m=+21.915651244" Jun 03 09:43:23.697813 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.697792 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 09:43:23.970658 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.970454 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T09:43:23.697808989Z","UUID":"3099dc65-929e-48f5-8426-0c425c9c1276","Handler":null,"Name":"","Endpoint":""} Jun 03 09:43:23.973062 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.973042 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 09:43:23.973193 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:23.973068 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 09:43:24.013464 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:24.013432 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:24.013611 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:24.013549 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:24.235668 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:24.235566 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" event={"ID":"45422955502318a5047bb59bbc8eb301","Type":"ContainerStarted","Data":"d9e45eda58a91bce9e028a80e2ffaf4e097523b389b1ddcdf453e1a94f8cd3c2"} Jun 03 09:43:24.237436 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:24.237412 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" event={"ID":"8c8ab655-3307-4063-9f37-de4d81468c22","Type":"ContainerStarted","Data":"cd27f7028194e211b895210bc171a1733b1820d319ca1f24103f735c358a1d43"} Jun 03 09:43:24.238886 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:24.238843 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jccsk" event={"ID":"d40ca2ad-eba2-43af-bddc-d7bb07693a2c","Type":"ContainerStarted","Data":"3685c6f0e8499b921a35d7e5f14bd4aa2ceea2929f25319fd3ad6437db96e5a3"} Jun 03 09:43:24.264167 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:24.264075 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-86.ec2.internal" podStartSLOduration=22.264057597 podStartE2EDuration="22.264057597s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:43:24.26382725 +0000 UTC m=+22.816178618" watchObservedRunningTime="2026-06-03 09:43:24.264057597 +0000 UTC m=+22.816408963" Jun 03 09:43:24.311218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:24.311166 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jccsk" podStartSLOduration=3.412259323 podStartE2EDuration="22.311128066s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.263505828 +0000 UTC m=+1.815857171" lastFinishedPulling="2026-06-03 09:43:22.162374558 +0000 UTC m=+20.714725914" observedRunningTime="2026-06-03 09:43:24.31063495 +0000 UTC m=+22.862986318" watchObservedRunningTime="2026-06-03 09:43:24.311128066 +0000 UTC m=+22.863479431" Jun 03 09:43:25.013219 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:25.013194 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:25.013344 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:25.013194 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:25.013404 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:25.013334 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:25.013460 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:25.013438 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:25.243484 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:25.243448 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/0.log" Jun 03 09:43:25.243925 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:25.243848 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"e88138e20632291242a6676f8573cc4c69aa1896bce117dc5a031cd45cbe66ca"} Jun 03 09:43:25.245760 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:25.245716 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" event={"ID":"8c8ab655-3307-4063-9f37-de4d81468c22","Type":"ContainerStarted","Data":"9d1a2e1ede927407ad83427abb028e8a664de5d58f23db37208ab89feefffdf4"} Jun 03 09:43:26.013422 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:26.013191 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:26.013581 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:26.013517 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:27.013603 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:27.013575 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:27.014016 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:27.013574 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:27.014016 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:27.013680 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:27.014016 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:27.013792 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:27.680361 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:27.680328 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:27.681079 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:27.681056 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:27.714497 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:27.714454 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-snbc6" podStartSLOduration=4.354256843 podStartE2EDuration="25.714441789s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.299942073 +0000 UTC m=+1.852293415" lastFinishedPulling="2026-06-03 09:43:24.660127002 +0000 UTC m=+23.212478361" observedRunningTime="2026-06-03 09:43:25.269300831 +0000 UTC m=+23.821652195" watchObservedRunningTime="2026-06-03 09:43:27.714441789 +0000 UTC m=+26.266793154" Jun 03 09:43:28.013908 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:28.013839 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:28.014504 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:28.013975 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:28.251551 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:28.251517 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:28.252093 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:28.252066 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nbjzb" Jun 03 09:43:29.013992 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.013849 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:29.014476 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.013849 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:29.014476 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:29.014071 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:29.014476 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:29.014166 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:29.255885 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.255810 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/0.log" Jun 03 09:43:29.256188 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.256142 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"652344d972c29d6c6f78ce418a449f877a757275429bfb03d82fb85074f4484c"} Jun 03 09:43:29.256517 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.256497 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:29.256660 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.256644 2558 scope.go:117] "RemoveContainer" containerID="c59fb3f3f51aa18941974cb34f468a5318843c5e0a097d35cc80d48dc34f4347" Jun 03 09:43:29.257943 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.257923 2558 generic.go:358] "Generic (PLEG): container finished" podID="7ec91163-9154-4ae3-8cee-4f3b26098114" containerID="390b89b3d005e78f565a613189fd6d3fc27cba3728b09b699ffc120eebb6bd0c" exitCode=0 Jun 03 09:43:29.258047 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.257997 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerDied","Data":"390b89b3d005e78f565a613189fd6d3fc27cba3728b09b699ffc120eebb6bd0c"} Jun 03 09:43:29.272467 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:29.272447 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:30.013781 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.013746 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:30.014050 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:30.013876 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:30.263525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.263499 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/0.log" Jun 03 09:43:30.263968 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.263916 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" event={"ID":"27abf46b-2e55-4eab-ae20-a7feb144f14d","Type":"ContainerStarted","Data":"35afa123fa883719d540ed5844411dd91194c9b36d98265df0fc60568b2d7f10"} Jun 03 09:43:30.264129 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.264111 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:30.264218 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.264139 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:30.280389 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.280366 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:43:30.302445 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.302351 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" podStartSLOduration=9.166587573 podStartE2EDuration="28.302335629s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.283190978 +0000 UTC m=+1.835542320" lastFinishedPulling="2026-06-03 09:43:22.418939018 +0000 UTC m=+20.971290376" observedRunningTime="2026-06-03 09:43:30.300583885 +0000 UTC m=+28.852935250" watchObservedRunningTime="2026-06-03 09:43:30.302335629 +0000 UTC m=+28.854686995" Jun 03 09:43:30.874142 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.874111 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfmvr"] Jun 03 09:43:30.874319 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.874253 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:30.874365 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:30.874332 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:30.877553 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.877531 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6d6zm"] Jun 03 09:43:30.877678 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.877634 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:30.877742 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:30.877708 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:30.878212 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.878191 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n46bq"] Jun 03 09:43:30.878319 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:30.878307 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:30.878414 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:30.878396 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:31.268184 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:31.268129 2558 generic.go:358] "Generic (PLEG): container finished" podID="7ec91163-9154-4ae3-8cee-4f3b26098114" containerID="3abc8c77d77787ae4fe3a493ae02fb0670d6c63a142c0c489bee9a4f625cbd4c" exitCode=0 Jun 03 09:43:31.268602 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:31.268215 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerDied","Data":"3abc8c77d77787ae4fe3a493ae02fb0670d6c63a142c0c489bee9a4f625cbd4c"} Jun 03 09:43:32.016525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:32.016388 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:32.016662 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:32.016592 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:32.271993 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:32.271907 2558 generic.go:358] "Generic (PLEG): container finished" podID="7ec91163-9154-4ae3-8cee-4f3b26098114" containerID="819c9a07c5c3a500b435a448e8da18bc0a4bf9eab1ea72cac4d8d2eb7616353d" exitCode=0 Jun 03 09:43:32.272417 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:32.271987 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerDied","Data":"819c9a07c5c3a500b435a448e8da18bc0a4bf9eab1ea72cac4d8d2eb7616353d"} Jun 03 09:43:33.013751 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:33.013673 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:33.013911 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:33.013680 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:33.013911 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:33.013803 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:33.013911 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:33.013903 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:34.013909 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:34.013878 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:34.014486 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:34.013998 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n46bq" podUID="76c8a6bd-cc16-4b6a-8be9-6043f75e1430" Jun 03 09:43:34.770536 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:34.770505 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:34.770727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:34.770554 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:34.770727 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:34.770664 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:34.770727 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:34.770699 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 09:43:34.770727 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:34.770715 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 09:43:34.770727 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:34.770727 2558 projected.go:194] Error preparing data for projected volume kube-api-access-xrv6p for pod openshift-network-diagnostics/network-check-target-n46bq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:34.770727 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:34.770731 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:44:06.770716653 +0000 UTC m=+65.323068000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 09:43:34.770952 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:34.770774 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p podName:76c8a6bd-cc16-4b6a-8be9-6043f75e1430 nodeName:}" failed. No retries permitted until 2026-06-03 09:44:06.770759103 +0000 UTC m=+65.323110486 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xrv6p" (UniqueName: "kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p") pod "network-check-target-n46bq" (UID: "76c8a6bd-cc16-4b6a-8be9-6043f75e1430") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 09:43:35.014063 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.014033 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:35.014614 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.014076 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:35.014614 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:35.014178 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:43:35.014614 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:35.014294 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfmvr" podUID="3bc2b457-33ce-4fb0-96fc-88999b7338ae" Jun 03 09:43:35.248053 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.247967 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-86.ec2.internal" event="NodeReady" Jun 03 09:43:35.248230 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.248124 2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 09:43:35.306832 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.306731 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qszcn"] Jun 03 09:43:35.326083 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.326042 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sg5vh"] Jun 03 09:43:35.326256 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.326093 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.329849 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.329580 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 09:43:35.329849 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.329625 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 09:43:35.329849 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.329797 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jmbp6\"" Jun 03 09:43:35.341956 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.341932 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qszcn"] Jun 03 09:43:35.341956 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.341961 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sg5vh"] Jun 03 09:43:35.342141 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.342061 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:35.345736 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.345714 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 09:43:35.345949 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.345927 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wwwqd\"" Jun 03 09:43:35.346567 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.346546 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 09:43:35.346653 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.346570 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 09:43:35.476164 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.476120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.476164 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.476167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-tmp-dir\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.476407 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.476258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwnf\" (UniqueName: \"kubernetes.io/projected/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-kube-api-access-dmwnf\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.476407 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.476295 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:35.476407 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.476371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6425\" (UniqueName: \"kubernetes.io/projected/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-kube-api-access-d6425\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:35.476536 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.476447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-config-volume\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.577409 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.577374 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6425\" (UniqueName: \"kubernetes.io/projected/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-kube-api-access-d6425\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:35.577589 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.577431 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-config-volume\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.577589 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.577476 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.577589 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.577495 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-tmp-dir\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.577753 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:35.577626 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:35.577753 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:35.577712 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:36.077689702 +0000 UTC m=+34.630041068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:43:35.577753 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.577733 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwnf\" (UniqueName: \"kubernetes.io/projected/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-kube-api-access-dmwnf\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.577915 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.577763 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:35.577915 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.577831 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-tmp-dir\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.577915 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:35.577855 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:35.577915 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:35.577893 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:43:36.077878322 +0000 UTC m=+34.630229679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:43:35.578128 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.578107 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-config-volume\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.592716 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.592690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwnf\" (UniqueName: \"kubernetes.io/projected/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-kube-api-access-dmwnf\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:35.592822 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:35.592759 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6425\" (UniqueName: \"kubernetes.io/projected/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-kube-api-access-d6425\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:36.013764 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:36.013675 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:43:36.019069 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:36.019046 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 09:43:36.019563 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:36.019327 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q22z7\"" Jun 03 09:43:36.019563 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:36.019377 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 09:43:36.081758 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:36.081720 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:36.081952 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:36.081785 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:36.081952 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:36.081881 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:36.081952 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:36.081911 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:36.082078 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:36.081961 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:43:37.081944399 +0000 UTC m=+35.634295742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:43:36.082078 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:36.081976 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:37.081969436 +0000 UTC m=+35.634320779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:43:37.013417 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:37.013386 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:37.013588 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:37.013386 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:43:37.017954 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:37.017932 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 09:43:37.019064 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:37.019044 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwzs9\"" Jun 03 09:43:37.019164 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:37.019079 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 09:43:37.090666 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:37.090636 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:37.090844 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:37.090729 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:37.090844 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:37.090804 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:37.090917 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:37.090852 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:37.090917 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:37.090871 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:43:39.090855219 +0000 UTC m=+37.643206565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:43:37.090917 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:37.090908 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:39.09089454 +0000 UTC m=+37.643245890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:43:38.287002 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:38.286975 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerStarted","Data":"07d9608e7ade446df95e5bfb3c51c14c7f86fcff3ec8519f06284b5c641c9501"} Jun 03 09:43:38.702311 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:38.702225 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:38.704567 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:38.704551 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc2b457-33ce-4fb0-96fc-88999b7338ae-original-pull-secret\") pod \"global-pull-secret-syncer-xfmvr\" (UID: \"3bc2b457-33ce-4fb0-96fc-88999b7338ae\") " pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:38.824186 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:38.824160 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfmvr" Jun 03 09:43:38.961375 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:38.961182 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfmvr"] Jun 03 09:43:38.965548 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:38.965519 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc2b457_33ce_4fb0_96fc_88999b7338ae.slice/crio-90cfa19867ddb309d03586c002b5b17290c156ab26d3973966d631f3d313f0a1 WatchSource:0}: Error finding container 90cfa19867ddb309d03586c002b5b17290c156ab26d3973966d631f3d313f0a1: Status 404 returned error can't find the container with id 90cfa19867ddb309d03586c002b5b17290c156ab26d3973966d631f3d313f0a1 Jun 03 09:43:39.105165 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:39.105119 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:39.105287 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:39.105270 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:39.105345 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:39.105323 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:43.105308653 +0000 UTC m=+41.657659995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:43:39.105345 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:39.105269 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:39.105454 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:39.105353 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:39.105454 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:39.105408 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:43:43.105393124 +0000 UTC m=+41.657744482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:43:39.289514 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:39.289444 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfmvr" event={"ID":"3bc2b457-33ce-4fb0-96fc-88999b7338ae","Type":"ContainerStarted","Data":"90cfa19867ddb309d03586c002b5b17290c156ab26d3973966d631f3d313f0a1"} Jun 03 09:43:39.291753 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:39.291729 2558 generic.go:358] "Generic (PLEG): container finished" podID="7ec91163-9154-4ae3-8cee-4f3b26098114" containerID="07d9608e7ade446df95e5bfb3c51c14c7f86fcff3ec8519f06284b5c641c9501" exitCode=0 Jun 03 09:43:39.291861 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:39.291772 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerDied","Data":"07d9608e7ade446df95e5bfb3c51c14c7f86fcff3ec8519f06284b5c641c9501"} Jun 03 09:43:40.296277 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:40.296241 2558 generic.go:358] "Generic (PLEG): container finished" podID="7ec91163-9154-4ae3-8cee-4f3b26098114" containerID="8ee8607004b40c1ef9480df1991b025aac8f56fb3f73209e4a541e57c71d4611" exitCode=0 Jun 03 09:43:40.296645 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:40.296292 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerDied","Data":"8ee8607004b40c1ef9480df1991b025aac8f56fb3f73209e4a541e57c71d4611"} Jun 03 09:43:41.301890 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:41.301853 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" event={"ID":"7ec91163-9154-4ae3-8cee-4f3b26098114","Type":"ContainerStarted","Data":"8ebfc0a075387c089bdf49cc5ccadb34a7c2748bfa5474f69be5725928fed856"} Jun 03 09:43:41.331629 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:41.331540 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sjwtz" podStartSLOduration=4.465430523 podStartE2EDuration="39.331524811s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:43:03.250989672 +0000 UTC m=+1.803341028" lastFinishedPulling="2026-06-03 09:43:38.11708397 +0000 UTC m=+36.669435316" observedRunningTime="2026-06-03 09:43:41.331298068 +0000 UTC m=+39.883649434" watchObservedRunningTime="2026-06-03 09:43:41.331524811 +0000 UTC m=+39.883876182" Jun 03 09:43:43.137225 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:43.137182 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:43.137581 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:43.137231 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:43.137581 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:43.137332 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:43.137581 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:43.137373 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:43:51.137360361 +0000 UTC m=+49.689711708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:43:43.137581 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:43.137332 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:43.137581 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:43.137464 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:43:51.137445791 +0000 UTC m=+49.689797144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:43:43.307017 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:43.306944 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfmvr" event={"ID":"3bc2b457-33ce-4fb0-96fc-88999b7338ae","Type":"ContainerStarted","Data":"e7292583acc3042b935a6a33658cfed46502d6e8df0662ca2907a34ee1947437"} Jun 03 09:43:43.324800 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:43.324756 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xfmvr" podStartSLOduration=33.377969306 podStartE2EDuration="37.324743226s" podCreationTimestamp="2026-06-03 09:43:06 +0000 UTC" firstStartedPulling="2026-06-03 09:43:38.967181918 +0000 UTC m=+37.519533262" lastFinishedPulling="2026-06-03 09:43:42.913955836 +0000 UTC m=+41.466307182" observedRunningTime="2026-06-03 09:43:43.32411174 +0000 UTC m=+41.876463105" watchObservedRunningTime="2026-06-03 09:43:43.324743226 +0000 UTC m=+41.877094622" Jun 03 09:43:51.188213 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:51.188176 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:43:51.188621 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:51.188230 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:43:51.188621 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:51.188325 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:43:51.188621 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:51.188366 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:43:51.188621 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:51.188394 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:44:07.188379635 +0000 UTC m=+65.740730978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:43:51.188621 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:43:51.188431 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:44:07.188418431 +0000 UTC m=+65.740769778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:43:53.178400 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.178363 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll"] Jun 03 09:43:53.200134 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.200109 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.201594 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.201570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgpmb\" (UniqueName: \"kubernetes.io/projected/99a52adc-44bc-4562-ad9b-870f33722159-kube-api-access-fgpmb\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.201685 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.201631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99a52adc-44bc-4562-ad9b-870f33722159-tmp\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.201727 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.201708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/99a52adc-44bc-4562-ad9b-870f33722159-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.211245 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.211229 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 09:43:53.212367 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.212352 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 09:43:53.212440 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.212420 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 09:43:53.222410 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.222396 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 09:43:53.264620 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.264596 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll"] Jun 03 09:43:53.265098 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.265081 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x"] Jun 03 09:43:53.276113 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.276094 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.280270 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.280254 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 09:43:53.280367 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.280274 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 09:43:53.280530 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.280514 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 09:43:53.280672 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.280652 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 09:43:53.285142 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.285120 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x"] Jun 03 09:43:53.302806 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.302787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-hub\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.302887 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.302839 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fgpmb\" (UniqueName: \"kubernetes.io/projected/99a52adc-44bc-4562-ad9b-870f33722159-kube-api-access-fgpmb\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.302887 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.302883 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99a52adc-44bc-4562-ad9b-870f33722159-tmp\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.302970 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.302900 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.302970 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.302917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.302970 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.302961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.303108 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.303001 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/99a52adc-44bc-4562-ad9b-870f33722159-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.303108 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.303027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-ca\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.303108 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.303052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qztzz\" (UniqueName: \"kubernetes.io/projected/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-kube-api-access-qztzz\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.303259 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.303193 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99a52adc-44bc-4562-ad9b-870f33722159-tmp\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.306939 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.306923 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/99a52adc-44bc-4562-ad9b-870f33722159-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.333084 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.333060 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgpmb\" (UniqueName: \"kubernetes.io/projected/99a52adc-44bc-4562-ad9b-870f33722159-kube-api-access-fgpmb\") pod \"klusterlet-addon-workmgr-5cfc944c8-lscll\" (UID: \"99a52adc-44bc-4562-ad9b-870f33722159\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.403441 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.403416 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.403538 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.403447 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.403538 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.403466 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.403680 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.403662 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-ca\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.403737 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.403702 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qztzz\" (UniqueName: \"kubernetes.io/projected/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-kube-api-access-qztzz\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.403795 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.403746 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-hub\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.404120 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.404092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.405746 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.405728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.405989 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.405968 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-hub\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.406130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.406116 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-ca\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.406211 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.406193 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.419341 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.419316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qztzz\" (UniqueName: \"kubernetes.io/projected/a11f10a7-e9d1-47c2-8142-e0a628e6ec04-kube-api-access-qztzz\") pod \"cluster-proxy-proxy-agent-6bc74f8b-9fd5x\" (UID: \"a11f10a7-e9d1-47c2-8142-e0a628e6ec04\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.509540 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.509463 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:53.596726 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.596641 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:43:53.637348 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.637319 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll"] Jun 03 09:43:53.642291 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:53.642265 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a52adc_44bc_4562_ad9b_870f33722159.slice/crio-35c29e3e8c98f0e579ce8a0295f63a2f050362208a99c217f879c0bb5ac3b15f WatchSource:0}: Error finding container 35c29e3e8c98f0e579ce8a0295f63a2f050362208a99c217f879c0bb5ac3b15f: Status 404 returned error can't find the container with id 35c29e3e8c98f0e579ce8a0295f63a2f050362208a99c217f879c0bb5ac3b15f Jun 03 09:43:53.726696 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:53.726669 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x"] Jun 03 09:43:53.729334 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:43:53.729309 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda11f10a7_e9d1_47c2_8142_e0a628e6ec04.slice/crio-7c10a8fa33cb841e45adf781dfc07653588f265b70c7c663fe64de3d65e55cb8 WatchSource:0}: Error finding container 7c10a8fa33cb841e45adf781dfc07653588f265b70c7c663fe64de3d65e55cb8: Status 404 returned error can't find the container with id 7c10a8fa33cb841e45adf781dfc07653588f265b70c7c663fe64de3d65e55cb8 Jun 03 09:43:54.328417 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:54.328388 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" event={"ID":"a11f10a7-e9d1-47c2-8142-e0a628e6ec04","Type":"ContainerStarted","Data":"7c10a8fa33cb841e45adf781dfc07653588f265b70c7c663fe64de3d65e55cb8"} Jun 03 09:43:54.329419 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:54.329393 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" event={"ID":"99a52adc-44bc-4562-ad9b-870f33722159","Type":"ContainerStarted","Data":"35c29e3e8c98f0e579ce8a0295f63a2f050362208a99c217f879c0bb5ac3b15f"} Jun 03 09:43:58.340402 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:58.340363 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" event={"ID":"a11f10a7-e9d1-47c2-8142-e0a628e6ec04","Type":"ContainerStarted","Data":"1fb8981592ba54fc31466975381b06ac56bec01edb56a35ccfc3e63237b33758"} Jun 03 09:43:59.343734 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:59.343692 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" event={"ID":"99a52adc-44bc-4562-ad9b-870f33722159","Type":"ContainerStarted","Data":"671d9ced079abb9526bf9a13579fda6147dd24d22c941fe67b495370eeb476cc"} Jun 03 09:43:59.344192 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:59.343909 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:59.345750 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:59.345728 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" Jun 03 09:43:59.387399 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:43:59.387344 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfc944c8-lscll" podStartSLOduration=1.270504951 podStartE2EDuration="6.387331402s" podCreationTimestamp="2026-06-03 09:43:53 +0000 UTC" firstStartedPulling="2026-06-03 09:43:53.644249854 +0000 UTC m=+52.196601216" lastFinishedPulling="2026-06-03 09:43:58.761076308 +0000 UTC m=+57.313427667" observedRunningTime="2026-06-03 09:43:59.383625521 +0000 UTC m=+57.935976886" watchObservedRunningTime="2026-06-03 09:43:59.387331402 +0000 UTC m=+57.939682766" Jun 03 09:44:01.349571 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:01.349535 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" event={"ID":"a11f10a7-e9d1-47c2-8142-e0a628e6ec04","Type":"ContainerStarted","Data":"69f12a5a9b0acce0cf8404b0bf203adef0fdd5ba8ac91d617e0bd1b91fa490a3"} Jun 03 09:44:01.349571 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:01.349571 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" event={"ID":"a11f10a7-e9d1-47c2-8142-e0a628e6ec04","Type":"ContainerStarted","Data":"88bebefa3a53ead70deaf5f202767e0e76a84b35b509de8408d006fcecc06da6"} Jun 03 09:44:01.389323 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:01.389269 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" podStartSLOduration=1.517597858 podStartE2EDuration="8.389255099s" podCreationTimestamp="2026-06-03 09:43:53 +0000 UTC" firstStartedPulling="2026-06-03 09:43:53.731078334 +0000 UTC m=+52.283429678" lastFinishedPulling="2026-06-03 09:44:00.602735566 +0000 UTC m=+59.155086919" observedRunningTime="2026-06-03 09:44:01.388930663 +0000 UTC m=+59.941282028" watchObservedRunningTime="2026-06-03 09:44:01.389255099 +0000 UTC m=+59.941606464" Jun 03 09:44:02.282848 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:02.282823 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m4bz9" Jun 03 09:44:06.790649 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.790606 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:44:06.791019 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.790706 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:44:06.794157 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.794129 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 09:44:06.794671 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.794656 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 09:44:06.801231 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:06.801213 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 09:44:06.801284 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:06.801270 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:45:10.801253945 +0000 UTC m=+129.353605287 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : secret "metrics-daemon-secret" not found Jun 03 09:44:06.803705 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.803677 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 09:44:06.814422 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.814405 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrv6p\" (UniqueName: \"kubernetes.io/projected/76c8a6bd-cc16-4b6a-8be9-6043f75e1430-kube-api-access-xrv6p\") pod \"network-check-target-n46bq\" (UID: \"76c8a6bd-cc16-4b6a-8be9-6043f75e1430\") " pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:44:06.927015 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.926982 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q22z7\"" Jun 03 09:44:06.934289 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:06.934255 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:44:07.058362 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:07.058298 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n46bq"] Jun 03 09:44:07.061690 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:44:07.061660 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c8a6bd_cc16_4b6a_8be9_6043f75e1430.slice/crio-5b9238b74ae5dc5ac520f83bf61d00ae81f89afeb64d0086f2e021ed45e29d54 WatchSource:0}: Error finding container 5b9238b74ae5dc5ac520f83bf61d00ae81f89afeb64d0086f2e021ed45e29d54: Status 404 returned error can't find the container with id 5b9238b74ae5dc5ac520f83bf61d00ae81f89afeb64d0086f2e021ed45e29d54 Jun 03 09:44:07.192855 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:07.192825 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:44:07.193001 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:07.192889 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:44:07.193001 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:07.192963 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:44:07.193001 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:07.192973 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:44:07.193104 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:07.193023 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:44:39.193008417 +0000 UTC m=+97.745359768 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:44:07.193104 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:07.193036 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:44:39.193030786 +0000 UTC m=+97.745382128 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:44:07.362359 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:07.362328 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n46bq" event={"ID":"76c8a6bd-cc16-4b6a-8be9-6043f75e1430","Type":"ContainerStarted","Data":"5b9238b74ae5dc5ac520f83bf61d00ae81f89afeb64d0086f2e021ed45e29d54"} Jun 03 09:44:11.371397 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:11.371357 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n46bq" event={"ID":"76c8a6bd-cc16-4b6a-8be9-6043f75e1430","Type":"ContainerStarted","Data":"e77b16e8f323c139b2599cafa094750d19488997af13eeb02b44a656d64cd49e"} Jun 03 09:44:11.371802 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:11.371480 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:44:11.391895 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:11.391851 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n46bq" podStartSLOduration=65.921285747 podStartE2EDuration="1m9.391838227s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:44:07.063639207 +0000 UTC m=+65.615990554" lastFinishedPulling="2026-06-03 09:44:10.534191676 +0000 UTC m=+69.086543034" observedRunningTime="2026-06-03 09:44:11.390611378 +0000 UTC m=+69.942962742" watchObservedRunningTime="2026-06-03 09:44:11.391838227 +0000 UTC m=+69.944189591" Jun 03 09:44:39.221416 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:39.221273 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:44:39.221416 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:39.221331 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:44:39.221416 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:39.221413 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 09:44:39.221416 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:39.221416 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 09:44:39.221984 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:39.221465 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert podName:fef4b465-8df2-431f-9e77-e6c86a1b8ffd nodeName:}" failed. No retries permitted until 2026-06-03 09:45:43.221451407 +0000 UTC m=+161.773802750 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert") pod "ingress-canary-sg5vh" (UID: "fef4b465-8df2-431f-9e77-e6c86a1b8ffd") : secret "canary-serving-cert" not found Jun 03 09:44:39.221984 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:44:39.221479 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls podName:7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b nodeName:}" failed. No retries permitted until 2026-06-03 09:45:43.221471768 +0000 UTC m=+161.773823110 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls") pod "dns-default-qszcn" (UID: "7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b") : secret "dns-default-metrics-tls" not found Jun 03 09:44:42.376176 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:44:42.376129 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n46bq" Jun 03 09:45:10.856322 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:10.856285 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:45:10.856791 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:10.856430 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 09:45:10.856791 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:10.856499 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs podName:78bfa0a1-e57b-458a-b820-2a6a47362c9b nodeName:}" failed. No retries permitted until 2026-06-03 09:47:12.85648482 +0000 UTC m=+251.408836167 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs") pod "network-metrics-daemon-6d6zm" (UID: "78bfa0a1-e57b-458a-b820-2a6a47362c9b") : secret "metrics-daemon-secret" not found Jun 03 09:45:22.350346 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:22.350308 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fxl8b_0ae11697-e620-40a9-ae34-580e652f61b7/dns-node-resolver/0.log" Jun 03 09:45:23.153773 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:23.153746 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfh7n_e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb/node-ca/0.log" Jun 03 09:45:38.339629 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:38.339587 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qszcn" podUID="7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b" Jun 03 09:45:38.367943 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:38.367908 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-sg5vh" podUID="fef4b465-8df2-431f-9e77-e6c86a1b8ffd" Jun 03 09:45:38.574520 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:38.574490 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qszcn" Jun 03 09:45:40.029663 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:40.029626 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6d6zm" podUID="78bfa0a1-e57b-458a-b820-2a6a47362c9b" Jun 03 09:45:43.284517 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.284462 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:45:43.284517 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.284531 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:45:43.286871 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.286836 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b-metrics-tls\") pod \"dns-default-qszcn\" (UID: \"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b\") " pod="openshift-dns/dns-default-qszcn" Jun 03 09:45:43.286871 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.286867 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fef4b465-8df2-431f-9e77-e6c86a1b8ffd-cert\") pod \"ingress-canary-sg5vh\" (UID: \"fef4b465-8df2-431f-9e77-e6c86a1b8ffd\") " pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:45:43.378248 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.378215 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jmbp6\"" Jun 03 09:45:43.385886 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.385866 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qszcn" Jun 03 09:45:43.504483 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.504440 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qszcn"] Jun 03 09:45:43.508364 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:45:43.508338 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aabd2e5_cca5_4ea2_97a6_b7a6758ad90b.slice/crio-7914884b839096634625851253626ad35b6a5ade298765ba093e268cfaadc11b WatchSource:0}: Error finding container 7914884b839096634625851253626ad35b6a5ade298765ba093e268cfaadc11b: Status 404 returned error can't find the container with id 7914884b839096634625851253626ad35b6a5ade298765ba093e268cfaadc11b Jun 03 09:45:43.586921 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:43.586890 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qszcn" event={"ID":"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b","Type":"ContainerStarted","Data":"7914884b839096634625851253626ad35b6a5ade298765ba093e268cfaadc11b"} Jun 03 09:45:45.593098 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:45.593061 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qszcn" event={"ID":"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b","Type":"ContainerStarted","Data":"ece8390b4a39fd277417c9b0e451bdf5657eecaea44ad92e9b2dfd063e3b40a4"} Jun 03 09:45:45.593098 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:45.593094 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qszcn" event={"ID":"7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b","Type":"ContainerStarted","Data":"13a48633442771b96e11c5b50015fcca520c0b4a8ca919ad5483483808d54d61"} Jun 03 09:45:45.593540 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:45.593187 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qszcn" Jun 03 09:45:45.611041 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:45.610996 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qszcn" podStartSLOduration=129.352834854 podStartE2EDuration="2m10.61098055s" podCreationTimestamp="2026-06-03 09:43:35 +0000 UTC" firstStartedPulling="2026-06-03 09:45:43.510192719 +0000 UTC m=+162.062544078" lastFinishedPulling="2026-06-03 09:45:44.768338422 +0000 UTC m=+163.320689774" observedRunningTime="2026-06-03 09:45:45.609425693 +0000 UTC m=+164.161777058" watchObservedRunningTime="2026-06-03 09:45:45.61098055 +0000 UTC m=+164.163331914" Jun 03 09:45:46.208938 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.208899 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9nx6l"] Jun 03 09:45:46.211895 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.211879 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.214840 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.214818 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 09:45:46.215909 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.215894 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 09:45:46.216183 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.216140 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 09:45:46.216292 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.216249 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4xt2x\"" Jun 03 09:45:46.216352 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.216315 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 09:45:46.222902 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.222876 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nx6l"] Jun 03 09:45:46.308262 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.308227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05f305d9-32ac-4bc1-b241-763f9fb556ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.308449 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.308277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05f305d9-32ac-4bc1-b241-763f9fb556ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.308449 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.308306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05f305d9-32ac-4bc1-b241-763f9fb556ef-crio-socket\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.308449 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.308346 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f305d9-32ac-4bc1-b241-763f9fb556ef-data-volume\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.308449 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.308392 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9s7h\" (UniqueName: \"kubernetes.io/projected/05f305d9-32ac-4bc1-b241-763f9fb556ef-kube-api-access-t9s7h\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.409487 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.409454 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05f305d9-32ac-4bc1-b241-763f9fb556ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.409487 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.409494 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05f305d9-32ac-4bc1-b241-763f9fb556ef-crio-socket\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.409709 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.409517 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f305d9-32ac-4bc1-b241-763f9fb556ef-data-volume\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.409709 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.409611 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05f305d9-32ac-4bc1-b241-763f9fb556ef-crio-socket\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.409709 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.409629 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9s7h\" (UniqueName: \"kubernetes.io/projected/05f305d9-32ac-4bc1-b241-763f9fb556ef-kube-api-access-t9s7h\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.409849 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.409723 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05f305d9-32ac-4bc1-b241-763f9fb556ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.410034 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.410015 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05f305d9-32ac-4bc1-b241-763f9fb556ef-data-volume\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.410236 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.410220 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05f305d9-32ac-4bc1-b241-763f9fb556ef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.412054 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.412024 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05f305d9-32ac-4bc1-b241-763f9fb556ef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.421623 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.421601 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9s7h\" (UniqueName: \"kubernetes.io/projected/05f305d9-32ac-4bc1-b241-763f9fb556ef-kube-api-access-t9s7h\") pod \"insights-runtime-extractor-9nx6l\" (UID: \"05f305d9-32ac-4bc1-b241-763f9fb556ef\") " pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.520437 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.520344 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9nx6l" Jun 03 09:45:46.643224 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:46.643194 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9nx6l"] Jun 03 09:45:46.646763 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:45:46.646730 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f305d9_32ac_4bc1_b241_763f9fb556ef.slice/crio-9c627b63f38b1b23fc00411f735542ea14f9e68de77e8bbc3acf21e87528f634 WatchSource:0}: Error finding container 9c627b63f38b1b23fc00411f735542ea14f9e68de77e8bbc3acf21e87528f634: Status 404 returned error can't find the container with id 9c627b63f38b1b23fc00411f735542ea14f9e68de77e8bbc3acf21e87528f634 Jun 03 09:45:47.601883 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:47.601852 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nx6l" event={"ID":"05f305d9-32ac-4bc1-b241-763f9fb556ef","Type":"ContainerStarted","Data":"43e99c810f860a478698b83a68eebd770df6281a7bfd3a4b4e88a0fd67549828"} Jun 03 09:45:47.601977 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:47.601894 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nx6l" event={"ID":"05f305d9-32ac-4bc1-b241-763f9fb556ef","Type":"ContainerStarted","Data":"9c627b63f38b1b23fc00411f735542ea14f9e68de77e8bbc3acf21e87528f634"} Jun 03 09:45:48.606261 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:48.606220 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nx6l" event={"ID":"05f305d9-32ac-4bc1-b241-763f9fb556ef","Type":"ContainerStarted","Data":"e344a971ad57d0d9bd1de78634fe1a2abd577c1077deeada4a450614b617b395"} Jun 03 09:45:49.609951 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:49.609917 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9nx6l" event={"ID":"05f305d9-32ac-4bc1-b241-763f9fb556ef","Type":"ContainerStarted","Data":"2889b66085b82a0a8611e567ceef864e57dd3f338623a222ba0743f59d359a59"} Jun 03 09:45:49.634090 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:49.634044 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9nx6l" podStartSLOduration=1.250319475 podStartE2EDuration="3.634027981s" podCreationTimestamp="2026-06-03 09:45:46 +0000 UTC" firstStartedPulling="2026-06-03 09:45:46.702006522 +0000 UTC m=+165.254357869" lastFinishedPulling="2026-06-03 09:45:49.085715014 +0000 UTC m=+167.638066375" observedRunningTime="2026-06-03 09:45:49.632878453 +0000 UTC m=+168.185229817" watchObservedRunningTime="2026-06-03 09:45:49.634027981 +0000 UTC m=+168.186379340" Jun 03 09:45:52.016610 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:52.016537 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:45:52.019807 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:52.019790 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wwwqd\"" Jun 03 09:45:52.028028 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:52.028003 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sg5vh" Jun 03 09:45:52.150479 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:52.150447 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sg5vh"] Jun 03 09:45:52.154104 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:45:52.154072 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef4b465_8df2_431f_9e77_e6c86a1b8ffd.slice/crio-307266986b0441acccc6bb88d544cb617dcb1813036063d6f561c84839fd9298 WatchSource:0}: Error finding container 307266986b0441acccc6bb88d544cb617dcb1813036063d6f561c84839fd9298: Status 404 returned error can't find the container with id 307266986b0441acccc6bb88d544cb617dcb1813036063d6f561c84839fd9298 Jun 03 09:45:52.618589 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:52.618546 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sg5vh" event={"ID":"fef4b465-8df2-431f-9e77-e6c86a1b8ffd","Type":"ContainerStarted","Data":"307266986b0441acccc6bb88d544cb617dcb1813036063d6f561c84839fd9298"} Jun 03 09:45:53.013382 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:53.013297 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:45:54.624638 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:54.624604 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sg5vh" event={"ID":"fef4b465-8df2-431f-9e77-e6c86a1b8ffd","Type":"ContainerStarted","Data":"f5eff676ebd5e0eda0237dfd55bd687af5a9a40f7f869c0b0bd7595c09f6091b"} Jun 03 09:45:54.642884 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:54.642830 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sg5vh" podStartSLOduration=138.078986657 podStartE2EDuration="2m19.642817354s" podCreationTimestamp="2026-06-03 09:43:35 +0000 UTC" firstStartedPulling="2026-06-03 09:45:52.15638555 +0000 UTC m=+170.708736896" lastFinishedPulling="2026-06-03 09:45:53.720216247 +0000 UTC m=+172.272567593" observedRunningTime="2026-06-03 09:45:54.641577636 +0000 UTC m=+173.193928998" watchObservedRunningTime="2026-06-03 09:45:54.642817354 +0000 UTC m=+173.195168762" Jun 03 09:45:55.598262 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:55.598227 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qszcn" Jun 03 09:45:58.699208 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.699175 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-fpprc"] Jun 03 09:45:58.701682 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.701666 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.705075 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.705055 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 09:45:58.705406 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.705382 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 09:45:58.706410 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.706392 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 09:45:58.706552 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.706435 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-67tts\"" Jun 03 09:45:58.706675 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.706661 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 09:45:58.706809 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.706784 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 09:45:58.715537 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.715518 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-fpprc"] Jun 03 09:45:58.777650 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.777617 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cbr9t"] Jun 03 09:45:58.780109 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.780090 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.782985 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.782968 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 09:45:58.783095 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.783047 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmskq\"" Jun 03 09:45:58.783248 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.783234 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 09:45:58.783368 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.783351 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 09:45:58.802402 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.802373 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.802548 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.802431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.802548 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.802510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.802631 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.802550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkwtl\" (UniqueName: \"kubernetes.io/projected/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-kube-api-access-bkwtl\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.902935 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.902898 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.903130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.902944 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2lb\" (UniqueName: \"kubernetes.io/projected/5d0d750b-64cf-4681-9d52-1476dc5f9514-kube-api-access-gr2lb\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.902966 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkwtl\" (UniqueName: \"kubernetes.io/projected/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-kube-api-access-bkwtl\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.903130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.902987 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-accelerators-collector-config\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903022 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-textfile\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903040 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-sys\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903130 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903084 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-wtmp\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903472 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903170 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.903472 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903205 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-tls\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903472 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0d750b-64cf-4681-9d52-1476dc5f9514-metrics-client-ca\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903472 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-root\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:58.903472 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903282 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.903472 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:58.903371 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 09:45:58.903472 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:58.903434 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-tls podName:3d3c1a2d-9d21-4e74-a191-9b192b94b6c3 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:59.403417705 +0000 UTC m=+177.955769055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-fpprc" (UID: "3d3c1a2d-9d21-4e74-a191-9b192b94b6c3") : secret "openshift-state-metrics-tls" not found Jun 03 09:45:58.903822 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.903801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.905297 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.905275 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:58.918426 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:58.918403 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkwtl\" (UniqueName: \"kubernetes.io/projected/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-kube-api-access-bkwtl\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:59.004435 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004355 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-textfile\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004435 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004392 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004435 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004412 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-sys\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004435 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004432 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-wtmp\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004480 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-tls\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004499 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0d750b-64cf-4681-9d52-1476dc5f9514-metrics-client-ca\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-sys\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004517 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-root\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004567 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-root\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004593 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2lb\" (UniqueName: \"kubernetes.io/projected/5d0d750b-64cf-4681-9d52-1476dc5f9514-kube-api-access-gr2lb\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:59.004612 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004659 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-accelerators-collector-config\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004688 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-wtmp\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.004715 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:45:59.004699 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-tls podName:5d0d750b-64cf-4681-9d52-1476dc5f9514 nodeName:}" failed. No retries permitted until 2026-06-03 09:45:59.504677464 +0000 UTC m=+178.057028827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-tls") pod "node-exporter-cbr9t" (UID: "5d0d750b-64cf-4681-9d52-1476dc5f9514") : secret "node-exporter-tls" not found Jun 03 09:45:59.005214 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.004722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-textfile\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.005214 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.005089 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d0d750b-64cf-4681-9d52-1476dc5f9514-metrics-client-ca\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.005307 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.005234 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-accelerators-collector-config\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.006654 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.006634 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.016041 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.016011 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2lb\" (UniqueName: \"kubernetes.io/projected/5d0d750b-64cf-4681-9d52-1476dc5f9514-kube-api-access-gr2lb\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.407440 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.407402 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:59.409681 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.409662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d3c1a2d-9d21-4e74-a191-9b192b94b6c3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-fpprc\" (UID: \"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:59.507942 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.507891 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-tls\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.510225 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.510201 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d0d750b-64cf-4681-9d52-1476dc5f9514-node-exporter-tls\") pod \"node-exporter-cbr9t\" (UID: \"5d0d750b-64cf-4681-9d52-1476dc5f9514\") " pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.610484 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.610438 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" Jun 03 09:45:59.688437 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.688094 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cbr9t" Jun 03 09:45:59.696602 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:45:59.696576 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0d750b_64cf_4681_9d52_1476dc5f9514.slice/crio-c3e2958328caf5dc49b7fbd9268b48cfe50fd47ab87c264de74bac553cbd89dc WatchSource:0}: Error finding container c3e2958328caf5dc49b7fbd9268b48cfe50fd47ab87c264de74bac553cbd89dc: Status 404 returned error can't find the container with id c3e2958328caf5dc49b7fbd9268b48cfe50fd47ab87c264de74bac553cbd89dc Jun 03 09:45:59.743169 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:45:59.743126 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-fpprc"] Jun 03 09:45:59.746555 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:45:59.746518 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d3c1a2d_9d21_4e74_a191_9b192b94b6c3.slice/crio-265b141ec192a48bc07fc4db96a63eac193f60e6ff5856973d0d88117edb91aa WatchSource:0}: Error finding container 265b141ec192a48bc07fc4db96a63eac193f60e6ff5856973d0d88117edb91aa: Status 404 returned error can't find the container with id 265b141ec192a48bc07fc4db96a63eac193f60e6ff5856973d0d88117edb91aa Jun 03 09:46:00.642580 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:00.642542 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" event={"ID":"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3","Type":"ContainerStarted","Data":"04759383d4ec064a3789813628875bae2bcd176f7685f25b5fcb62d6e995898d"} Jun 03 09:46:00.642769 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:00.642589 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" event={"ID":"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3","Type":"ContainerStarted","Data":"b17329d351e0ceda8bead49cc86424d3117936ecbcb6d44fbfd7fe08aa06de4c"} Jun 03 09:46:00.642769 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:00.642603 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" event={"ID":"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3","Type":"ContainerStarted","Data":"265b141ec192a48bc07fc4db96a63eac193f60e6ff5856973d0d88117edb91aa"} Jun 03 09:46:00.643788 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:00.643757 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbr9t" event={"ID":"5d0d750b-64cf-4681-9d52-1476dc5f9514","Type":"ContainerStarted","Data":"c3e2958328caf5dc49b7fbd9268b48cfe50fd47ab87c264de74bac553cbd89dc"} Jun 03 09:46:01.648585 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.648551 2558 generic.go:358] "Generic (PLEG): container finished" podID="5d0d750b-64cf-4681-9d52-1476dc5f9514" containerID="041731bbaac9481c646b74b253a57400b26933c456cdb91fa4dbef9fafc1fc46" exitCode=0 Jun 03 09:46:01.649072 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.648585 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbr9t" event={"ID":"5d0d750b-64cf-4681-9d52-1476dc5f9514","Type":"ContainerDied","Data":"041731bbaac9481c646b74b253a57400b26933c456cdb91fa4dbef9fafc1fc46"} Jun 03 09:46:01.650728 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.650703 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" event={"ID":"3d3c1a2d-9d21-4e74-a191-9b192b94b6c3","Type":"ContainerStarted","Data":"911365d439969ebc2642c7b78a6a8b48fc9b125e1591a307c5df916548a7f40c"} Jun 03 09:46:01.689672 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.689626 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-fpprc" podStartSLOduration=2.554064207 podStartE2EDuration="3.689611471s" podCreationTimestamp="2026-06-03 09:45:58 +0000 UTC" firstStartedPulling="2026-06-03 09:45:59.862107485 +0000 UTC m=+178.414458829" lastFinishedPulling="2026-06-03 09:46:00.99765475 +0000 UTC m=+179.550006093" observedRunningTime="2026-06-03 09:46:01.68900974 +0000 UTC m=+180.241361135" watchObservedRunningTime="2026-06-03 09:46:01.689611471 +0000 UTC m=+180.241962836" Jun 03 09:46:01.796671 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.796643 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6588f466-pdsgt"] Jun 03 09:46:01.799894 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.799872 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.802673 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.802648 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 09:46:01.802673 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.802664 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 09:46:01.802850 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.802694 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 09:46:01.802850 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.802773 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cn8lrj49u47b8\"" Jun 03 09:46:01.802988 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.802973 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 09:46:01.803271 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.803159 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 09:46:01.803271 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.803262 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l2f8k\"" Jun 03 09:46:01.812304 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.812272 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6588f466-pdsgt"] Jun 03 09:46:01.925824 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.925750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjw55\" (UniqueName: \"kubernetes.io/projected/446904de-4e60-4589-a6ff-f114e75ca628-kube-api-access-qjw55\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.925824 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.925786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.926027 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.925878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.926027 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.925911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.926027 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.925957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-tls\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.926027 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.926001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.926267 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.926083 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-grpc-tls\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:01.926267 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:01.926137 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/446904de-4e60-4589-a6ff-f114e75ca628-metrics-client-ca\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026544 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026512 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/446904de-4e60-4589-a6ff-f114e75ca628-metrics-client-ca\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026544 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026549 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjw55\" (UniqueName: \"kubernetes.io/projected/446904de-4e60-4589-a6ff-f114e75ca628-kube-api-access-qjw55\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026577 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026612 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026646 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026686 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-tls\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026709 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.026778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.026756 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-grpc-tls\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.027372 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.027353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/446904de-4e60-4589-a6ff-f114e75ca628-metrics-client-ca\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.029450 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.029430 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 09:46:02.029565 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.029485 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 09:46:02.029565 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.029548 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 09:46:02.029705 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.029686 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cn8lrj49u47b8\"" Jun 03 09:46:02.029800 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.029786 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 09:46:02.029892 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.029877 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 09:46:02.039484 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.039457 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.039777 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.039753 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.039859 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.039780 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.039938 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.039913 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-tls\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.039994 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.039978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.040045 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.040027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjw55\" (UniqueName: \"kubernetes.io/projected/446904de-4e60-4589-a6ff-f114e75ca628-kube-api-access-qjw55\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.040102 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.040045 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/446904de-4e60-4589-a6ff-f114e75ca628-secret-grpc-tls\") pod \"thanos-querier-6588f466-pdsgt\" (UID: \"446904de-4e60-4589-a6ff-f114e75ca628\") " pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.112077 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.112045 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l2f8k\"" Jun 03 09:46:02.120401 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.120379 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:02.249888 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.249851 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6588f466-pdsgt"] Jun 03 09:46:02.254019 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:46:02.253990 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446904de_4e60_4589_a6ff_f114e75ca628.slice/crio-0d8648250ea8f970df87f39d70264c3264de994afb9d94157b938f6579f3d115 WatchSource:0}: Error finding container 0d8648250ea8f970df87f39d70264c3264de994afb9d94157b938f6579f3d115: Status 404 returned error can't find the container with id 0d8648250ea8f970df87f39d70264c3264de994afb9d94157b938f6579f3d115 Jun 03 09:46:02.654890 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.654854 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" event={"ID":"446904de-4e60-4589-a6ff-f114e75ca628","Type":"ContainerStarted","Data":"0d8648250ea8f970df87f39d70264c3264de994afb9d94157b938f6579f3d115"} Jun 03 09:46:02.656703 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.656677 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbr9t" event={"ID":"5d0d750b-64cf-4681-9d52-1476dc5f9514","Type":"ContainerStarted","Data":"cfc29d9c63b0bfba5a44178e45cec29ad9cf0bfe777bf59ff54e58f70dda29b9"} Jun 03 09:46:02.656813 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.656710 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cbr9t" event={"ID":"5d0d750b-64cf-4681-9d52-1476dc5f9514","Type":"ContainerStarted","Data":"d35a74c49bee3225f0bc31aececd16dd2f377a1fb11ac8e663d9be11c15e9aac"} Jun 03 09:46:02.677774 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:02.677718 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cbr9t" podStartSLOduration=3.671849594 podStartE2EDuration="4.677700721s" podCreationTimestamp="2026-06-03 09:45:58 +0000 UTC" firstStartedPulling="2026-06-03 09:45:59.698288047 +0000 UTC m=+178.250639390" lastFinishedPulling="2026-06-03 09:46:00.70413916 +0000 UTC m=+179.256490517" observedRunningTime="2026-06-03 09:46:02.677349973 +0000 UTC m=+181.229701373" watchObservedRunningTime="2026-06-03 09:46:02.677700721 +0000 UTC m=+181.230052087" Jun 03 09:46:04.667534 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:04.667439 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" event={"ID":"446904de-4e60-4589-a6ff-f114e75ca628","Type":"ContainerStarted","Data":"ea7d730a7dae1c00c4f895efde43f05abc10b4c51824785d140f8d1839dd813d"} Jun 03 09:46:04.667534 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:04.667478 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" event={"ID":"446904de-4e60-4589-a6ff-f114e75ca628","Type":"ContainerStarted","Data":"0269af5775454c766aaed5e814a885244e58ad9e2c314dfdd61172b869c71f4f"} Jun 03 09:46:04.667534 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:04.667491 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" event={"ID":"446904de-4e60-4589-a6ff-f114e75ca628","Type":"ContainerStarted","Data":"ca11e0e26dd288fdc865da636f5197faa22981165e6503d7bb3013c522c0455e"} Jun 03 09:46:05.671945 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:05.671907 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" event={"ID":"446904de-4e60-4589-a6ff-f114e75ca628","Type":"ContainerStarted","Data":"89cf22d8e54cc78fc5b625d56252f2b3c7fdbd3a7d96c59e1c07b1c02972d02a"} Jun 03 09:46:05.672324 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:05.671951 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" event={"ID":"446904de-4e60-4589-a6ff-f114e75ca628","Type":"ContainerStarted","Data":"c366e28c3a6695ba023aef165103a37bca399360e5afc4b48af04468b5a8f1ba"} Jun 03 09:46:05.672324 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:05.671965 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" event={"ID":"446904de-4e60-4589-a6ff-f114e75ca628","Type":"ContainerStarted","Data":"68671893ac1ff2ab16fd6bf5209f01e54f5de8c38661081ce1e8b0c2df48d6d5"} Jun 03 09:46:05.672324 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:05.672080 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:05.704091 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:05.704040 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" podStartSLOduration=1.848826914 podStartE2EDuration="4.704026477s" podCreationTimestamp="2026-06-03 09:46:01 +0000 UTC" firstStartedPulling="2026-06-03 09:46:02.255798863 +0000 UTC m=+180.808150206" lastFinishedPulling="2026-06-03 09:46:05.110998427 +0000 UTC m=+183.663349769" observedRunningTime="2026-06-03 09:46:05.702128838 +0000 UTC m=+184.254480228" watchObservedRunningTime="2026-06-03 09:46:05.704026477 +0000 UTC m=+184.256377843" Jun 03 09:46:11.681274 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:11.681243 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6588f466-pdsgt" Jun 03 09:46:13.597721 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.597677 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" podUID="a11f10a7-e9d1-47c2-8142-e0a628e6ec04" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 09:46:13.772571 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.772536 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-565tm"] Jun 03 09:46:13.776636 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.776620 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-565tm" Jun 03 09:46:13.779291 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.779270 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5pf2f\"" Jun 03 09:46:13.779483 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.779306 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 09:46:13.779483 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.779435 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 09:46:13.784224 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.784206 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-565tm"] Jun 03 09:46:13.925770 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:13.925650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw25p\" (UniqueName: \"kubernetes.io/projected/cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9-kube-api-access-vw25p\") pod \"downloads-c65b8dc4b-565tm\" (UID: \"cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9\") " pod="openshift-console/downloads-c65b8dc4b-565tm" Jun 03 09:46:14.026487 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:14.026450 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vw25p\" (UniqueName: \"kubernetes.io/projected/cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9-kube-api-access-vw25p\") pod \"downloads-c65b8dc4b-565tm\" (UID: \"cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9\") " pod="openshift-console/downloads-c65b8dc4b-565tm" Jun 03 09:46:14.040814 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:14.040785 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw25p\" (UniqueName: \"kubernetes.io/projected/cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9-kube-api-access-vw25p\") pod \"downloads-c65b8dc4b-565tm\" (UID: \"cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9\") " pod="openshift-console/downloads-c65b8dc4b-565tm" Jun 03 09:46:14.086896 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:14.086866 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-565tm" Jun 03 09:46:14.210974 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:14.210846 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-565tm"] Jun 03 09:46:14.213342 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:46:14.213313 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc43e169_fa45_47b9_81ff_d2f5d6f7b2e9.slice/crio-414b4ee9541f4048cf315383a841ed9f78ca480ea0f794807a134d91eb7dfa0f WatchSource:0}: Error finding container 414b4ee9541f4048cf315383a841ed9f78ca480ea0f794807a134d91eb7dfa0f: Status 404 returned error can't find the container with id 414b4ee9541f4048cf315383a841ed9f78ca480ea0f794807a134d91eb7dfa0f Jun 03 09:46:14.696764 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:14.696721 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-565tm" event={"ID":"cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9","Type":"ContainerStarted","Data":"414b4ee9541f4048cf315383a841ed9f78ca480ea0f794807a134d91eb7dfa0f"} Jun 03 09:46:23.553277 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.553233 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57c4859c85-f52dl"] Jun 03 09:46:23.557558 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.557537 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.560198 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.560173 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 09:46:23.560464 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.560444 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 09:46:23.561573 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.561528 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nkhvm\"" Jun 03 09:46:23.561889 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.561872 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 09:46:23.561951 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.561902 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 09:46:23.561998 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.561876 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 09:46:23.565981 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.565718 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c4859c85-f52dl"] Jun 03 09:46:23.598388 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.598355 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" podUID="a11f10a7-e9d1-47c2-8142-e0a628e6ec04" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 09:46:23.708517 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.708486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-service-ca\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.708687 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.708539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m5sh\" (UniqueName: \"kubernetes.io/projected/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-kube-api-access-6m5sh\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.708687 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.708605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-config\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.708687 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.708652 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-oauth-serving-cert\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.708790 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.708691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-serving-cert\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.708790 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.708746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-oauth-config\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.809276 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.809199 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6m5sh\" (UniqueName: \"kubernetes.io/projected/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-kube-api-access-6m5sh\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.809276 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.809236 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-config\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.809276 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.809260 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-oauth-serving-cert\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.809534 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.809291 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-serving-cert\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.809534 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.809318 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-oauth-config\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.809534 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.809346 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-service-ca\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.809954 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.809933 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-config\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.810037 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.810020 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-oauth-serving-cert\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.810109 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.810089 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-service-ca\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.811707 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.811677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-oauth-config\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.811868 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.811846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-serving-cert\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.817826 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.817797 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m5sh\" (UniqueName: \"kubernetes.io/projected/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-kube-api-access-6m5sh\") pod \"console-57c4859c85-f52dl\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:23.869572 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:23.869536 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:24.018541 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:24.018515 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c4859c85-f52dl"] Jun 03 09:46:24.020103 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:46:24.020074 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f5838c_d4ac_44c6_a9f1_56dd6ed03843.slice/crio-63ee2d0b6e6ed198943595232672db0abb584e4741fdce0b7085bb9f3cb562f3 WatchSource:0}: Error finding container 63ee2d0b6e6ed198943595232672db0abb584e4741fdce0b7085bb9f3cb562f3: Status 404 returned error can't find the container with id 63ee2d0b6e6ed198943595232672db0abb584e4741fdce0b7085bb9f3cb562f3 Jun 03 09:46:24.726914 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:24.726875 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4859c85-f52dl" event={"ID":"52f5838c-d4ac-44c6-a9f1-56dd6ed03843","Type":"ContainerStarted","Data":"63ee2d0b6e6ed198943595232672db0abb584e4741fdce0b7085bb9f3cb562f3"} Jun 03 09:46:33.598073 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.598024 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" podUID="a11f10a7-e9d1-47c2-8142-e0a628e6ec04" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 09:46:33.598555 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.598109 2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" Jun 03 09:46:33.598735 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.598701 2558 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"69f12a5a9b0acce0cf8404b0bf203adef0fdd5ba8ac91d617e0bd1b91fa490a3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 09:46:33.598810 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.598764 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" podUID="a11f10a7-e9d1-47c2-8142-e0a628e6ec04" containerName="service-proxy" containerID="cri-o://69f12a5a9b0acce0cf8404b0bf203adef0fdd5ba8ac91d617e0bd1b91fa490a3" gracePeriod=30 Jun 03 09:46:33.755496 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.755465 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-565tm" event={"ID":"cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9","Type":"ContainerStarted","Data":"f0ab09fb8d08034de3d66739077d08d012de22138e2894cbedac1675a663b116"} Jun 03 09:46:33.755742 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.755694 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-565tm" Jun 03 09:46:33.757128 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.757101 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4859c85-f52dl" event={"ID":"52f5838c-d4ac-44c6-a9f1-56dd6ed03843","Type":"ContainerStarted","Data":"3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e"} Jun 03 09:46:33.759114 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.759090 2558 generic.go:358] "Generic (PLEG): container finished" podID="a11f10a7-e9d1-47c2-8142-e0a628e6ec04" containerID="69f12a5a9b0acce0cf8404b0bf203adef0fdd5ba8ac91d617e0bd1b91fa490a3" exitCode=2 Jun 03 09:46:33.759228 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.759128 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" event={"ID":"a11f10a7-e9d1-47c2-8142-e0a628e6ec04","Type":"ContainerDied","Data":"69f12a5a9b0acce0cf8404b0bf203adef0fdd5ba8ac91d617e0bd1b91fa490a3"} Jun 03 09:46:33.767764 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.767743 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-565tm" Jun 03 09:46:33.777420 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.777379 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-565tm" podStartSLOduration=2.044935799 podStartE2EDuration="20.77736762s" podCreationTimestamp="2026-06-03 09:46:13 +0000 UTC" firstStartedPulling="2026-06-03 09:46:14.215082043 +0000 UTC m=+192.767433386" lastFinishedPulling="2026-06-03 09:46:32.947513852 +0000 UTC m=+211.499865207" observedRunningTime="2026-06-03 09:46:33.777066352 +0000 UTC m=+212.329417721" watchObservedRunningTime="2026-06-03 09:46:33.77736762 +0000 UTC m=+212.329718982" Jun 03 09:46:33.802469 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.802251 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57c4859c85-f52dl" podStartSLOduration=1.9244658270000001 podStartE2EDuration="10.802234197s" podCreationTimestamp="2026-06-03 09:46:23 +0000 UTC" firstStartedPulling="2026-06-03 09:46:24.022447407 +0000 UTC m=+202.574798752" lastFinishedPulling="2026-06-03 09:46:32.900215776 +0000 UTC m=+211.452567122" observedRunningTime="2026-06-03 09:46:33.801769857 +0000 UTC m=+212.354121222" watchObservedRunningTime="2026-06-03 09:46:33.802234197 +0000 UTC m=+212.354585562" Jun 03 09:46:33.870625 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.870534 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:33.870625 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.870580 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:33.877011 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:33.876777 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:34.765445 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:34.765405 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bc74f8b-9fd5x" event={"ID":"a11f10a7-e9d1-47c2-8142-e0a628e6ec04","Type":"ContainerStarted","Data":"f44502a5d6856eb7da9596f434c2852ebf5facba07192deccd0ba7ece3e07d25"} Jun 03 09:46:34.770127 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:34.770086 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:46:42.518224 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:46:42.518188 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c4859c85-f52dl"] Jun 03 09:47:07.538732 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.538671 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57c4859c85-f52dl" podUID="52f5838c-d4ac-44c6-a9f1-56dd6ed03843" containerName="console" containerID="cri-o://3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e" gracePeriod=15 Jun 03 09:47:07.809673 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.809654 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57c4859c85-f52dl_52f5838c-d4ac-44c6-a9f1-56dd6ed03843/console/0.log" Jun 03 09:47:07.809784 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.809725 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:47:07.864021 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.864000 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57c4859c85-f52dl_52f5838c-d4ac-44c6-a9f1-56dd6ed03843/console/0.log" Jun 03 09:47:07.864192 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.864040 2558 generic.go:358] "Generic (PLEG): container finished" podID="52f5838c-d4ac-44c6-a9f1-56dd6ed03843" containerID="3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e" exitCode=2 Jun 03 09:47:07.864192 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.864077 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4859c85-f52dl" event={"ID":"52f5838c-d4ac-44c6-a9f1-56dd6ed03843","Type":"ContainerDied","Data":"3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e"} Jun 03 09:47:07.864192 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.864104 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4859c85-f52dl" event={"ID":"52f5838c-d4ac-44c6-a9f1-56dd6ed03843","Type":"ContainerDied","Data":"63ee2d0b6e6ed198943595232672db0abb584e4741fdce0b7085bb9f3cb562f3"} Jun 03 09:47:07.864192 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.864122 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4859c85-f52dl" Jun 03 09:47:07.864192 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.864140 2558 scope.go:117] "RemoveContainer" containerID="3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e" Jun 03 09:47:07.871428 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.871411 2558 scope.go:117] "RemoveContainer" containerID="3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e" Jun 03 09:47:07.871694 ip-10-0-129-86 kubenswrapper[2558]: E0603 09:47:07.871673 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e\": container with ID starting with 3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e not found: ID does not exist" containerID="3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e" Jun 03 09:47:07.871733 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.871709 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e"} err="failed to get container status \"3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e\": rpc error: code = NotFound desc = could not find container \"3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e\": container with ID starting with 3b4afb5a4d383f5b4c3305a1ee279e9c05eddb077c51230e3c73b588858cc08e not found: ID does not exist" Jun 03 09:47:07.872859 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.872841 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-config\") pod \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " Jun 03 09:47:07.872911 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.872876 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-oauth-serving-cert\") pod \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " Jun 03 09:47:07.872911 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.872905 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-serving-cert\") pod \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " Jun 03 09:47:07.873017 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.872952 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m5sh\" (UniqueName: \"kubernetes.io/projected/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-kube-api-access-6m5sh\") pod \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " Jun 03 09:47:07.873017 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.873006 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-oauth-config\") pod \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " Jun 03 09:47:07.873111 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.873027 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-service-ca\") pod \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\" (UID: \"52f5838c-d4ac-44c6-a9f1-56dd6ed03843\") " Jun 03 09:47:07.873322 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.873262 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-config" (OuterVolumeSpecName: "console-config") pod "52f5838c-d4ac-44c6-a9f1-56dd6ed03843" (UID: "52f5838c-d4ac-44c6-a9f1-56dd6ed03843"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:07.873466 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.873442 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "52f5838c-d4ac-44c6-a9f1-56dd6ed03843" (UID: "52f5838c-d4ac-44c6-a9f1-56dd6ed03843"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:07.873534 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.873487 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-service-ca" (OuterVolumeSpecName: "service-ca") pod "52f5838c-d4ac-44c6-a9f1-56dd6ed03843" (UID: "52f5838c-d4ac-44c6-a9f1-56dd6ed03843"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 09:47:07.875200 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.875169 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "52f5838c-d4ac-44c6-a9f1-56dd6ed03843" (UID: "52f5838c-d4ac-44c6-a9f1-56dd6ed03843"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:07.875281 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.875198 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "52f5838c-d4ac-44c6-a9f1-56dd6ed03843" (UID: "52f5838c-d4ac-44c6-a9f1-56dd6ed03843"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 09:47:07.875281 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.875249 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-kube-api-access-6m5sh" (OuterVolumeSpecName: "kube-api-access-6m5sh") pod "52f5838c-d4ac-44c6-a9f1-56dd6ed03843" (UID: "52f5838c-d4ac-44c6-a9f1-56dd6ed03843"). InnerVolumeSpecName "kube-api-access-6m5sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 09:47:07.973879 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.973854 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 03 09:47:07.973879 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.973877 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m5sh\" (UniqueName: \"kubernetes.io/projected/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-kube-api-access-6m5sh\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 03 09:47:07.974007 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.973886 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-oauth-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 03 09:47:07.974007 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.973896 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-service-ca\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 03 09:47:07.974007 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.973905 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-console-config\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 03 09:47:07.974007 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:07.973913 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52f5838c-d4ac-44c6-a9f1-56dd6ed03843-oauth-serving-cert\") on node \"ip-10-0-129-86.ec2.internal\" DevicePath \"\"" Jun 03 09:47:08.180870 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:08.180843 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c4859c85-f52dl"] Jun 03 09:47:08.185031 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:08.185008 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57c4859c85-f52dl"] Jun 03 09:47:10.017458 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:10.017425 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52f5838c-d4ac-44c6-a9f1-56dd6ed03843" path="/var/lib/kubelet/pods/52f5838c-d4ac-44c6-a9f1-56dd6ed03843/volumes" Jun 03 09:47:12.908914 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:12.908882 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:47:12.911089 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:12.911058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78bfa0a1-e57b-458a-b820-2a6a47362c9b-metrics-certs\") pod \"network-metrics-daemon-6d6zm\" (UID: \"78bfa0a1-e57b-458a-b820-2a6a47362c9b\") " pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:47:13.117314 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:13.117285 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qwzs9\"" Jun 03 09:47:13.125405 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:13.125381 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6d6zm" Jun 03 09:47:13.243924 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:13.243895 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6d6zm"] Jun 03 09:47:13.247291 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:47:13.247265 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78bfa0a1_e57b_458a_b820_2a6a47362c9b.slice/crio-7457bf1e1e85df581bdbf64cf8b4ad0b7f840b9525f7db026757cf84e0e3012f WatchSource:0}: Error finding container 7457bf1e1e85df581bdbf64cf8b4ad0b7f840b9525f7db026757cf84e0e3012f: Status 404 returned error can't find the container with id 7457bf1e1e85df581bdbf64cf8b4ad0b7f840b9525f7db026757cf84e0e3012f Jun 03 09:47:13.882470 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:13.882436 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6d6zm" event={"ID":"78bfa0a1-e57b-458a-b820-2a6a47362c9b","Type":"ContainerStarted","Data":"7457bf1e1e85df581bdbf64cf8b4ad0b7f840b9525f7db026757cf84e0e3012f"} Jun 03 09:47:15.890066 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:15.890029 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6d6zm" event={"ID":"78bfa0a1-e57b-458a-b820-2a6a47362c9b","Type":"ContainerStarted","Data":"ce842fcaed487a335f2331b29a5db3303d5d615e007418877e61066c5ee96be0"} Jun 03 09:47:15.890066 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:15.890066 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6d6zm" event={"ID":"78bfa0a1-e57b-458a-b820-2a6a47362c9b","Type":"ContainerStarted","Data":"2c249fd5dff4d4b47061268553bfbd313dc2cf1fdd0099f0e63bfcbb6b0ac3e2"} Jun 03 09:47:15.907951 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:15.907893 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6d6zm" podStartSLOduration=252.327458492 podStartE2EDuration="4m13.907876805s" podCreationTimestamp="2026-06-03 09:43:02 +0000 UTC" firstStartedPulling="2026-06-03 09:47:13.251538649 +0000 UTC m=+251.803889992" lastFinishedPulling="2026-06-03 09:47:14.831956959 +0000 UTC m=+253.384308305" observedRunningTime="2026-06-03 09:47:15.906607786 +0000 UTC m=+254.458959148" watchObservedRunningTime="2026-06-03 09:47:15.907876805 +0000 UTC m=+254.460228173" Jun 03 09:47:22.508214 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.508112 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd446f8c7-2c7gg"] Jun 03 09:47:22.508658 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.508508 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f5838c-d4ac-44c6-a9f1-56dd6ed03843" containerName="console" Jun 03 09:47:22.508658 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.508528 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f5838c-d4ac-44c6-a9f1-56dd6ed03843" containerName="console" Jun 03 09:47:22.508658 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.508599 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="52f5838c-d4ac-44c6-a9f1-56dd6ed03843" containerName="console" Jun 03 09:47:22.510403 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.510372 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.514104 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.514083 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 09:47:22.514248 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.514089 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 09:47:22.514248 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.514218 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 09:47:22.514248 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.514136 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 09:47:22.514420 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.514125 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nkhvm\"" Jun 03 09:47:22.514527 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.514512 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 09:47:22.518619 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.518579 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 09:47:22.523479 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.523460 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd446f8c7-2c7gg"] Jun 03 09:47:22.678335 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.678304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-oauth-serving-cert\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.678478 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.678342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-serving-cert\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.678478 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.678364 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-oauth-config\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.678478 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.678424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-service-ca\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.678478 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.678448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-config\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.678478 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.678477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6lml\" (UniqueName: \"kubernetes.io/projected/a88c11b1-bfbd-4f77-948a-64f9fe958da8-kube-api-access-x6lml\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.678649 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.678500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-trusted-ca-bundle\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.779901 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.779803 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-oauth-serving-cert\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.779901 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.779844 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-serving-cert\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.779901 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.779864 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-oauth-config\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.779901 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.779887 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-service-ca\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.779901 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.779910 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-config\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.780320 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.779948 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6lml\" (UniqueName: \"kubernetes.io/projected/a88c11b1-bfbd-4f77-948a-64f9fe958da8-kube-api-access-x6lml\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.780320 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.779972 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-trusted-ca-bundle\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.780687 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.780663 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-service-ca\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.780775 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.780667 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-oauth-serving-cert\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.780814 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.780790 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-config\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.780848 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.780811 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88c11b1-bfbd-4f77-948a-64f9fe958da8-trusted-ca-bundle\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.782959 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.782934 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-oauth-config\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.783042 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.783015 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a88c11b1-bfbd-4f77-948a-64f9fe958da8-console-serving-cert\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.788929 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.788901 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6lml\" (UniqueName: \"kubernetes.io/projected/a88c11b1-bfbd-4f77-948a-64f9fe958da8-kube-api-access-x6lml\") pod \"console-dd446f8c7-2c7gg\" (UID: \"a88c11b1-bfbd-4f77-948a-64f9fe958da8\") " pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.820357 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.820327 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:22.944879 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:22.944838 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd446f8c7-2c7gg"] Jun 03 09:47:22.948170 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:47:22.948119 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88c11b1_bfbd_4f77_948a_64f9fe958da8.slice/crio-afddd00be88e1afe88c6738945fea4e9556aede64b3539fa33b23b19b42274c7 WatchSource:0}: Error finding container afddd00be88e1afe88c6738945fea4e9556aede64b3539fa33b23b19b42274c7: Status 404 returned error can't find the container with id afddd00be88e1afe88c6738945fea4e9556aede64b3539fa33b23b19b42274c7 Jun 03 09:47:23.910633 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:23.910590 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd446f8c7-2c7gg" event={"ID":"a88c11b1-bfbd-4f77-948a-64f9fe958da8","Type":"ContainerStarted","Data":"34cf4b4893e99faf098a209363559ad2b92f6ed7abcb75f36b444a2d9bf7e6d7"} Jun 03 09:47:23.910633 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:23.910631 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd446f8c7-2c7gg" event={"ID":"a88c11b1-bfbd-4f77-948a-64f9fe958da8","Type":"ContainerStarted","Data":"afddd00be88e1afe88c6738945fea4e9556aede64b3539fa33b23b19b42274c7"} Jun 03 09:47:23.930074 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:23.930027 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-dd446f8c7-2c7gg" podStartSLOduration=1.930014704 podStartE2EDuration="1.930014704s" podCreationTimestamp="2026-06-03 09:47:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:47:23.929432873 +0000 UTC m=+262.481784238" watchObservedRunningTime="2026-06-03 09:47:23.930014704 +0000 UTC m=+262.482366069" Jun 03 09:47:32.821413 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:32.821373 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:32.821413 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:32.821414 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:32.826016 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:32.825993 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:47:32.939290 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:47:32.939263 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd446f8c7-2c7gg" Jun 03 09:48:01.919190 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:01.919143 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/0.log" Jun 03 09:48:01.919810 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:01.919259 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/0.log" Jun 03 09:48:01.924793 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:01.924772 2558 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 09:48:47.713611 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:47.713579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xfmvr_3bc2b457-33ce-4fb0-96fc-88999b7338ae/global-pull-secret-syncer/0.log" Jun 03 09:48:47.815556 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:47.815510 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nbjzb_1aa8ec22-da2a-4632-9f10-c2ab5690c805/konnectivity-agent/0.log" Jun 03 09:48:47.836766 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:47.836739 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-86.ec2.internal_12c1570f7ab0a1ed0359aa488a0bf8bb/haproxy/0.log" Jun 03 09:48:51.137945 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.137845 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cbr9t_5d0d750b-64cf-4681-9d52-1476dc5f9514/node-exporter/0.log" Jun 03 09:48:51.162125 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.162075 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cbr9t_5d0d750b-64cf-4681-9d52-1476dc5f9514/kube-rbac-proxy/0.log" Jun 03 09:48:51.186567 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.186545 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cbr9t_5d0d750b-64cf-4681-9d52-1476dc5f9514/init-textfile/0.log" Jun 03 09:48:51.388627 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.388539 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-fpprc_3d3c1a2d-9d21-4e74-a191-9b192b94b6c3/kube-rbac-proxy-main/0.log" Jun 03 09:48:51.410569 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.410549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-fpprc_3d3c1a2d-9d21-4e74-a191-9b192b94b6c3/kube-rbac-proxy-self/0.log" Jun 03 09:48:51.433024 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.433005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-fpprc_3d3c1a2d-9d21-4e74-a191-9b192b94b6c3/openshift-state-metrics/0.log" Jun 03 09:48:51.807563 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.807485 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6588f466-pdsgt_446904de-4e60-4589-a6ff-f114e75ca628/thanos-query/0.log" Jun 03 09:48:51.830127 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.830106 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6588f466-pdsgt_446904de-4e60-4589-a6ff-f114e75ca628/kube-rbac-proxy-web/0.log" Jun 03 09:48:51.850992 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.850973 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6588f466-pdsgt_446904de-4e60-4589-a6ff-f114e75ca628/kube-rbac-proxy/0.log" Jun 03 09:48:51.876525 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.876508 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6588f466-pdsgt_446904de-4e60-4589-a6ff-f114e75ca628/prom-label-proxy/0.log" Jun 03 09:48:51.896271 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.896241 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6588f466-pdsgt_446904de-4e60-4589-a6ff-f114e75ca628/kube-rbac-proxy-rules/0.log" Jun 03 09:48:51.919921 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:51.919904 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6588f466-pdsgt_446904de-4e60-4589-a6ff-f114e75ca628/kube-rbac-proxy-metrics/0.log" Jun 03 09:48:53.769927 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:53.769895 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dd446f8c7-2c7gg_a88c11b1-bfbd-4f77-948a-64f9fe958da8/console/0.log" Jun 03 09:48:53.797331 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:53.797304 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-565tm_cc43e169-fa45-47b9-81ff-d2f5d6f7b2e9/download-server/0.log" Jun 03 09:48:54.317394 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.317361 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft"] Jun 03 09:48:54.319323 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.319307 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.321756 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.321725 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4q4fr\"/\"kube-root-ca.crt\"" Jun 03 09:48:54.322847 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.322828 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4q4fr\"/\"default-dockercfg-kftqc\"" Jun 03 09:48:54.322951 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.322833 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4q4fr\"/\"openshift-service-ca.crt\"" Jun 03 09:48:54.327636 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.327610 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft"] Jun 03 09:48:54.421063 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.421031 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-lib-modules\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.421063 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.421062 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-proc\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.421282 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.421083 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-podres\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.421282 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.421175 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-sys\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.421282 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.421206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxmjc\" (UniqueName: \"kubernetes.io/projected/15666b4d-38cc-473a-a39e-c195f728cc5c-kube-api-access-sxmjc\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.521947 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.521913 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-podres\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522038 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.521960 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-sys\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522038 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.521978 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxmjc\" (UniqueName: \"kubernetes.io/projected/15666b4d-38cc-473a-a39e-c195f728cc5c-kube-api-access-sxmjc\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522038 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.522025 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-lib-modules\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522134 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.522044 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-proc\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522134 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.522048 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-sys\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522134 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.522072 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-podres\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522134 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.522110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-proc\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.522292 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.522167 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/15666b4d-38cc-473a-a39e-c195f728cc5c-lib-modules\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.530754 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.530730 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxmjc\" (UniqueName: \"kubernetes.io/projected/15666b4d-38cc-473a-a39e-c195f728cc5c-kube-api-access-sxmjc\") pod \"perf-node-gather-daemonset-927ft\" (UID: \"15666b4d-38cc-473a-a39e-c195f728cc5c\") " pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.630430 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.630408 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:54.749421 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.749386 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft"] Jun 03 09:48:54.752558 ip-10-0-129-86 kubenswrapper[2558]: W0603 09:48:54.752534 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod15666b4d_38cc_473a_a39e_c195f728cc5c.slice/crio-436eb793f79a4834ec6a2110de1a5850b827a54f81d00f1263c84ee23f61686d WatchSource:0}: Error finding container 436eb793f79a4834ec6a2110de1a5850b827a54f81d00f1263c84ee23f61686d: Status 404 returned error can't find the container with id 436eb793f79a4834ec6a2110de1a5850b827a54f81d00f1263c84ee23f61686d Jun 03 09:48:54.754066 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.754053 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 09:48:54.901031 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.900959 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qszcn_7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b/dns/0.log" Jun 03 09:48:54.922484 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.922456 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qszcn_7aabd2e5-cca5-4ea2-97a6-b7a6758ad90b/kube-rbac-proxy/0.log" Jun 03 09:48:54.999416 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:54.999394 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fxl8b_0ae11697-e620-40a9-ae34-580e652f61b7/dns-node-resolver/0.log" Jun 03 09:48:55.154778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:55.154693 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" event={"ID":"15666b4d-38cc-473a-a39e-c195f728cc5c","Type":"ContainerStarted","Data":"5b88d353703e09e8f2500746e54a4191760e2a2138b4e86018c0e9c53ecfaa59"} Jun 03 09:48:55.154778 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:55.154728 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" event={"ID":"15666b4d-38cc-473a-a39e-c195f728cc5c","Type":"ContainerStarted","Data":"436eb793f79a4834ec6a2110de1a5850b827a54f81d00f1263c84ee23f61686d"} Jun 03 09:48:55.154941 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:55.154881 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:48:55.171622 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:55.171580 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" podStartSLOduration=1.171568378 podStartE2EDuration="1.171568378s" podCreationTimestamp="2026-06-03 09:48:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:48:55.169560794 +0000 UTC m=+353.721912156" watchObservedRunningTime="2026-06-03 09:48:55.171568378 +0000 UTC m=+353.723919743" Jun 03 09:48:55.410927 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:55.410857 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfh7n_e20d0ed3-a4e7-4e34-bc88-7edbf00e8afb/node-ca/0.log" Jun 03 09:48:56.472728 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:56.472696 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sg5vh_fef4b465-8df2-431f-9e77-e6c86a1b8ffd/serve-healthcheck-canary/0.log" Jun 03 09:48:56.893332 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:56.893305 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nx6l_05f305d9-32ac-4bc1-b241-763f9fb556ef/kube-rbac-proxy/0.log" Jun 03 09:48:56.917454 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:56.917432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nx6l_05f305d9-32ac-4bc1-b241-763f9fb556ef/exporter/0.log" Jun 03 09:48:56.949496 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:48:56.949471 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9nx6l_05f305d9-32ac-4bc1-b241-763f9fb556ef/extractor/0.log" Jun 03 09:49:01.167656 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:01.167629 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4q4fr/perf-node-gather-daemonset-927ft" Jun 03 09:49:02.700930 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.700904 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwtz_7ec91163-9154-4ae3-8cee-4f3b26098114/kube-multus-additional-cni-plugins/0.log" Jun 03 09:49:02.724268 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.724238 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwtz_7ec91163-9154-4ae3-8cee-4f3b26098114/egress-router-binary-copy/0.log" Jun 03 09:49:02.750175 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.750129 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwtz_7ec91163-9154-4ae3-8cee-4f3b26098114/cni-plugins/0.log" Jun 03 09:49:02.779555 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.779528 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwtz_7ec91163-9154-4ae3-8cee-4f3b26098114/bond-cni-plugin/0.log" Jun 03 09:49:02.813598 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.813567 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwtz_7ec91163-9154-4ae3-8cee-4f3b26098114/routeoverride-cni/0.log" Jun 03 09:49:02.852137 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.852068 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwtz_7ec91163-9154-4ae3-8cee-4f3b26098114/whereabouts-cni-bincopy/0.log" Jun 03 09:49:02.887538 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.887513 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sjwtz_7ec91163-9154-4ae3-8cee-4f3b26098114/whereabouts-cni/0.log" Jun 03 09:49:02.925299 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.925274 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vkssk_a76aef5d-d213-4de9-a607-90783cff0866/kube-multus/0.log" Jun 03 09:49:02.976535 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.976507 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6d6zm_78bfa0a1-e57b-458a-b820-2a6a47362c9b/network-metrics-daemon/0.log" Jun 03 09:49:02.999792 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:02.999765 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6d6zm_78bfa0a1-e57b-458a-b820-2a6a47362c9b/kube-rbac-proxy/0.log" Jun 03 09:49:04.259055 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.259021 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-controller/0.log" Jun 03 09:49:04.283555 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.283527 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/0.log" Jun 03 09:49:04.284948 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.284931 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovn-acl-logging/1.log" Jun 03 09:49:04.305713 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.305690 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/kube-rbac-proxy-node/0.log" Jun 03 09:49:04.328119 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.328095 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 09:49:04.351016 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.350998 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/northd/0.log" Jun 03 09:49:04.373524 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.373510 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/nbdb/0.log" Jun 03 09:49:04.397391 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.397375 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/sbdb/0.log" Jun 03 09:49:04.478527 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:04.478502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m4bz9_27abf46b-2e55-4eab-ae20-a7feb144f14d/ovnkube-controller/0.log" Jun 03 09:49:05.892044 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:05.892014 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-n46bq_76c8a6bd-cc16-4b6a-8be9-6043f75e1430/network-check-target-container/0.log" Jun 03 09:49:06.774799 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:06.774769 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jccsk_d40ca2ad-eba2-43af-bddc-d7bb07693a2c/iptables-alerter/0.log" Jun 03 09:49:07.438135 ip-10-0-129-86 kubenswrapper[2558]: I0603 09:49:07.438108 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-jsfhl_b63c2ca1-03a8-4462-9f80-83826a7fba19/tuned/0.log"