Jun 02 16:59:00.004158 ip-10-0-141-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 16:59:00.004170 ip-10-0-141-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 16:59:00.004178 ip-10-0-141-142 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 16:59:00.004479 ip-10-0-141-142 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 16:59:10.135080 ip-10-0-141-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 16:59:10.135102 ip-10-0-141-142 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3447042df9c2476cb2e195a4615dc6ad -- Jun 02 17:01:26.405104 ip-10-0-141-142 systemd[1]: Starting Kubernetes Kubelet... Jun 02 17:01:26.803704 ip-10-0-141-142 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 17:01:26.803704 ip-10-0-141-142 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 17:01:26.803704 ip-10-0-141-142 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 17:01:26.803704 ip-10-0-141-142 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 17:01:26.803704 ip-10-0-141-142 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 17:01:26.805171 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.804995 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 17:01:26.808716 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808701 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 17:01:26.808716 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808716 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808720 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808723 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808726 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808729 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808732 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808735 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808738 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808741 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808743 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808747 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808752 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808755 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808758 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808761 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808763 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808766 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808768 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808772 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808779 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 17:01:26.808781 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808782 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808786 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808788 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808791 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808794 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808808 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808813 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808818 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808822 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808826 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808831 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808833 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808836 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808838 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808841 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808844 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808846 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808851 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808853 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808856 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 17:01:26.809266 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808859 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808862 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808864 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808867 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808869 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808872 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808874 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808877 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808879 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808882 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808884 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808886 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808889 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808891 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808895 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808898 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808901 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808903 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808906 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 17:01:26.809750 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808908 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808911 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808913 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808916 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808918 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808924 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808927 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808930 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808933 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808935 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808938 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808941 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808943 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808946 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808948 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808951 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808953 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808956 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808959 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 17:01:26.810216 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808961 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808964 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808967 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808969 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808972 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808974 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.808977 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809354 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809360 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809363 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809365 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809368 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809371 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809375 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809378 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809380 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809383 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809385 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809389 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 17:01:26.810675 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809393 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809396 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809399 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809402 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809404 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809407 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809409 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809412 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809414 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809417 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809419 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809422 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809425 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809427 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809429 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809432 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809434 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809437 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809440 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 17:01:26.811156 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809442 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809445 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809448 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809452 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809454 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809457 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809460 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809462 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809465 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809467 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809470 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809472 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809474 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809477 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809479 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809482 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809484 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809486 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809489 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809491 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 17:01:26.811664 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809494 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809496 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809499 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809502 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809504 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809506 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809509 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809511 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809514 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809516 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809518 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809522 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809524 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809526 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809530 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809533 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809535 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809538 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809540 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809542 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 17:01:26.812161 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809545 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809548 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809552 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809556 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809559 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809562 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809564 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809567 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809570 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809572 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809575 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809577 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809580 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809582 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.809585 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809663 2555 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809673 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809680 2555 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809684 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809689 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809693 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 17:01:26.812639 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809697 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809702 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809705 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809708 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809711 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809715 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809718 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809721 2555 flags.go:64] FLAG: --cgroup-root="" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809724 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809727 2555 flags.go:64] FLAG: --client-ca-file="" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809730 2555 flags.go:64] FLAG: --cloud-config="" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809733 2555 flags.go:64] FLAG: --cloud-provider="external" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809736 2555 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809740 2555 flags.go:64] FLAG: --cluster-domain="" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809743 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809746 2555 flags.go:64] FLAG: --config-dir="" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809749 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809752 2555 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809756 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809759 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809762 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809766 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809769 2555 flags.go:64] FLAG: --contention-profiling="false" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809772 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 17:01:26.813164 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809775 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809778 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809781 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809786 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809789 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809792 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809795 2555 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809813 2555 flags.go:64] FLAG: --enable-server="true" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809816 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809822 2555 flags.go:64] FLAG: --event-burst="100" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809825 2555 flags.go:64] FLAG: --event-qps="50" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809828 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809831 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809835 2555 flags.go:64] FLAG: --eviction-hard="" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809839 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809841 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809844 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809847 2555 flags.go:64] FLAG: --eviction-soft="" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809850 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809853 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809856 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809859 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809862 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809865 2555 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809868 2555 flags.go:64] FLAG: --feature-gates="" Jun 02 17:01:26.813840 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809871 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809875 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809878 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809881 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809883 2555 flags.go:64] FLAG: --healthz-port="10248" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809886 2555 flags.go:64] FLAG: --help="false" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809889 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-141-142.ec2.internal" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809892 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809895 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809898 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809901 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809905 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809908 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809911 2555 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809914 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809916 2555 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809919 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809922 2555 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809925 2555 flags.go:64] FLAG: --kube-reserved="" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809927 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809931 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809934 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809936 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809939 2555 flags.go:64] FLAG: --lock-file="" Jun 02 17:01:26.814442 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809942 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809945 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809948 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809953 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809956 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809959 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809961 2555 flags.go:64] FLAG: --logging-format="text" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809964 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809967 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809970 2555 flags.go:64] FLAG: --manifest-url="" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809973 2555 flags.go:64] FLAG: --manifest-url-header="" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809977 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809980 2555 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809984 2555 flags.go:64] FLAG: --max-pods="110" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809987 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809990 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809993 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809996 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.809999 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810002 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810006 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810014 2555 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810017 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810020 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 17:01:26.815055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810023 2555 flags.go:64] FLAG: --pod-cidr="" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810026 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810031 2555 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810034 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810037 2555 flags.go:64] FLAG: --pods-per-core="0" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810040 2555 flags.go:64] FLAG: --port="10250" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810044 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810046 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08a7c59025d909c20" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810050 2555 flags.go:64] FLAG: --qos-reserved="" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810052 2555 flags.go:64] FLAG: --read-only-port="10255" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810056 2555 flags.go:64] FLAG: --register-node="true" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810058 2555 flags.go:64] FLAG: --register-schedulable="true" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810062 2555 flags.go:64] FLAG: --register-with-taints="" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810065 2555 flags.go:64] FLAG: --registry-burst="10" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810068 2555 flags.go:64] FLAG: --registry-qps="5" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810071 2555 flags.go:64] FLAG: --reserved-cpus="" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810073 2555 flags.go:64] FLAG: --reserved-memory="" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810077 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810080 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810083 2555 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810086 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810089 2555 flags.go:64] FLAG: --runonce="false" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810091 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810094 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810100 2555 flags.go:64] FLAG: --seccomp-default="false" Jun 02 17:01:26.815632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810102 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810105 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810108 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810111 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810114 2555 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810118 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810121 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810123 2555 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810126 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810129 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810132 2555 flags.go:64] FLAG: --system-cgroups="" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810134 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810140 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810143 2555 flags.go:64] FLAG: --tls-cert-file="" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810146 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810150 2555 flags.go:64] FLAG: --tls-min-version="" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810152 2555 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810155 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810158 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810161 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810164 2555 flags.go:64] FLAG: --v="2" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810168 2555 flags.go:64] FLAG: --version="false" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810176 2555 flags.go:64] FLAG: --vmodule="" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810181 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.810184 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 17:01:26.816287 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810278 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810281 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810284 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810287 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810289 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810292 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810296 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810301 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810304 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810306 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810309 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810311 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810314 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810317 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810319 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810322 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810325 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810327 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810330 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810332 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 17:01:26.816913 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810335 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810337 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810339 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810344 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810347 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810349 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810352 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810355 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810358 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810361 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810364 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810367 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810370 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810373 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810375 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810378 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810381 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810385 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810390 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 17:01:26.817414 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810395 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810398 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810400 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810404 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810406 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810409 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810411 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810414 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810416 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810419 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810422 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810424 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810427 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810429 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810432 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810434 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810437 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810439 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810442 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810444 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 17:01:26.817956 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810447 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810449 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810452 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810454 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810456 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810459 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810462 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810464 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810467 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810469 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810472 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810475 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810479 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810481 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810484 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810486 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810489 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810491 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810494 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 17:01:26.818440 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810496 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810499 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810502 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810504 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810507 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810510 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810512 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.810515 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.811335 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.818232 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.818250 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818302 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818308 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818311 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818315 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818318 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 17:01:26.818926 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818321 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818324 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818326 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818329 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818331 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818334 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818336 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818339 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818341 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818344 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818346 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818350 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818354 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818357 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818360 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818362 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818365 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818368 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818371 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 17:01:26.819330 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818374 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818377 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818379 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818382 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818384 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818387 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818390 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818393 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818396 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818398 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818401 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818404 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818406 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818409 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818412 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818415 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818417 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818420 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818422 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818425 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 17:01:26.819814 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818427 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818430 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818432 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818435 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818438 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818440 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818442 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818445 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818448 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818450 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818453 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818457 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818459 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818461 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818464 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818466 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818469 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818471 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818474 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818478 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 17:01:26.820298 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818480 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818483 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818485 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818488 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818490 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818493 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818495 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818497 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818500 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818502 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818505 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818508 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818510 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818512 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818515 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818517 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818520 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818524 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818528 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818531 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 17:01:26.820782 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818534 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818537 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.818542 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818661 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818667 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818670 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818673 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818676 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818679 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818682 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818685 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818687 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818690 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818692 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818695 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 17:01:26.821282 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818697 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818700 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818702 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818705 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818707 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818710 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818712 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818714 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818717 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818719 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818722 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818724 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818727 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818729 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818731 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818734 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818737 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818739 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818741 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818744 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 17:01:26.821644 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818747 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818749 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818752 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818754 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818757 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818759 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818762 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818764 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818767 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818769 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818772 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818774 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818777 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818779 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818782 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818785 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818788 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818792 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818794 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818796 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 17:01:26.822176 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818818 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818821 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818824 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818827 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818829 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818832 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818836 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818838 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818840 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818843 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818845 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818848 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818850 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818853 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818855 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818858 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818861 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818864 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818866 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 17:01:26.822729 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818869 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818871 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818874 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818877 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818879 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818881 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818884 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818887 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818890 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818894 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818897 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818900 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818902 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818905 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:26.818908 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 17:01:26.823271 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.818912 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 17:01:26.823653 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.819588 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 17:01:26.823653 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.822027 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 17:01:26.823653 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.822858 2555 server.go:1019] "Starting client certificate rotation" Jun 02 17:01:26.823653 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.822956 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 17:01:26.823653 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.822992 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 17:01:26.844716 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.844696 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 17:01:26.845891 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.845860 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 17:01:26.863885 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.863864 2555 log.go:25] "Validated CRI v1 runtime API" Jun 02 17:01:26.869003 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.868988 2555 log.go:25] "Validated CRI v1 image API" Jun 02 17:01:26.870367 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.870350 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 17:01:26.873655 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.873630 2555 fs.go:135] Filesystem UUIDs: map[2daacb6e-1ba3-4b12-bbf0-227b3ae40f21:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b8cd2a3c-25a3-4b69-8b40-4fb941d93691:/dev/nvme0n1p3] Jun 02 17:01:26.873718 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.873657 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 17:01:26.877868 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.877749 2555 manager.go:217] Machine: {Timestamp:2026-06-02 17:01:26.877275559 +0000 UTC m=+0.363983008 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100789 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ae68e10cc40f92d517aaa82f9e17a SystemUUID:ec2ae68e-10cc-40f9-2d51-7aaa82f9e17a BootID:3447042d-f9c2-476c-b2e1-95a4615dc6ad Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:f8:83:8d:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:f8:83:8d:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:e5:98:45:e9:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 17:01:26.878410 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.878400 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 17:01:26.878505 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.878487 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 17:01:26.880699 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.880673 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 17:01:26.880854 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.880701 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 17:01:26.880906 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.880864 2555 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 17:01:26.880906 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.880873 2555 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 17:01:26.880906 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.880884 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 17:01:26.881523 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.881513 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 17:01:26.881994 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.881980 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 17:01:26.882735 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.882724 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 02 17:01:26.882852 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.882842 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 17:01:26.885519 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.885510 2555 kubelet.go:491] "Attempting to sync node with API server" Jun 02 17:01:26.885558 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.885524 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 17:01:26.885558 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.885536 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 17:01:26.885558 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.885545 2555 kubelet.go:397] "Adding apiserver pod source" Jun 02 17:01:26.885558 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.885553 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 17:01:26.886523 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.886511 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 17:01:26.886562 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.886531 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 17:01:26.889103 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.889088 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 17:01:26.891231 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.891216 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 17:01:26.893399 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893380 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 17:01:26.893399 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893398 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893404 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893411 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893426 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893432 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893444 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893450 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893456 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893462 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893477 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 17:01:26.893525 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.893483 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 17:01:26.894159 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.894149 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 17:01:26.894159 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.894159 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 17:01:26.895668 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.895646 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 17:01:26.895734 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.895708 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 17:01:26.897270 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.897256 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 17:01:26.897335 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.897295 2555 server.go:1295] "Started kubelet" Jun 02 17:01:26.897930 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.897399 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 17:01:26.898029 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.897969 2555 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 17:01:26.898430 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.897361 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 17:01:26.898685 ip-10-0-141-142 systemd[1]: Started Kubernetes Kubelet. Jun 02 17:01:26.898941 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.898923 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 17:01:26.901629 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.901612 2555 server.go:317] "Adding debug handlers to kubelet server" Jun 02 17:01:26.904144 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904125 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7wdb" Jun 02 17:01:26.904236 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904157 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 17:01:26.904236 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904170 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 17:01:26.904342 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904310 2555 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 17:01:26.904342 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904321 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 17:01:26.904434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904354 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 17:01:26.904434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904408 2555 reconstruct.go:97] "Volume reconstruction finished" Jun 02 17:01:26.904434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.904416 2555 reconciler.go:26] "Reconciler: start to sync state" Jun 02 17:01:26.904861 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.904840 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:26.905028 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905016 2555 factory.go:153] Registering CRI-O factory Jun 02 17:01:26.905084 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905037 2555 factory.go:223] Registration of the crio container factory successfully Jun 02 17:01:26.905134 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905085 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 17:01:26.905134 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905094 2555 factory.go:55] Registering systemd factory Jun 02 17:01:26.905134 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905102 2555 factory.go:223] Registration of the systemd container factory successfully Jun 02 17:01:26.905134 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905117 2555 factory.go:103] Registering Raw factory Jun 02 17:01:26.905134 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905134 2555 manager.go:1196] Started watching for new ooms in manager Jun 02 17:01:26.905558 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.905540 2555 manager.go:319] Starting recovery of all containers Jun 02 17:01:26.906488 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.906469 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 17:01:26.907755 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.906904 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-142.ec2.internal.18b55245ac9fb750 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-142.ec2.internal,UID:ip-10-0-141-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-142.ec2.internal,},FirstTimestamp:2026-06-02 17:01:26.89726856 +0000 UTC m=+0.383975998,LastTimestamp:2026-06-02 17:01:26.89726856 +0000 UTC m=+0.383975998,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-142.ec2.internal,}" Jun 02 17:01:26.907925 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.907911 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 17:01:26.908100 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.908076 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 17:01:26.909237 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.909217 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7wdb" Jun 02 17:01:26.917249 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.917237 2555 manager.go:324] Recovery completed Jun 02 17:01:26.917853 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.917837 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 17:01:26.918793 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.918773 2555 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 17:01:26.921777 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.921764 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 17:01:26.923934 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.923919 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientMemory" Jun 02 17:01:26.924011 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.923955 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 17:01:26.924011 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.923964 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientPID" Jun 02 17:01:26.924449 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.924436 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 17:01:26.924449 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.924449 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 17:01:26.924528 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.924464 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 02 17:01:26.926695 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.926684 2555 policy_none.go:49] "None policy: Start" Jun 02 17:01:26.926736 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.926710 2555 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 17:01:26.926736 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.926720 2555 state_mem.go:35] "Initializing new in-memory state store" Jun 02 17:01:26.959382 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.959369 2555 manager.go:341] "Starting Device Plugin manager" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.959406 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.959421 2555 server.go:85] "Starting device plugin registration server" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.959655 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.959667 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.959759 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.959903 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:26.959916 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.960351 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 17:01:26.971672 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:26.960382 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.035847 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.035814 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 17:01:27.037136 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.037118 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 17:01:27.037221 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.037145 2555 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 17:01:27.037221 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.037163 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 17:01:27.037221 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.037169 2555 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 17:01:27.037341 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.037229 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 17:01:27.039767 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.039748 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 17:01:27.059790 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.059738 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 17:01:27.060554 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.060539 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientMemory" Jun 02 17:01:27.060624 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.060566 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 17:01:27.060624 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.060577 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientPID" Jun 02 17:01:27.060624 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.060599 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.068052 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.068035 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.068110 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.068055 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-142.ec2.internal\": node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.082260 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.082242 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.137334 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.137311 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal"] Jun 02 17:01:27.137425 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.137382 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 17:01:27.138165 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.138152 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientMemory" Jun 02 17:01:27.138227 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.138178 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 17:01:27.138227 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.138187 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientPID" Jun 02 17:01:27.139171 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139159 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 17:01:27.139302 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139289 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.139342 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139319 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 17:01:27.139774 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139759 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientMemory" Jun 02 17:01:27.139883 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139788 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 17:01:27.139883 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139784 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientMemory" Jun 02 17:01:27.139883 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139822 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientPID" Jun 02 17:01:27.139883 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139834 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 17:01:27.139883 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.139843 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientPID" Jun 02 17:01:27.140957 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.140942 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.141027 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.140985 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 17:01:27.141605 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.141591 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientMemory" Jun 02 17:01:27.141666 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.141618 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 17:01:27.141666 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.141628 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeHasSufficientPID" Jun 02 17:01:27.166389 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.166373 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-142.ec2.internal\" not found" node="ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.170707 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.170690 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-142.ec2.internal\" not found" node="ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.182886 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.182867 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.283099 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.283063 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.305582 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.305557 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16ef1a4fb8e42957ee653fae4905d861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal\" (UID: \"16ef1a4fb8e42957ee653fae4905d861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.305678 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.305584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87e6df01ce1c000adb1652ffb3234aa6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-142.ec2.internal\" (UID: \"87e6df01ce1c000adb1652ffb3234aa6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.305678 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.305602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16ef1a4fb8e42957ee653fae4905d861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal\" (UID: \"16ef1a4fb8e42957ee653fae4905d861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.383875 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.383792 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.406270 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.406241 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87e6df01ce1c000adb1652ffb3234aa6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-142.ec2.internal\" (UID: \"87e6df01ce1c000adb1652ffb3234aa6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.406327 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.406287 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16ef1a4fb8e42957ee653fae4905d861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal\" (UID: \"16ef1a4fb8e42957ee653fae4905d861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.406327 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.406319 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/87e6df01ce1c000adb1652ffb3234aa6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-142.ec2.internal\" (UID: \"87e6df01ce1c000adb1652ffb3234aa6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.406385 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.406315 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16ef1a4fb8e42957ee653fae4905d861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal\" (UID: \"16ef1a4fb8e42957ee653fae4905d861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.406419 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.406385 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/16ef1a4fb8e42957ee653fae4905d861-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal\" (UID: \"16ef1a4fb8e42957ee653fae4905d861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.406419 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.406390 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/16ef1a4fb8e42957ee653fae4905d861-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal\" (UID: \"16ef1a4fb8e42957ee653fae4905d861\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.470425 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.470379 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.473880 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.473861 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" Jun 02 17:01:27.484550 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.484531 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.585023 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.584967 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.685507 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.685404 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.786031 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.785981 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.823433 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.823392 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 17:01:27.824106 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.823543 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 17:01:27.824106 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.823543 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 17:01:27.886780 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.886735 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:27.905094 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.904934 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 17:01:27.910777 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.910740 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 16:56:26 +0000 UTC" deadline="2028-01-07 19:53:22.119905417 +0000 UTC" Jun 02 17:01:27.910777 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.910766 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14018h51m54.209141613s" Jun 02 17:01:27.927465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.927444 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 17:01:27.952300 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.952206 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpt8w" Jun 02 17:01:27.959632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:27.959600 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpt8w" Jun 02 17:01:27.987142 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:27.987109 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:28.018357 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:28.018327 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e6df01ce1c000adb1652ffb3234aa6.slice/crio-1211f743686614344c56d3f4b6bd9e24d9007c76ead8994e35d69f94ed3655db WatchSource:0}: Error finding container 1211f743686614344c56d3f4b6bd9e24d9007c76ead8994e35d69f94ed3655db: Status 404 returned error can't find the container with id 1211f743686614344c56d3f4b6bd9e24d9007c76ead8994e35d69f94ed3655db Jun 02 17:01:28.018570 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:28.018546 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ef1a4fb8e42957ee653fae4905d861.slice/crio-49adc3e07e82244b9426798c542f490c27a916703be9f12bcf733edd90680c5e WatchSource:0}: Error finding container 49adc3e07e82244b9426798c542f490c27a916703be9f12bcf733edd90680c5e: Status 404 returned error can't find the container with id 49adc3e07e82244b9426798c542f490c27a916703be9f12bcf733edd90680c5e Jun 02 17:01:28.021850 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.021834 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 17:01:28.040793 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.040756 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" event={"ID":"87e6df01ce1c000adb1652ffb3234aa6","Type":"ContainerStarted","Data":"1211f743686614344c56d3f4b6bd9e24d9007c76ead8994e35d69f94ed3655db"} Jun 02 17:01:28.041673 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.041647 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" event={"ID":"16ef1a4fb8e42957ee653fae4905d861","Type":"ContainerStarted","Data":"49adc3e07e82244b9426798c542f490c27a916703be9f12bcf733edd90680c5e"} Jun 02 17:01:28.059890 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.059864 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 17:01:28.088150 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:28.088124 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:28.188663 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:28.188625 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:28.289195 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:28.289093 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:28.389877 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:28.389844 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-142.ec2.internal\" not found" Jun 02 17:01:28.460244 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.460167 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 17:01:28.504464 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.504439 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" Jun 02 17:01:28.515101 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.515077 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 17:01:28.515898 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.515878 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" Jun 02 17:01:28.525655 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.525635 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 17:01:28.887636 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.887356 2555 apiserver.go:52] "Watching apiserver" Jun 02 17:01:28.896825 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.896782 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 17:01:28.897367 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.897343 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-sp2qr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk","openshift-cluster-node-tuning-operator/tuned-9zc25","openshift-dns/node-resolver-gmcgl","openshift-image-registry/node-ca-9bdw4","openshift-network-diagnostics/network-check-target-jfbct","openshift-ovn-kubernetes/ovnkube-node-47xpb","kube-system/konnectivity-agent-b9c6j","kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal","openshift-multus/multus-additional-cni-plugins-dhwn6","openshift-multus/multus-fzpwv","openshift-multus/network-metrics-daemon-pd7mm","openshift-network-operator/iptables-alerter-6pfph"] Jun 02 17:01:28.900886 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.900674 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.901002 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.900964 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:28.901065 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:28.901040 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:28.902476 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.902064 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.903339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.903318 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:28.904461 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.904439 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:28.905233 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.905216 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 17:01:28.905327 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.905219 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 17:01:28.905327 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.905308 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 17:01:28.905503 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.905440 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sm7gx\"" Jun 02 17:01:28.905503 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.905474 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 17:01:28.906315 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.906298 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:28.906420 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:28.906398 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:28.906880 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.906861 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 17:01:28.906962 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.906883 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wk88l\"" Jun 02 17:01:28.907700 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.907683 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:28.908168 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908151 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 17:01:28.908252 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908187 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 17:01:28.908314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908300 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-949x4\"" Jun 02 17:01:28.908391 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908373 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 17:01:28.908480 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908464 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w9hj4\"" Jun 02 17:01:28.908567 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908554 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 17:01:28.908614 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908598 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 17:01:28.908663 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908610 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 17:01:28.908719 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908690 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:01:28.908917 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.908896 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 17:01:28.910099 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.910081 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:28.911853 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.911834 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:01:28.912027 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.911990 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 17:01:28.912763 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.912738 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fzpwv" Jun 02 17:01:28.916300 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.916281 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-systemd-units\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.916389 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.916313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6429a92-f38c-4f60-869b-3aee5835318a-hosts-file\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:28.916389 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.916331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fc3cb36-c502-41e1-90ad-33255b0ace73-host\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:28.916389 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.916360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:28.916546 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.916528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7jbf\" (UniqueName: \"kubernetes.io/projected/522a9658-3edc-4e24-8e27-28625f1169c1-kube-api-access-t7jbf\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysctl-d\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.916739 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7fc3cb36-c502-41e1-90ad-33255b0ace73-serviceca\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-run-netns\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-var-lib-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920709 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920736 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-kubernetes\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.918787 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.918684 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.918288 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jxnsn\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.919230 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xq2d6\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920004 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:28.921171 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920765 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-sys\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.919250 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.920097 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.919143 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nbclr\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.918870 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.918952 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 17:01:28.921339 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.918016 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921328 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1484d6de-f208-4fdd-8bc0-f8de1955ed71-tmp\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921415 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dms7x\" (UniqueName: \"kubernetes.io/projected/7fc3cb36-c502-41e1-90ad-33255b0ace73-kube-api-access-dms7x\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.919207 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-etc-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921532 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-env-overrides\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921607 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-tuned\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921639 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk8gx\" (UniqueName: \"kubernetes.io/projected/1484d6de-f208-4fdd-8bc0-f8de1955ed71-kube-api-access-sk8gx\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921667 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-cni-netd\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.921706 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-slash\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-systemd\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-node-log\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922232 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-log-socket\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922728 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922242 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g8xd\" (UniqueName: \"kubernetes.io/projected/46629318-af6e-4221-8694-2f1cc2a21d9e-kube-api-access-5g8xd\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:28.922728 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922267 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-modprobe-d\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922728 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922289 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-systemd\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922728 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922315 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:28.922728 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922337 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-lib-modules\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922742 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-var-lib-kubelet\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6429a92-f38c-4f60-869b-3aee5835318a-tmp-dir\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-ovn\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-cni-bin\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922868 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-ovnkube-config\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysconfig\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysctl-conf\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-run\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.922956 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922956 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-host\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:28.923314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.922978 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdl8k\" (UniqueName: \"kubernetes.io/projected/f6429a92-f38c-4f60-869b-3aee5835318a-kube-api-access-qdl8k\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:28.923314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.923002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-ovnkube-script-lib\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.923314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.923048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/522a9658-3edc-4e24-8e27-28625f1169c1-ovn-node-metrics-cert\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.923314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.923088 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-kubelet\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:28.923314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.923289 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 17:01:28.924835 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.924796 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 17:01:28.924931 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.924918 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cjq7g\"" Jun 02 17:01:28.925098 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.925073 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 17:01:28.925154 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.925105 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 17:01:28.925154 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.925122 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 17:01:28.925251 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.925187 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9sl7g\"" Jun 02 17:01:28.960335 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.960303 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:56:27 +0000 UTC" deadline="2028-01-07 05:25:45.580129713 +0000 UTC" Jun 02 17:01:28.960335 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.960333 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14004h24m16.619799934s" Jun 02 17:01:28.962151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:28.962129 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 17:01:29.005505 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.005479 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 17:01:29.023265 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023233 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-socket-dir-parent\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.023434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023277 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/522a9658-3edc-4e24-8e27-28625f1169c1-ovn-node-metrics-cert\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.023434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.023434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023343 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-registration-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.023434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023369 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-multus-certs\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.023434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023395 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7jbf\" (UniqueName: \"kubernetes.io/projected/522a9658-3edc-4e24-8e27-28625f1169c1-kube-api-access-t7jbf\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.023434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023417 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysctl-d\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cfffe023-ff49-475e-9f39-beec941ef1fd-iptables-alerter-script\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023486 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhl4c\" (UniqueName: \"kubernetes.io/projected/d47f74ad-477f-403b-b259-65b3b57fa05c-kube-api-access-lhl4c\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p895j\" (UniqueName: \"kubernetes.io/projected/491c36f1-4223-4f5b-8dcf-fba0a99015ec-kube-api-access-p895j\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023578 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysctl-d\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023587 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-run-netns\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023637 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023658 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-run-netns\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023666 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-kubernetes\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023691 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1484d6de-f208-4fdd-8bc0-f8de1955ed71-tmp\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023715 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dms7x\" (UniqueName: \"kubernetes.io/projected/7fc3cb36-c502-41e1-90ad-33255b0ace73-kube-api-access-dms7x\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:29.023741 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023741 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-etc-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023755 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-kubernetes\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023794 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-etc-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023923 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-env-overrides\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023962 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-daemon-config\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.023980 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-systemd\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024000 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-modprobe-d\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-device-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gc2g\" (UniqueName: \"kubernetes.io/projected/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-kube-api-access-4gc2g\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024065 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024083 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024103 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd3d63de-f035-4b13-b443-b2669d1e523a-dbus\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024122 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024139 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-var-lib-kubelet\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-conf-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f8e92c1-5482-4a83-b7dc-01c3da765141-konnectivity-ca\") pod \"konnectivity-agent-b9c6j\" (UID: \"1f8e92c1-5482-4a83-b7dc-01c3da765141\") " pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024191 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-os-release\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.024297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024206 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd3d63de-f035-4b13-b443-b2669d1e523a-kubelet-config\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024204 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024208 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-modprobe-d\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024221 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-cni-bin\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024255 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-ovnkube-config\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024282 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-run\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024303 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-cni-bin\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.024310 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024333 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-host\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-var-lib-kubelet\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024345 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-systemd\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024416 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-run\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024428 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-env-overrides\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024452 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-host\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.024446 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs podName:46629318-af6e-4221-8694-2f1cc2a21d9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:29.524378575 +0000 UTC m=+3.011086016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs") pod "network-metrics-daemon-pd7mm" (UID: "46629318-af6e-4221-8694-2f1cc2a21d9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-kubelet\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-etc-kubernetes\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.025061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024605 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024650 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdl8k\" (UniqueName: \"kubernetes.io/projected/f6429a92-f38c-4f60-869b-3aee5835318a-kube-api-access-qdl8k\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024688 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-ovnkube-script-lib\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfffe023-ff49-475e-9f39-beec941ef1fd-host-slash\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024746 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-socket-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-sys-fs\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-cni-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024856 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024877 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-ovnkube-config\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024893 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-kubelet\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024932 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-systemd-units\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.024984 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-systemd-units\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-kubelet\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025016 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-os-release\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025043 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-k8s-cni-cncf-io\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025080 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-netns\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025105 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-hostroot\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.025607 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025132 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025159 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6429a92-f38c-4f60-869b-3aee5835318a-hosts-file\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025184 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fc3cb36-c502-41e1-90ad-33255b0ace73-host\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025212 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/522a9658-3edc-4e24-8e27-28625f1169c1-ovnkube-script-lib\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025217 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6429a92-f38c-4f60-869b-3aee5835318a-hosts-file\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025260 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fc3cb36-c502-41e1-90ad-33255b0ace73-host\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025260 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025299 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-system-cni-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025510 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-system-cni-dir\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025564 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7fc3cb36-c502-41e1-90ad-33255b0ace73-serviceca\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025590 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-var-lib-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025611 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-sys\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-cnibin\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025659 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-cni-multus\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025689 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025714 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025740 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-tuned\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.026354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025766 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sk8gx\" (UniqueName: \"kubernetes.io/projected/1484d6de-f208-4fdd-8bc0-f8de1955ed71-kube-api-access-sk8gx\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025792 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dgg\" (UniqueName: \"kubernetes.io/projected/cfffe023-ff49-475e-9f39-beec941ef1fd-kube-api-access-w5dgg\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025840 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-cni-netd\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025887 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-slash\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025913 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-node-log\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025937 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-log-socket\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025964 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5g8xd\" (UniqueName: \"kubernetes.io/projected/46629318-af6e-4221-8694-2f1cc2a21d9e-kube-api-access-5g8xd\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.025988 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-systemd\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026011 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-lib-modules\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026035 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-cni-binary-copy\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-cni-bin\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cnibin\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026118 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026146 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6429a92-f38c-4f60-869b-3aee5835318a-tmp-dir\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026179 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-ovn\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026212 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysconfig\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026234 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysctl-conf\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.027112 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026311 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f8e92c1-5482-4a83-b7dc-01c3da765141-agent-certs\") pod \"konnectivity-agent-b9c6j\" (UID: \"1f8e92c1-5482-4a83-b7dc-01c3da765141\") " pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026763 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7fc3cb36-c502-41e1-90ad-33255b0ace73-serviceca\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026852 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-var-lib-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026904 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-sys\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.026990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-openvswitch\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027036 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-run-ovn-kubernetes\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027339 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-lib-modules\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027584 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6429a92-f38c-4f60-869b-3aee5835318a-tmp-dir\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027590 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-cni-netd\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-host-slash\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027717 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-log-socket\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027759 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-node-log\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.027894 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysconfig\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.028391 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027906 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/522a9658-3edc-4e24-8e27-28625f1169c1-run-ovn\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.028391 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1484d6de-f208-4fdd-8bc0-f8de1955ed71-tmp\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.028391 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027977 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-systemd\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.028391 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.027996 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-sysctl-conf\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.028391 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.028124 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/522a9658-3edc-4e24-8e27-28625f1169c1-ovn-node-metrics-cert\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.030089 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.030067 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1484d6de-f208-4fdd-8bc0-f8de1955ed71-etc-tuned\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.031757 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.031729 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7jbf\" (UniqueName: \"kubernetes.io/projected/522a9658-3edc-4e24-8e27-28625f1169c1-kube-api-access-t7jbf\") pod \"ovnkube-node-47xpb\" (UID: \"522a9658-3edc-4e24-8e27-28625f1169c1\") " pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.032757 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.032659 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dms7x\" (UniqueName: \"kubernetes.io/projected/7fc3cb36-c502-41e1-90ad-33255b0ace73-kube-api-access-dms7x\") pod \"node-ca-9bdw4\" (UID: \"7fc3cb36-c502-41e1-90ad-33255b0ace73\") " pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:29.041849 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.041133 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 17:01:29.041849 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.041158 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 17:01:29.041849 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.041172 2555 projected.go:194] Error preparing data for projected volume kube-api-access-4zvwq for pod openshift-network-diagnostics/network-check-target-jfbct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:29.041849 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.041254 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq podName:3e07d9f5-8072-45ce-9445-6f63761014f3 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:29.541234947 +0000 UTC m=+3.027942387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4zvwq" (UniqueName: "kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq") pod "network-check-target-jfbct" (UID: "3e07d9f5-8072-45ce-9445-6f63761014f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:29.044434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.043843 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk8gx\" (UniqueName: \"kubernetes.io/projected/1484d6de-f208-4fdd-8bc0-f8de1955ed71-kube-api-access-sk8gx\") pod \"tuned-9zc25\" (UID: \"1484d6de-f208-4fdd-8bc0-f8de1955ed71\") " pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.044434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.044287 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g8xd\" (UniqueName: \"kubernetes.io/projected/46629318-af6e-4221-8694-2f1cc2a21d9e-kube-api-access-5g8xd\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:29.046994 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.046971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdl8k\" (UniqueName: \"kubernetes.io/projected/f6429a92-f38c-4f60-869b-3aee5835318a-kube-api-access-qdl8k\") pod \"node-resolver-gmcgl\" (UID: \"f6429a92-f38c-4f60-869b-3aee5835318a\") " pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:29.127125 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127091 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-cnibin\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127125 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127125 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-cni-multus\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127151 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dgg\" (UniqueName: \"kubernetes.io/projected/cfffe023-ff49-475e-9f39-beec941ef1fd-kube-api-access-w5dgg\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127182 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-cni-binary-copy\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127206 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-cni-bin\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127213 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-cnibin\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127230 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cnibin\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127227 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-cni-multus\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127261 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127275 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-cni-bin\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127296 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127321 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f8e92c1-5482-4a83-b7dc-01c3da765141-agent-certs\") pod \"konnectivity-agent-b9c6j\" (UID: \"1f8e92c1-5482-4a83-b7dc-01c3da765141\") " pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:29.127341 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127344 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-socket-dir-parent\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127363 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cnibin\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127373 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127395 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-registration-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127419 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-multus-certs\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127458 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cfffe023-ff49-475e-9f39-beec941ef1fd-iptables-alerter-script\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127485 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhl4c\" (UniqueName: \"kubernetes.io/projected/d47f74ad-477f-403b-b259-65b3b57fa05c-kube-api-access-lhl4c\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127489 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127516 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p895j\" (UniqueName: \"kubernetes.io/projected/491c36f1-4223-4f5b-8dcf-fba0a99015ec-kube-api-access-p895j\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127548 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-socket-dir-parent\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127601 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127644 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-daemon-config\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127675 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-device-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127701 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gc2g\" (UniqueName: \"kubernetes.io/projected/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-kube-api-access-4gc2g\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127728 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127754 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd3d63de-f035-4b13-b443-b2669d1e523a-dbus\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.127831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127797 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-conf-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127840 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f8e92c1-5482-4a83-b7dc-01c3da765141-konnectivity-ca\") pod \"konnectivity-agent-b9c6j\" (UID: \"1f8e92c1-5482-4a83-b7dc-01c3da765141\") " pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127861 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-registration-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127869 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-cni-binary-copy\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127861 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127866 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-os-release\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127924 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd3d63de-f035-4b13-b443-b2669d1e523a-kubelet-config\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127956 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-kubelet\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.127980 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-etc-kubernetes\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128004 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128013 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-multus-certs\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128035 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfffe023-ff49-475e-9f39-beec941ef1fd-host-slash\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128060 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-socket-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128069 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-device-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128083 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-sys-fs\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128084 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-etc-kubernetes\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128143 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-sys-fs\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.128328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128165 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-var-lib-kubelet\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128178 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cfffe023-ff49-475e-9f39-beec941ef1fd-host-slash\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d47f74ad-477f-403b-b259-65b3b57fa05c-socket-dir\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128236 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-cni-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128241 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-os-release\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128263 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128290 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-os-release\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128290 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fd3d63de-f035-4b13-b443-b2669d1e523a-dbus\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128338 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-cni-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128342 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fd3d63de-f035-4b13-b443-b2669d1e523a-kubelet-config\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128338 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-k8s-cni-cncf-io\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128377 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-netns\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128390 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-os-release\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128431 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-k8s-cni-cncf-io\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.128446 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128476 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-conf-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128499 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-hostroot\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.128946 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128523 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.128545 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret podName:fd3d63de-f035-4b13-b443-b2669d1e523a nodeName:}" failed. No retries permitted until 2026-06-02 17:01:29.628527503 +0000 UTC m=+3.115234936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret") pod "global-pull-secret-syncer-sp2qr" (UID: "fd3d63de-f035-4b13-b443-b2669d1e523a") : object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128559 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128596 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128613 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-host-run-netns\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128641 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cfffe023-ff49-475e-9f39-beec941ef1fd-iptables-alerter-script\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128650 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-hostroot\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128720 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-multus-daemon-config\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128726 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-system-cni-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128775 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-system-cni-dir\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128818 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-system-cni-dir\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/491c36f1-4223-4f5b-8dcf-fba0a99015ec-system-cni-dir\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.128990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/491c36f1-4223-4f5b-8dcf-fba0a99015ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.129622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.129201 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f8e92c1-5482-4a83-b7dc-01c3da765141-konnectivity-ca\") pod \"konnectivity-agent-b9c6j\" (UID: \"1f8e92c1-5482-4a83-b7dc-01c3da765141\") " pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:29.130080 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.130007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f8e92c1-5482-4a83-b7dc-01c3da765141-agent-certs\") pod \"konnectivity-agent-b9c6j\" (UID: \"1f8e92c1-5482-4a83-b7dc-01c3da765141\") " pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:29.138845 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.138768 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dgg\" (UniqueName: \"kubernetes.io/projected/cfffe023-ff49-475e-9f39-beec941ef1fd-kube-api-access-w5dgg\") pod \"iptables-alerter-6pfph\" (UID: \"cfffe023-ff49-475e-9f39-beec941ef1fd\") " pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.139348 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.139331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p895j\" (UniqueName: \"kubernetes.io/projected/491c36f1-4223-4f5b-8dcf-fba0a99015ec-kube-api-access-p895j\") pod \"multus-additional-cni-plugins-dhwn6\" (UID: \"491c36f1-4223-4f5b-8dcf-fba0a99015ec\") " pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.146633 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.146614 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gc2g\" (UniqueName: \"kubernetes.io/projected/b1d034b8-85c8-44bf-ac99-ee9c72a3842d-kube-api-access-4gc2g\") pod \"multus-fzpwv\" (UID: \"b1d034b8-85c8-44bf-ac99-ee9c72a3842d\") " pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.146747 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.146674 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhl4c\" (UniqueName: \"kubernetes.io/projected/d47f74ad-477f-403b-b259-65b3b57fa05c-kube-api-access-lhl4c\") pod \"aws-ebs-csi-driver-node-jvfbk\" (UID: \"d47f74ad-477f-403b-b259-65b3b57fa05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.220907 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.220869 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:29.227729 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.227701 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zc25" Jun 02 17:01:29.235476 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.235450 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gmcgl" Jun 02 17:01:29.242141 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.242120 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bdw4" Jun 02 17:01:29.250796 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.250777 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6pfph" Jun 02 17:01:29.259437 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.259416 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:29.268028 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.268006 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fzpwv" Jun 02 17:01:29.274671 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.274647 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" Jun 02 17:01:29.283330 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.283308 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" Jun 02 17:01:29.297272 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.297249 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 17:01:29.530972 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.530883 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:29.531124 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.531036 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:29.531124 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.531102 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs podName:46629318-af6e-4221-8694-2f1cc2a21d9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:30.531084414 +0000 UTC m=+4.017791850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs") pod "network-metrics-daemon-pd7mm" (UID: "46629318-af6e-4221-8694-2f1cc2a21d9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:29.631690 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.631656 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:29.631917 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.631706 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:29.631917 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.631845 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:29.631917 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.631875 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 17:01:29.631917 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.631889 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 17:01:29.631917 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.631900 2555 projected.go:194] Error preparing data for projected volume kube-api-access-4zvwq for pod openshift-network-diagnostics/network-check-target-jfbct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:29.631917 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.631918 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret podName:fd3d63de-f035-4b13-b443-b2669d1e523a nodeName:}" failed. No retries permitted until 2026-06-02 17:01:30.631898754 +0000 UTC m=+4.118606194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret") pod "global-pull-secret-syncer-sp2qr" (UID: "fd3d63de-f035-4b13-b443-b2669d1e523a") : object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:29.632208 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:29.631937 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq podName:3e07d9f5-8072-45ce-9445-6f63761014f3 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:30.631926484 +0000 UTC m=+4.118633909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zvwq" (UniqueName: "kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq") pod "network-check-target-jfbct" (UID: "3e07d9f5-8072-45ce-9445-6f63761014f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:29.679091 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.679057 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8e92c1_5482_4a83_b7dc_01c3da765141.slice/crio-5336ed61886ac446d8781396cd37340cb380f1067b3ec582579bb48f2e720d7e WatchSource:0}: Error finding container 5336ed61886ac446d8781396cd37340cb380f1067b3ec582579bb48f2e720d7e: Status 404 returned error can't find the container with id 5336ed61886ac446d8781396cd37340cb380f1067b3ec582579bb48f2e720d7e Jun 02 17:01:29.680371 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.680345 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d034b8_85c8_44bf_ac99_ee9c72a3842d.slice/crio-7c95709301a10b4e367b400c61053e889d55806ae6ade3b9788f0e415c650f2d WatchSource:0}: Error finding container 7c95709301a10b4e367b400c61053e889d55806ae6ade3b9788f0e415c650f2d: Status 404 returned error can't find the container with id 7c95709301a10b4e367b400c61053e889d55806ae6ade3b9788f0e415c650f2d Jun 02 17:01:29.681158 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.681138 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522a9658_3edc_4e24_8e27_28625f1169c1.slice/crio-43b78f892cf660e00950d3abe6bc857584b500f8523a573ad960c2f2c5839112 WatchSource:0}: Error finding container 43b78f892cf660e00950d3abe6bc857584b500f8523a573ad960c2f2c5839112: Status 404 returned error can't find the container with id 43b78f892cf660e00950d3abe6bc857584b500f8523a573ad960c2f2c5839112 Jun 02 17:01:29.683467 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.683397 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc3cb36_c502_41e1_90ad_33255b0ace73.slice/crio-ca34e8ea3048561ed71e42afca1514ec675bc118d25f2a5c284702b6da03d287 WatchSource:0}: Error finding container ca34e8ea3048561ed71e42afca1514ec675bc118d25f2a5c284702b6da03d287: Status 404 returned error can't find the container with id ca34e8ea3048561ed71e42afca1514ec675bc118d25f2a5c284702b6da03d287 Jun 02 17:01:29.685249 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.685157 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1484d6de_f208_4fdd_8bc0_f8de1955ed71.slice/crio-b230e1277853e1cf511b9a89bd66204b1f32d0c48c6aee3a7871cd6a3398e7aa WatchSource:0}: Error finding container b230e1277853e1cf511b9a89bd66204b1f32d0c48c6aee3a7871cd6a3398e7aa: Status 404 returned error can't find the container with id b230e1277853e1cf511b9a89bd66204b1f32d0c48c6aee3a7871cd6a3398e7aa Jun 02 17:01:29.687632 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.687584 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47f74ad_477f_403b_b259_65b3b57fa05c.slice/crio-ea4a40cff604ded25a972c070bed21951c5d30590bfe8684d0bd9d304bae2f0d WatchSource:0}: Error finding container ea4a40cff604ded25a972c070bed21951c5d30590bfe8684d0bd9d304bae2f0d: Status 404 returned error can't find the container with id ea4a40cff604ded25a972c070bed21951c5d30590bfe8684d0bd9d304bae2f0d Jun 02 17:01:29.689384 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.688876 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6429a92_f38c_4f60_869b_3aee5835318a.slice/crio-d955d70db94b14e8f6fbff3a290758fab13297b027a982514734bad4d090bba6 WatchSource:0}: Error finding container d955d70db94b14e8f6fbff3a290758fab13297b027a982514734bad4d090bba6: Status 404 returned error can't find the container with id d955d70db94b14e8f6fbff3a290758fab13297b027a982514734bad4d090bba6 Jun 02 17:01:29.690204 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:01:29.690171 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfffe023_ff49_475e_9f39_beec941ef1fd.slice/crio-be5df266c67dac7fe6ec12ae52b2350446d02f47305a83245199c6e9e4ee6ddd WatchSource:0}: Error finding container be5df266c67dac7fe6ec12ae52b2350446d02f47305a83245199c6e9e4ee6ddd: Status 404 returned error can't find the container with id be5df266c67dac7fe6ec12ae52b2350446d02f47305a83245199c6e9e4ee6ddd Jun 02 17:01:29.960558 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.960531 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:56:27 +0000 UTC" deadline="2027-12-03 00:46:20.562223466 +0000 UTC" Jun 02 17:01:29.961007 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:29.960558 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13159h44m50.60166844s" Jun 02 17:01:30.037780 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.037745 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:30.037966 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.037788 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:30.037966 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.037883 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:30.038076 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.037994 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:30.047599 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.047568 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gmcgl" event={"ID":"f6429a92-f38c-4f60-869b-3aee5835318a","Type":"ContainerStarted","Data":"d955d70db94b14e8f6fbff3a290758fab13297b027a982514734bad4d090bba6"} Jun 02 17:01:30.048685 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.048659 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerStarted","Data":"c6c6666554f5c45f2e5a1733441da9deee5788acec715877fa8b887e6b5d313c"} Jun 02 17:01:30.049605 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.049587 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6pfph" event={"ID":"cfffe023-ff49-475e-9f39-beec941ef1fd","Type":"ContainerStarted","Data":"be5df266c67dac7fe6ec12ae52b2350446d02f47305a83245199c6e9e4ee6ddd"} Jun 02 17:01:30.050609 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.050587 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" event={"ID":"d47f74ad-477f-403b-b259-65b3b57fa05c","Type":"ContainerStarted","Data":"ea4a40cff604ded25a972c070bed21951c5d30590bfe8684d0bd9d304bae2f0d"} Jun 02 17:01:30.051655 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.051609 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bdw4" event={"ID":"7fc3cb36-c502-41e1-90ad-33255b0ace73","Type":"ContainerStarted","Data":"ca34e8ea3048561ed71e42afca1514ec675bc118d25f2a5c284702b6da03d287"} Jun 02 17:01:30.052873 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.052849 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"43b78f892cf660e00950d3abe6bc857584b500f8523a573ad960c2f2c5839112"} Jun 02 17:01:30.054046 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.054020 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fzpwv" event={"ID":"b1d034b8-85c8-44bf-ac99-ee9c72a3842d","Type":"ContainerStarted","Data":"7c95709301a10b4e367b400c61053e889d55806ae6ade3b9788f0e415c650f2d"} Jun 02 17:01:30.055722 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.055699 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" event={"ID":"87e6df01ce1c000adb1652ffb3234aa6","Type":"ContainerStarted","Data":"e09d8dcecb0b15ccf3b637c7bb97f3f9fc52041bb4fcee4d2952e1839f81387d"} Jun 02 17:01:30.057309 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.057284 2555 generic.go:358] "Generic (PLEG): container finished" podID="16ef1a4fb8e42957ee653fae4905d861" containerID="5c4919b4e596bf27cf38db0180e557faacdbc5bae9c3f822b8908e59d6e6f520" exitCode=0 Jun 02 17:01:30.057400 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.057357 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" event={"ID":"16ef1a4fb8e42957ee653fae4905d861","Type":"ContainerDied","Data":"5c4919b4e596bf27cf38db0180e557faacdbc5bae9c3f822b8908e59d6e6f520"} Jun 02 17:01:30.058679 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.058658 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zc25" event={"ID":"1484d6de-f208-4fdd-8bc0-f8de1955ed71","Type":"ContainerStarted","Data":"b230e1277853e1cf511b9a89bd66204b1f32d0c48c6aee3a7871cd6a3398e7aa"} Jun 02 17:01:30.059718 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.059692 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b9c6j" event={"ID":"1f8e92c1-5482-4a83-b7dc-01c3da765141","Type":"ContainerStarted","Data":"5336ed61886ac446d8781396cd37340cb380f1067b3ec582579bb48f2e720d7e"} Jun 02 17:01:30.069756 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.069711 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-142.ec2.internal" podStartSLOduration=2.0696976 podStartE2EDuration="2.0696976s" podCreationTimestamp="2026-06-02 17:01:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:01:30.069338468 +0000 UTC m=+3.556045919" watchObservedRunningTime="2026-06-02 17:01:30.0696976 +0000 UTC m=+3.556405049" Jun 02 17:01:30.538315 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.537643 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:30.538315 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.537844 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:30.538315 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.537920 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs podName:46629318-af6e-4221-8694-2f1cc2a21d9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:32.537901651 +0000 UTC m=+6.024609086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs") pod "network-metrics-daemon-pd7mm" (UID: "46629318-af6e-4221-8694-2f1cc2a21d9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:30.638839 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.638786 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:30.639019 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:30.638858 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:30.639019 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.638989 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 17:01:30.639019 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.639005 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 17:01:30.639019 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.639017 2555 projected.go:194] Error preparing data for projected volume kube-api-access-4zvwq for pod openshift-network-diagnostics/network-check-target-jfbct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:30.639230 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.639075 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq podName:3e07d9f5-8072-45ce-9445-6f63761014f3 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:32.639057487 +0000 UTC m=+6.125764915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zvwq" (UniqueName: "kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq") pod "network-check-target-jfbct" (UID: "3e07d9f5-8072-45ce-9445-6f63761014f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:30.639462 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.639444 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:30.639527 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:30.639500 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret podName:fd3d63de-f035-4b13-b443-b2669d1e523a nodeName:}" failed. No retries permitted until 2026-06-02 17:01:32.639484234 +0000 UTC m=+6.126191660 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret") pod "global-pull-secret-syncer-sp2qr" (UID: "fd3d63de-f035-4b13-b443-b2669d1e523a") : object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:31.038955 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:31.038927 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:31.039401 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:31.039071 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:31.078094 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:31.078055 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" event={"ID":"16ef1a4fb8e42957ee653fae4905d861","Type":"ContainerStarted","Data":"d5954e27697ea5c93cd9ec3fc27b43d0715a0f2cafed8e7d3413964e8211710a"} Jun 02 17:01:31.093694 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:31.093445 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-142.ec2.internal" podStartSLOduration=3.093425884 podStartE2EDuration="3.093425884s" podCreationTimestamp="2026-06-02 17:01:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:01:31.092819839 +0000 UTC m=+4.579527276" watchObservedRunningTime="2026-06-02 17:01:31.093425884 +0000 UTC m=+4.580133333" Jun 02 17:01:32.037707 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:32.037670 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:32.037924 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.037820 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:32.038218 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:32.038199 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:32.038313 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.038290 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:32.556314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:32.556282 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:32.556651 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.556416 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:32.556651 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.556479 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs podName:46629318-af6e-4221-8694-2f1cc2a21d9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:36.556458619 +0000 UTC m=+10.043166049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs") pod "network-metrics-daemon-pd7mm" (UID: "46629318-af6e-4221-8694-2f1cc2a21d9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:32.657475 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:32.657360 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:32.657475 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:32.657409 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:32.657718 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.657551 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:32.657718 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.657565 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 17:01:32.657718 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.657584 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 17:01:32.657718 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.657596 2555 projected.go:194] Error preparing data for projected volume kube-api-access-4zvwq for pod openshift-network-diagnostics/network-check-target-jfbct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:32.657718 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.657623 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret podName:fd3d63de-f035-4b13-b443-b2669d1e523a nodeName:}" failed. No retries permitted until 2026-06-02 17:01:36.657602219 +0000 UTC m=+10.144309659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret") pod "global-pull-secret-syncer-sp2qr" (UID: "fd3d63de-f035-4b13-b443-b2669d1e523a") : object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:32.657718 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:32.657647 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq podName:3e07d9f5-8072-45ce-9445-6f63761014f3 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:36.657630751 +0000 UTC m=+10.144338176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zvwq" (UniqueName: "kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq") pod "network-check-target-jfbct" (UID: "3e07d9f5-8072-45ce-9445-6f63761014f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:33.039911 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:33.039828 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:33.040075 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:33.039981 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:34.037728 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:34.037686 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:34.038201 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:34.037842 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:34.038201 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:34.038045 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:34.038201 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:34.038148 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:35.038489 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:35.038076 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:35.038489 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:35.038208 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:36.038594 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:36.037958 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:36.038594 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.038101 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:36.038594 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:36.038466 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:36.038594 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.038549 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:36.593299 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:36.592682 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:36.593299 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.592888 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:36.593299 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.592982 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs podName:46629318-af6e-4221-8694-2f1cc2a21d9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:44.592963745 +0000 UTC m=+18.079671179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs") pod "network-metrics-daemon-pd7mm" (UID: "46629318-af6e-4221-8694-2f1cc2a21d9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:36.693129 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:36.693089 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:36.693303 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:36.693149 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:36.693367 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.693342 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 17:01:36.693367 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.693361 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 17:01:36.693432 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.693374 2555 projected.go:194] Error preparing data for projected volume kube-api-access-4zvwq for pod openshift-network-diagnostics/network-check-target-jfbct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:36.693475 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.693437 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq podName:3e07d9f5-8072-45ce-9445-6f63761014f3 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:44.693417733 +0000 UTC m=+18.180125161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zvwq" (UniqueName: "kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq") pod "network-check-target-jfbct" (UID: "3e07d9f5-8072-45ce-9445-6f63761014f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:36.693859 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.693837 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:36.693979 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:36.693891 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret podName:fd3d63de-f035-4b13-b443-b2669d1e523a nodeName:}" failed. No retries permitted until 2026-06-02 17:01:44.693877269 +0000 UTC m=+18.180584697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret") pod "global-pull-secret-syncer-sp2qr" (UID: "fd3d63de-f035-4b13-b443-b2669d1e523a") : object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:37.040328 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:37.040246 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:37.040743 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:37.040402 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:38.038011 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:38.037975 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:38.038258 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:38.038107 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:38.038494 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:38.038475 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:38.038578 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:38.038559 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:39.039907 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:39.039874 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:39.040399 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:39.040007 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:40.037492 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:40.037450 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:40.037492 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:40.037468 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:40.037710 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:40.037574 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:40.037769 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:40.037703 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:41.037573 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:41.037531 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:41.038108 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:41.037675 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:42.038308 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:42.038274 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:42.038308 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:42.038308 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:42.038796 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:42.038395 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:42.038796 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:42.038520 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:43.038244 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:43.038214 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:43.038445 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:43.038351 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:44.037938 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:44.037900 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:44.037938 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:44.037939 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:44.038191 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.038024 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:44.038191 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.038157 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:44.659961 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:44.659923 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:44.660350 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.660083 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:44.660350 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.660139 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs podName:46629318-af6e-4221-8694-2f1cc2a21d9e nodeName:}" failed. No retries permitted until 2026-06-02 17:02:00.660124597 +0000 UTC m=+34.146832027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs") pod "network-metrics-daemon-pd7mm" (UID: "46629318-af6e-4221-8694-2f1cc2a21d9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:01:44.760412 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:44.760375 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:44.760580 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:44.760428 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:44.760580 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.760506 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:44.760580 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.760538 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 17:01:44.760580 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.760554 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 17:01:44.760580 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.760566 2555 projected.go:194] Error preparing data for projected volume kube-api-access-4zvwq for pod openshift-network-diagnostics/network-check-target-jfbct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:44.760580 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.760569 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret podName:fd3d63de-f035-4b13-b443-b2669d1e523a nodeName:}" failed. No retries permitted until 2026-06-02 17:02:00.760552635 +0000 UTC m=+34.247260065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret") pod "global-pull-secret-syncer-sp2qr" (UID: "fd3d63de-f035-4b13-b443-b2669d1e523a") : object "kube-system"/"original-pull-secret" not registered Jun 02 17:01:44.760891 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:44.760606 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq podName:3e07d9f5-8072-45ce-9445-6f63761014f3 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:00.760595854 +0000 UTC m=+34.247303286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zvwq" (UniqueName: "kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq") pod "network-check-target-jfbct" (UID: "3e07d9f5-8072-45ce-9445-6f63761014f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:01:45.037862 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:45.037764 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:45.038016 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:45.037916 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:46.038248 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:46.038209 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:46.038764 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:46.038213 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:46.038764 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:46.038328 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:46.038764 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:46.038421 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:47.038597 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:47.038561 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:47.039065 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:47.038677 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:48.037325 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.037283 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:48.037401 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:48.037378 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:48.037502 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.037454 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:48.037551 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:48.037531 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:48.112831 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.112588 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gmcgl" event={"ID":"f6429a92-f38c-4f60-869b-3aee5835318a","Type":"ContainerStarted","Data":"a5c543de75a1cabc3272568c0a57c9f34f2e7ba45aaeab0de728d7dcbd828ad3"} Jun 02 17:01:48.114776 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.114749 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" event={"ID":"d47f74ad-477f-403b-b259-65b3b57fa05c","Type":"ContainerStarted","Data":"0a0e909b2c8b70118d5bf6ff424738323eeccf12baab7e5d0993dd9c3f18f7b9"} Jun 02 17:01:48.119265 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.119223 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bdw4" event={"ID":"7fc3cb36-c502-41e1-90ad-33255b0ace73","Type":"ContainerStarted","Data":"4ca8eb0a888b34fbf9c01711b7ce21d596bc52533e0f4a2c604106d9e5c26cab"} Jun 02 17:01:48.121857 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.121759 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b9c6j" event={"ID":"1f8e92c1-5482-4a83-b7dc-01c3da765141","Type":"ContainerStarted","Data":"95cce49733b73f55976f24a4cdacfc91ca746e910f6d5799a5f848a4ea9cbb30"} Jun 02 17:01:48.150130 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.149749 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-gmcgl" podStartSLOduration=2.99496784 podStartE2EDuration="21.149730404s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.692073114 +0000 UTC m=+3.178780544" lastFinishedPulling="2026-06-02 17:01:47.846835666 +0000 UTC m=+21.333543108" observedRunningTime="2026-06-02 17:01:48.134010917 +0000 UTC m=+21.620718365" watchObservedRunningTime="2026-06-02 17:01:48.149730404 +0000 UTC m=+21.636437864" Jun 02 17:01:48.150674 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.150632 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b9c6j" podStartSLOduration=3.045455944 podStartE2EDuration="21.150617161s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.680916536 +0000 UTC m=+3.167623961" lastFinishedPulling="2026-06-02 17:01:47.78607775 +0000 UTC m=+21.272785178" observedRunningTime="2026-06-02 17:01:48.149455324 +0000 UTC m=+21.636162771" watchObservedRunningTime="2026-06-02 17:01:48.150617161 +0000 UTC m=+21.637324610" Jun 02 17:01:48.163877 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:48.163839 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9bdw4" podStartSLOduration=3.064040497 podStartE2EDuration="21.163824852s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.686283072 +0000 UTC m=+3.172990511" lastFinishedPulling="2026-06-02 17:01:47.786067437 +0000 UTC m=+21.272774866" observedRunningTime="2026-06-02 17:01:48.163556678 +0000 UTC m=+21.650264129" watchObservedRunningTime="2026-06-02 17:01:48.163824852 +0000 UTC m=+21.650532295" Jun 02 17:01:49.037588 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.037513 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:49.037736 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:49.037651 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:49.067952 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.067924 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:49.068589 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.068570 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:49.125360 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.125196 2555 generic.go:358] "Generic (PLEG): container finished" podID="491c36f1-4223-4f5b-8dcf-fba0a99015ec" containerID="c7a4ecb99742ceb82fc905a8b09027514c328e5a32be5961b0efe7058ccd96b6" exitCode=0 Jun 02 17:01:49.125727 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.125283 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerDied","Data":"c7a4ecb99742ceb82fc905a8b09027514c328e5a32be5961b0efe7058ccd96b6"} Jun 02 17:01:49.128199 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128110 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:01:49.131139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128737 2555 generic.go:358] "Generic (PLEG): container finished" podID="522a9658-3edc-4e24-8e27-28625f1169c1" containerID="9f30b49a758475c21f019d8f3603bbd1597789ddf241f2d2a4d8a22e9174e87f" exitCode=1 Jun 02 17:01:49.131139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128864 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"46df3546e2985f3c35cb9ab99e5fa17777dc7ef7fa06bcca0c850543af1deefb"} Jun 02 17:01:49.131139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128890 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"9d21b8e85efb998d48d8a51a290056fc082f5fbc604545ce3db24c998abdff1b"} Jun 02 17:01:49.131139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128905 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"8e8bdf278d6f1ed53c882742597b7d70acf8fc8407314b2efdf1b60784e5409f"} Jun 02 17:01:49.131139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128919 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"cd000f38f115c41ff2800949d4acf75e98fc3721fb2e39785a7f8adf5c25e23f"} Jun 02 17:01:49.131139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128931 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerDied","Data":"9f30b49a758475c21f019d8f3603bbd1597789ddf241f2d2a4d8a22e9174e87f"} Jun 02 17:01:49.131139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.128953 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"59b0ac615bb1d5228bbf09724b3b36b54f13917873e2e53f35c604b9e1197901"} Jun 02 17:01:49.132583 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.132558 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fzpwv" event={"ID":"b1d034b8-85c8-44bf-ac99-ee9c72a3842d","Type":"ContainerStarted","Data":"95ffe4b6265dab77c6e379cda8a038e2068f8516bbd36a603e41e7a97d5de46b"} Jun 02 17:01:49.133859 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.133838 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zc25" event={"ID":"1484d6de-f208-4fdd-8bc0-f8de1955ed71","Type":"ContainerStarted","Data":"624e49a5c685b6a6677d98d1124925f7ce7aa1b7d5d88616d2afd5b676262758"} Jun 02 17:01:49.161183 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.161129 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9zc25" podStartSLOduration=4.003403626 podStartE2EDuration="22.161116056s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.689137401 +0000 UTC m=+3.175844829" lastFinishedPulling="2026-06-02 17:01:47.846849822 +0000 UTC m=+21.333557259" observedRunningTime="2026-06-02 17:01:49.160826407 +0000 UTC m=+22.647533847" watchObservedRunningTime="2026-06-02 17:01:49.161116056 +0000 UTC m=+22.647823504" Jun 02 17:01:49.179038 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.178993 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-fzpwv" podStartSLOduration=3.945976508 podStartE2EDuration="22.178980782s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.682367794 +0000 UTC m=+3.169075219" lastFinishedPulling="2026-06-02 17:01:47.915372065 +0000 UTC m=+21.402079493" observedRunningTime="2026-06-02 17:01:49.178645794 +0000 UTC m=+22.665353243" watchObservedRunningTime="2026-06-02 17:01:49.178980782 +0000 UTC m=+22.665688229" Jun 02 17:01:49.525893 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.525864 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 17:01:49.557089 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.557068 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:49.557536 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.557514 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b9c6j" Jun 02 17:01:49.973114 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.973018 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T17:01:49.525888437Z","UUID":"82e799ed-792d-448a-b015-d7c42c251efe","Handler":null,"Name":"","Endpoint":""} Jun 02 17:01:49.975302 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.975274 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 17:01:49.975443 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:49.975310 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 17:01:50.038223 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:50.038192 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:50.038376 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:50.038198 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:50.038376 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:50.038292 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:50.038376 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:50.038347 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:50.137157 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:50.137116 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" event={"ID":"d47f74ad-477f-403b-b259-65b3b57fa05c","Type":"ContainerStarted","Data":"1aa2d9068554e96356f132993c887db93bd57ed500e4d3c42a9f989b84973853"} Jun 02 17:01:50.138602 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:50.138572 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6pfph" event={"ID":"cfffe023-ff49-475e-9f39-beec941ef1fd","Type":"ContainerStarted","Data":"e8857f6834d0449ab703fcf36bef822f2fe5b5e6962ef8d24429c111e9993912"} Jun 02 17:01:50.153715 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:50.153668 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6pfph" podStartSLOduration=4.971707296 podStartE2EDuration="23.153653412s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.693718718 +0000 UTC m=+3.180426145" lastFinishedPulling="2026-06-02 17:01:47.875664826 +0000 UTC m=+21.362372261" observedRunningTime="2026-06-02 17:01:50.153439699 +0000 UTC m=+23.640147147" watchObservedRunningTime="2026-06-02 17:01:50.153653412 +0000 UTC m=+23.640360859" Jun 02 17:01:51.037936 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:51.037901 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:51.038080 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:51.038040 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:51.143357 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:51.143336 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:01:51.143974 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:51.143956 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"68bbe1f71a39b0ca00bd52a48a231fd062d09dddae463cbe900d7ed8bb6bc728"} Jun 02 17:01:52.038167 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:52.038131 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:52.038346 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:52.038131 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:52.038346 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:52.038265 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:52.038469 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:52.038364 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:52.148355 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:52.148321 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" event={"ID":"d47f74ad-477f-403b-b259-65b3b57fa05c","Type":"ContainerStarted","Data":"c48b941eb23ad7a7817a9f45890c4851c61152250df7aa84390e7fd9d7cf7d70"} Jun 02 17:01:52.170654 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:52.170586 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvfbk" podStartSLOduration=3.801498596 podStartE2EDuration="25.170571168s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.692449469 +0000 UTC m=+3.179156897" lastFinishedPulling="2026-06-02 17:01:51.06152203 +0000 UTC m=+24.548229469" observedRunningTime="2026-06-02 17:01:52.170554321 +0000 UTC m=+25.657261769" watchObservedRunningTime="2026-06-02 17:01:52.170571168 +0000 UTC m=+25.657278612" Jun 02 17:01:53.040233 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.039817 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:53.040233 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:53.040105 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:53.154426 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.154393 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:01:53.154973 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.154944 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"050bbb5433fe3ba50afc079a8bf48d26881c799e954002e1fc6c3c64c652579d"} Jun 02 17:01:53.155849 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.155576 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:53.155849 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.155636 2555 scope.go:117] "RemoveContainer" containerID="9f30b49a758475c21f019d8f3603bbd1597789ddf241f2d2a4d8a22e9174e87f" Jun 02 17:01:53.155849 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.155696 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:53.155849 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.155780 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:53.177954 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.177866 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:53.178136 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:53.178091 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:01:54.038107 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.038071 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:54.038303 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.038087 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:54.038303 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:54.038173 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:54.038303 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:54.038264 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:54.160314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.160287 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:01:54.160758 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.160720 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" event={"ID":"522a9658-3edc-4e24-8e27-28625f1169c1","Type":"ContainerStarted","Data":"12fd8bb2244e8b47084ac9703465d208b6a45774df1187f6067575c04be47421"} Jun 02 17:01:54.216349 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.216291 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" podStartSLOduration=8.746238379 podStartE2EDuration="27.216271622s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.683603099 +0000 UTC m=+3.170310527" lastFinishedPulling="2026-06-02 17:01:48.153636331 +0000 UTC m=+21.640343770" observedRunningTime="2026-06-02 17:01:54.215884186 +0000 UTC m=+27.702591636" watchObservedRunningTime="2026-06-02 17:01:54.216271622 +0000 UTC m=+27.702979069" Jun 02 17:01:54.961357 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.961308 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sp2qr"] Jun 02 17:01:54.961547 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.961430 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:54.961612 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:54.961553 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:54.961848 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.961825 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfbct"] Jun 02 17:01:54.961944 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.961899 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:54.962055 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:54.961990 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:54.964103 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.964080 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pd7mm"] Jun 02 17:01:54.964208 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:54.964196 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:54.964323 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:54.964303 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:56.168154 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:56.167974 2555 generic.go:358] "Generic (PLEG): container finished" podID="491c36f1-4223-4f5b-8dcf-fba0a99015ec" containerID="300c1e21abfcd634d5cfed20df1280e7b61b16466c7ae759bbdf14d2e0939f89" exitCode=0 Jun 02 17:01:56.168514 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:56.168063 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerDied","Data":"300c1e21abfcd634d5cfed20df1280e7b61b16466c7ae759bbdf14d2e0939f89"} Jun 02 17:01:57.038698 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:57.038672 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:57.038865 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:57.038849 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:57.038920 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:57.038796 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:57.038968 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:57.038937 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:01:57.039008 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:57.038975 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:57.039067 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:57.039050 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:58.173944 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:58.173910 2555 generic.go:358] "Generic (PLEG): container finished" podID="491c36f1-4223-4f5b-8dcf-fba0a99015ec" containerID="85b02f2faf8f3483b422c6da1fc2cc83d260196cfa921430ef55b56ff9458c0b" exitCode=0 Jun 02 17:01:58.174717 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:58.173968 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerDied","Data":"85b02f2faf8f3483b422c6da1fc2cc83d260196cfa921430ef55b56ff9458c0b"} Jun 02 17:01:59.037687 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:59.037657 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:01:59.037879 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:59.037761 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:01:59.037879 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:59.037767 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pd7mm" podUID="46629318-af6e-4221-8694-2f1cc2a21d9e" Jun 02 17:01:59.038019 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:59.037872 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfbct" podUID="3e07d9f5-8072-45ce-9445-6f63761014f3" Jun 02 17:01:59.038019 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:01:59.037920 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:01:59.038019 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:01:59.037991 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sp2qr" podUID="fd3d63de-f035-4b13-b443-b2669d1e523a" Jun 02 17:02:00.179709 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.179434 2555 generic.go:358] "Generic (PLEG): container finished" podID="491c36f1-4223-4f5b-8dcf-fba0a99015ec" containerID="f30463989f06b85cf807e64f0eea7d66abe9674a71d5334068e3aca0256d3395" exitCode=0 Jun 02 17:02:00.180314 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.179516 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerDied","Data":"f30463989f06b85cf807e64f0eea7d66abe9674a71d5334068e3aca0256d3395"} Jun 02 17:02:00.679614 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.679580 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:02:00.679767 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.679730 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:02:00.679827 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.679794 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs podName:46629318-af6e-4221-8694-2f1cc2a21d9e nodeName:}" failed. No retries permitted until 2026-06-02 17:02:32.679779293 +0000 UTC m=+66.166486718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs") pod "network-metrics-daemon-pd7mm" (UID: "46629318-af6e-4221-8694-2f1cc2a21d9e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 17:02:00.780241 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.780165 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:02:00.780241 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.780203 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:02:00.780416 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.780312 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 17:02:00.780416 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.780320 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 17:02:00.780416 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.780335 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 17:02:00.780416 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.780344 2555 projected.go:194] Error preparing data for projected volume kube-api-access-4zvwq for pod openshift-network-diagnostics/network-check-target-jfbct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:02:00.780416 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.780381 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret podName:fd3d63de-f035-4b13-b443-b2669d1e523a nodeName:}" failed. No retries permitted until 2026-06-02 17:02:32.780364335 +0000 UTC m=+66.267071760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret") pod "global-pull-secret-syncer-sp2qr" (UID: "fd3d63de-f035-4b13-b443-b2669d1e523a") : object "kube-system"/"original-pull-secret" not registered Jun 02 17:02:00.780416 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:00.780396 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq podName:3e07d9f5-8072-45ce-9445-6f63761014f3 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:32.780389263 +0000 UTC m=+66.267096688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4zvwq" (UniqueName: "kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq") pod "network-check-target-jfbct" (UID: "3e07d9f5-8072-45ce-9445-6f63761014f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 17:02:00.903075 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.903047 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-142.ec2.internal" event="NodeReady" Jun 02 17:02:00.903241 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.903197 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 17:02:00.935266 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.935236 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64484bdd95-kt2pn"] Jun 02 17:02:00.955542 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.955505 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cjmfr"] Jun 02 17:02:00.955705 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.955675 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:00.958660 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.958529 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 17:02:00.958660 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.958551 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 17:02:00.958660 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.958565 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 17:02:00.960000 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.959976 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-crw56\"" Jun 02 17:02:00.968934 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.968909 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 17:02:00.973527 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.973505 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4d9m9"] Jun 02 17:02:00.973679 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.973663 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:00.976145 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.976128 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g2576\"" Jun 02 17:02:00.976239 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.976133 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 17:02:00.976239 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.976160 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 17:02:00.995996 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.995975 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64484bdd95-kt2pn"] Jun 02 17:02:00.996106 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.996006 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4d9m9"] Jun 02 17:02:00.996106 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.996020 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cjmfr"] Jun 02 17:02:00.996106 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.996061 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:00.998849 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.998829 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 17:02:00.998951 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.998853 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 17:02:00.998951 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.998831 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dc8pw\"" Jun 02 17:02:00.999078 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:00.998992 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 17:02:01.037571 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.037495 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:02:01.037571 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.037510 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:02:01.037571 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.037532 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:02:01.040429 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.040409 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 17:02:01.040571 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.040437 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 17:02:01.040571 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.040473 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z8p26\"" Jun 02 17:02:01.040571 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.040481 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 17:02:01.040763 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.040746 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 17:02:01.040881 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.040867 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dkzqv\"" Jun 02 17:02:01.082901 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.082875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-certificates\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.082995 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.082915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n2sv\" (UniqueName: \"kubernetes.io/projected/51260992-dd01-4775-8210-7728d4076e81-kube-api-access-5n2sv\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.082995 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.082968 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:01.083078 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsxtp\" (UniqueName: \"kubernetes.io/projected/3057023f-c2e8-4d1c-b0e5-79df3261432d-kube-api-access-wsxtp\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:01.083078 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-installation-pull-secrets\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.083158 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083100 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-trusted-ca\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.083158 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083128 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-ca-trust-extracted\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.083249 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.083249 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083184 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-image-registry-private-configuration\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.083249 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083223 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd8n2\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-kube-api-access-pd8n2\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.083390 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-bound-sa-token\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.083390 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51260992-dd01-4775-8210-7728d4076e81-config-volume\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.083390 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083299 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51260992-dd01-4775-8210-7728d4076e81-tmp-dir\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.083390 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.083355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.184539 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184507 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-trusted-ca\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184551 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-ca-trust-extracted\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184679 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184739 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-image-registry-private-configuration\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184770 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pd8n2\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-kube-api-access-pd8n2\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.184790 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.184888 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls podName:51260992-dd01-4775-8210-7728d4076e81 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:01.684868183 +0000 UTC m=+35.171575610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls") pod "dns-default-cjmfr" (UID: "51260992-dd01-4775-8210-7728d4076e81") : secret "dns-default-metrics-tls" not found Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184906 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-ca-trust-extracted\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184795 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-bound-sa-token\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184950 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51260992-dd01-4775-8210-7728d4076e81-config-volume\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.184973 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51260992-dd01-4775-8210-7728d4076e81-tmp-dir\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185027 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185070 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185061 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-certificates\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185103 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5n2sv\" (UniqueName: \"kubernetes.io/projected/51260992-dd01-4775-8210-7728d4076e81-kube-api-access-5n2sv\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185131 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185166 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsxtp\" (UniqueName: \"kubernetes.io/projected/3057023f-c2e8-4d1c-b0e5-79df3261432d-kube-api-access-wsxtp\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185199 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-installation-pull-secrets\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185338 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51260992-dd01-4775-8210-7728d4076e81-tmp-dir\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.185419 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.185435 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64484bdd95-kt2pn: secret "image-registry-tls" not found Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.185480 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls podName:47f5f7a4-15f4-4c43-962b-b9193f6a85a5 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:01.685465636 +0000 UTC m=+35.172173064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls") pod "image-registry-64484bdd95-kt2pn" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5") : secret "image-registry-tls" not found Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.185544 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185552 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51260992-dd01-4775-8210-7728d4076e81-config-volume\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.185650 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.185573 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert podName:3057023f-c2e8-4d1c-b0e5-79df3261432d nodeName:}" failed. No retries permitted until 2026-06-02 17:02:01.685563274 +0000 UTC m=+35.172270701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert") pod "ingress-canary-4d9m9" (UID: "3057023f-c2e8-4d1c-b0e5-79df3261432d") : secret "canary-serving-cert" not found Jun 02 17:02:01.186046 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185734 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-trusted-ca\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.186046 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.185792 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-certificates\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.189077 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.189056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-installation-pull-secrets\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.189191 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.189123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-image-registry-private-configuration\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.194657 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.194606 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n2sv\" (UniqueName: \"kubernetes.io/projected/51260992-dd01-4775-8210-7728d4076e81-kube-api-access-5n2sv\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.195110 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.195091 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-bound-sa-token\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.195721 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.195701 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd8n2\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-kube-api-access-pd8n2\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.196151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.196134 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsxtp\" (UniqueName: \"kubernetes.io/projected/3057023f-c2e8-4d1c-b0e5-79df3261432d-kube-api-access-wsxtp\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:01.690000 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.689955 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:01.690172 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.690034 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:01.690172 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:01.690073 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:01.690172 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.690130 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 17:02:01.690172 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.690159 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 17:02:01.690407 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.690161 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 17:02:01.690407 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.690217 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64484bdd95-kt2pn: secret "image-registry-tls" not found Jun 02 17:02:01.690407 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.690215 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls podName:51260992-dd01-4775-8210-7728d4076e81 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:02.690193947 +0000 UTC m=+36.176901378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls") pod "dns-default-cjmfr" (UID: "51260992-dd01-4775-8210-7728d4076e81") : secret "dns-default-metrics-tls" not found Jun 02 17:02:01.690513 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.690497 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert podName:3057023f-c2e8-4d1c-b0e5-79df3261432d nodeName:}" failed. No retries permitted until 2026-06-02 17:02:02.690408482 +0000 UTC m=+36.177115921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert") pod "ingress-canary-4d9m9" (UID: "3057023f-c2e8-4d1c-b0e5-79df3261432d") : secret "canary-serving-cert" not found Jun 02 17:02:01.690659 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:01.690646 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls podName:47f5f7a4-15f4-4c43-962b-b9193f6a85a5 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:02.690521022 +0000 UTC m=+36.177228450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls") pod "image-registry-64484bdd95-kt2pn" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5") : secret "image-registry-tls" not found Jun 02 17:02:02.698009 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:02.697969 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:02.698065 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:02.698121 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:02.698136 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:02.698205 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:02.698215 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert podName:3057023f-c2e8-4d1c-b0e5-79df3261432d nodeName:}" failed. No retries permitted until 2026-06-02 17:02:04.69819971 +0000 UTC m=+38.184907139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert") pod "ingress-canary-4d9m9" (UID: "3057023f-c2e8-4d1c-b0e5-79df3261432d") : secret "canary-serving-cert" not found Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:02.698228 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:02.698242 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64484bdd95-kt2pn: secret "image-registry-tls" not found Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:02.698262 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls podName:51260992-dd01-4775-8210-7728d4076e81 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:04.698248906 +0000 UTC m=+38.184956331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls") pod "dns-default-cjmfr" (UID: "51260992-dd01-4775-8210-7728d4076e81") : secret "dns-default-metrics-tls" not found Jun 02 17:02:02.698460 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:02.698282 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls podName:47f5f7a4-15f4-4c43-962b-b9193f6a85a5 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:04.698267811 +0000 UTC m=+38.184975430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls") pod "image-registry-64484bdd95-kt2pn" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5") : secret "image-registry-tls" not found Jun 02 17:02:04.714671 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:04.714623 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:04.714720 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:04.714759 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:04.714770 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:04.714861 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls podName:51260992-dd01-4775-8210-7728d4076e81 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:08.71484202 +0000 UTC m=+42.201549446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls") pod "dns-default-cjmfr" (UID: "51260992-dd01-4775-8210-7728d4076e81") : secret "dns-default-metrics-tls" not found Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:04.714879 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:04.714893 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:04.714911 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64484bdd95-kt2pn: secret "image-registry-tls" not found Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:04.714930 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert podName:3057023f-c2e8-4d1c-b0e5-79df3261432d nodeName:}" failed. No retries permitted until 2026-06-02 17:02:08.71491364 +0000 UTC m=+42.201621073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert") pod "ingress-canary-4d9m9" (UID: "3057023f-c2e8-4d1c-b0e5-79df3261432d") : secret "canary-serving-cert" not found Jun 02 17:02:04.715123 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:04.714954 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls podName:47f5f7a4-15f4-4c43-962b-b9193f6a85a5 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:08.714940364 +0000 UTC m=+42.201647788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls") pod "image-registry-64484bdd95-kt2pn" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5") : secret "image-registry-tls" not found Jun 02 17:02:06.892286 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:06.892264 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gmcgl_f6429a92-f38c-4f60-869b-3aee5835318a/dns-node-resolver/0.log" Jun 02 17:02:07.195301 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:07.195267 2555 generic.go:358] "Generic (PLEG): container finished" podID="491c36f1-4223-4f5b-8dcf-fba0a99015ec" containerID="ca147cd6749558386cdf999810d9e5b22d2787e2b7e23f49991e2aba090c8036" exitCode=0 Jun 02 17:02:07.195447 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:07.195353 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerDied","Data":"ca147cd6749558386cdf999810d9e5b22d2787e2b7e23f49991e2aba090c8036"} Jun 02 17:02:08.092797 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:08.092765 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bdw4_7fc3cb36-c502-41e1-90ad-33255b0ace73/node-ca/0.log" Jun 02 17:02:08.199721 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:08.199687 2555 generic.go:358] "Generic (PLEG): container finished" podID="491c36f1-4223-4f5b-8dcf-fba0a99015ec" containerID="cf95d4dd0bc38b90df6f4fd9ea8ef06ccff03d2dd17db34e231448c840765913" exitCode=0 Jun 02 17:02:08.199873 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:08.199749 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerDied","Data":"cf95d4dd0bc38b90df6f4fd9ea8ef06ccff03d2dd17db34e231448c840765913"} Jun 02 17:02:08.750087 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:08.750036 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:08.750104 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:08.750132 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:08.750188 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:08.750222 2555 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:08.750228 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:08.750238 2555 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64484bdd95-kt2pn: secret "image-registry-tls" not found Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:08.750256 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls podName:51260992-dd01-4775-8210-7728d4076e81 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:16.750240512 +0000 UTC m=+50.236947937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls") pod "dns-default-cjmfr" (UID: "51260992-dd01-4775-8210-7728d4076e81") : secret "dns-default-metrics-tls" not found Jun 02 17:02:08.750289 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:08.750294 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert podName:3057023f-c2e8-4d1c-b0e5-79df3261432d nodeName:}" failed. No retries permitted until 2026-06-02 17:02:16.750278143 +0000 UTC m=+50.236985569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert") pod "ingress-canary-4d9m9" (UID: "3057023f-c2e8-4d1c-b0e5-79df3261432d") : secret "canary-serving-cert" not found Jun 02 17:02:08.750557 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:08.750309 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls podName:47f5f7a4-15f4-4c43-962b-b9193f6a85a5 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:16.750302952 +0000 UTC m=+50.237010379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls") pod "image-registry-64484bdd95-kt2pn" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5") : secret "image-registry-tls" not found Jun 02 17:02:09.204021 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:09.203992 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" event={"ID":"491c36f1-4223-4f5b-8dcf-fba0a99015ec","Type":"ContainerStarted","Data":"744168e5aab82b56b5a96244e19c00424a75925d81ad7edf9080008d2c1a93e9"} Jun 02 17:02:09.240569 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:09.240525 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dhwn6" podStartSLOduration=5.534571189 podStartE2EDuration="42.240511965s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.69418811 +0000 UTC m=+3.180895544" lastFinishedPulling="2026-06-02 17:02:06.400128896 +0000 UTC m=+39.886836320" observedRunningTime="2026-06-02 17:02:09.234403999 +0000 UTC m=+42.721111449" watchObservedRunningTime="2026-06-02 17:02:09.240511965 +0000 UTC m=+42.727219411" Jun 02 17:02:16.805139 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.805095 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:16.805772 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.805169 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:16.805772 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.805202 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:16.808089 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.808057 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51260992-dd01-4775-8210-7728d4076e81-metrics-tls\") pod \"dns-default-cjmfr\" (UID: \"51260992-dd01-4775-8210-7728d4076e81\") " pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:16.808195 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.808062 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3057023f-c2e8-4d1c-b0e5-79df3261432d-cert\") pod \"ingress-canary-4d9m9\" (UID: \"3057023f-c2e8-4d1c-b0e5-79df3261432d\") " pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:16.808195 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.808062 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"image-registry-64484bdd95-kt2pn\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:16.873463 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.873428 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:16.883208 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.883188 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:16.905202 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:16.905172 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4d9m9" Jun 02 17:02:17.074584 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.074515 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64484bdd95-kt2pn"] Jun 02 17:02:17.077653 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:17.077623 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f5f7a4_15f4_4c43_962b_b9193f6a85a5.slice/crio-d08b9f39476b6237b49879a5437be6de92c9685b22f3c316d8aa4a38277014d5 WatchSource:0}: Error finding container d08b9f39476b6237b49879a5437be6de92c9685b22f3c316d8aa4a38277014d5: Status 404 returned error can't find the container with id d08b9f39476b6237b49879a5437be6de92c9685b22f3c316d8aa4a38277014d5 Jun 02 17:02:17.091657 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.091631 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4d9m9"] Jun 02 17:02:17.094225 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:17.094201 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3057023f_c2e8_4d1c_b0e5_79df3261432d.slice/crio-c9f4eb1c9b811825221a22b83bb3b52a0efd9197a094c044ca311dc24a1daee0 WatchSource:0}: Error finding container c9f4eb1c9b811825221a22b83bb3b52a0efd9197a094c044ca311dc24a1daee0: Status 404 returned error can't find the container with id c9f4eb1c9b811825221a22b83bb3b52a0efd9197a094c044ca311dc24a1daee0 Jun 02 17:02:17.105931 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.105910 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cjmfr"] Jun 02 17:02:17.108744 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:17.108721 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51260992_dd01_4775_8210_7728d4076e81.slice/crio-fca12d2164b7638aaec129f60f6c36f3857ec16ce57b1bc0915f02ece07f7803 WatchSource:0}: Error finding container fca12d2164b7638aaec129f60f6c36f3857ec16ce57b1bc0915f02ece07f7803: Status 404 returned error can't find the container with id fca12d2164b7638aaec129f60f6c36f3857ec16ce57b1bc0915f02ece07f7803 Jun 02 17:02:17.221366 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.221328 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjmfr" event={"ID":"51260992-dd01-4775-8210-7728d4076e81","Type":"ContainerStarted","Data":"fca12d2164b7638aaec129f60f6c36f3857ec16ce57b1bc0915f02ece07f7803"} Jun 02 17:02:17.222348 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.222313 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4d9m9" event={"ID":"3057023f-c2e8-4d1c-b0e5-79df3261432d","Type":"ContainerStarted","Data":"c9f4eb1c9b811825221a22b83bb3b52a0efd9197a094c044ca311dc24a1daee0"} Jun 02 17:02:17.223579 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.223558 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" event={"ID":"47f5f7a4-15f4-4c43-962b-b9193f6a85a5","Type":"ContainerStarted","Data":"4bac848b62df00695f795bed15582c3f91bf4e76cfcf07a153a6ccd04237dbb4"} Jun 02 17:02:17.223698 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.223584 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" event={"ID":"47f5f7a4-15f4-4c43-962b-b9193f6a85a5","Type":"ContainerStarted","Data":"d08b9f39476b6237b49879a5437be6de92c9685b22f3c316d8aa4a38277014d5"} Jun 02 17:02:17.223745 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.223727 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:17.249432 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:17.249387 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" podStartSLOduration=42.249373956 podStartE2EDuration="42.249373956s" podCreationTimestamp="2026-06-02 17:01:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:02:17.248784883 +0000 UTC m=+50.735492340" watchObservedRunningTime="2026-06-02 17:02:17.249373956 +0000 UTC m=+50.736081402" Jun 02 17:02:20.231669 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:20.231627 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjmfr" event={"ID":"51260992-dd01-4775-8210-7728d4076e81","Type":"ContainerStarted","Data":"8f093203ce4b578ec67b89b8958a85f0dc95c61f4bccf6702bc04ee8e78406b5"} Jun 02 17:02:20.231669 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:20.231674 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjmfr" event={"ID":"51260992-dd01-4775-8210-7728d4076e81","Type":"ContainerStarted","Data":"c32104d28bf029a229807850964997b67c5777ace1610838d3487df1d6cc1c41"} Jun 02 17:02:20.232159 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:20.231836 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:20.233059 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:20.233023 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4d9m9" event={"ID":"3057023f-c2e8-4d1c-b0e5-79df3261432d","Type":"ContainerStarted","Data":"7962f57fb67234bce80151d29ba0e8d1bf37c67061bdd6812a6148c611f773ba"} Jun 02 17:02:20.248640 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:20.248591 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cjmfr" podStartSLOduration=17.706168522 podStartE2EDuration="20.24857959s" podCreationTimestamp="2026-06-02 17:02:00 +0000 UTC" firstStartedPulling="2026-06-02 17:02:17.111094651 +0000 UTC m=+50.597802076" lastFinishedPulling="2026-06-02 17:02:19.653505717 +0000 UTC m=+53.140213144" observedRunningTime="2026-06-02 17:02:20.248052852 +0000 UTC m=+53.734760297" watchObservedRunningTime="2026-06-02 17:02:20.24857959 +0000 UTC m=+53.735287038" Jun 02 17:02:20.264003 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:20.263967 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4d9m9" podStartSLOduration=17.701928245 podStartE2EDuration="20.263955679s" podCreationTimestamp="2026-06-02 17:02:00 +0000 UTC" firstStartedPulling="2026-06-02 17:02:17.095928606 +0000 UTC m=+50.582636045" lastFinishedPulling="2026-06-02 17:02:19.657956054 +0000 UTC m=+53.144663479" observedRunningTime="2026-06-02 17:02:20.263146055 +0000 UTC m=+53.749853494" watchObservedRunningTime="2026-06-02 17:02:20.263955679 +0000 UTC m=+53.750663125" Jun 02 17:02:25.173222 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:25.173199 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-47xpb" Jun 02 17:02:27.151949 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.151914 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-7xkdq"] Jun 02 17:02:27.154303 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.154285 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-7xkdq" Jun 02 17:02:27.159476 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.159454 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 17:02:27.159830 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.159797 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 17:02:27.159996 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.159972 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9kdbz\"" Jun 02 17:02:27.169105 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.169081 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c6qxb"] Jun 02 17:02:27.171087 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.171070 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-7xkdq"] Jun 02 17:02:27.171199 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.171187 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.174957 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.174930 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 17:02:27.175098 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.174944 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 17:02:27.178379 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.178362 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 17:02:27.178522 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.178506 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 17:02:27.178613 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.178596 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7jw55\"" Jun 02 17:02:27.178871 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.178846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63358fee-6cd3-4e42-91ae-7407f8e4162e-data-volume\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.178948 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.178887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn5x2\" (UniqueName: \"kubernetes.io/projected/63358fee-6cd3-4e42-91ae-7407f8e4162e-kube-api-access-xn5x2\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.178948 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.178916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lntfg\" (UniqueName: \"kubernetes.io/projected/3812feaa-6803-4d19-bc4d-03d6261d32e6-kube-api-access-lntfg\") pod \"downloads-c65b8dc4b-7xkdq\" (UID: \"3812feaa-6803-4d19-bc4d-03d6261d32e6\") " pod="openshift-console/downloads-c65b8dc4b-7xkdq" Jun 02 17:02:27.179058 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.178988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63358fee-6cd3-4e42-91ae-7407f8e4162e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.179121 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.179068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63358fee-6cd3-4e42-91ae-7407f8e4162e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.179121 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.179103 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63358fee-6cd3-4e42-91ae-7407f8e4162e-crio-socket\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.182722 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.182702 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64484bdd95-kt2pn"] Jun 02 17:02:27.187694 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.187671 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c6qxb"] Jun 02 17:02:27.280231 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280190 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63358fee-6cd3-4e42-91ae-7407f8e4162e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.280231 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280231 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63358fee-6cd3-4e42-91ae-7407f8e4162e-crio-socket\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.280547 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280301 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63358fee-6cd3-4e42-91ae-7407f8e4162e-crio-socket\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.280547 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280310 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63358fee-6cd3-4e42-91ae-7407f8e4162e-data-volume\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.280547 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280345 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn5x2\" (UniqueName: \"kubernetes.io/projected/63358fee-6cd3-4e42-91ae-7407f8e4162e-kube-api-access-xn5x2\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.280547 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280366 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lntfg\" (UniqueName: \"kubernetes.io/projected/3812feaa-6803-4d19-bc4d-03d6261d32e6-kube-api-access-lntfg\") pod \"downloads-c65b8dc4b-7xkdq\" (UID: \"3812feaa-6803-4d19-bc4d-03d6261d32e6\") " pod="openshift-console/downloads-c65b8dc4b-7xkdq" Jun 02 17:02:27.280547 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280408 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63358fee-6cd3-4e42-91ae-7407f8e4162e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.280779 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280599 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63358fee-6cd3-4e42-91ae-7407f8e4162e-data-volume\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.280942 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.280926 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63358fee-6cd3-4e42-91ae-7407f8e4162e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.282676 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.282658 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63358fee-6cd3-4e42-91ae-7407f8e4162e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.291870 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.291838 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lntfg\" (UniqueName: \"kubernetes.io/projected/3812feaa-6803-4d19-bc4d-03d6261d32e6-kube-api-access-lntfg\") pod \"downloads-c65b8dc4b-7xkdq\" (UID: \"3812feaa-6803-4d19-bc4d-03d6261d32e6\") " pod="openshift-console/downloads-c65b8dc4b-7xkdq" Jun 02 17:02:27.292959 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.292939 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn5x2\" (UniqueName: \"kubernetes.io/projected/63358fee-6cd3-4e42-91ae-7407f8e4162e-kube-api-access-xn5x2\") pod \"insights-runtime-extractor-c6qxb\" (UID: \"63358fee-6cd3-4e42-91ae-7407f8e4162e\") " pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.465666 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.465636 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-7xkdq" Jun 02 17:02:27.480527 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.480502 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c6qxb" Jun 02 17:02:27.593883 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.593852 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-7xkdq"] Jun 02 17:02:27.597321 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:27.597297 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3812feaa_6803_4d19_bc4d_03d6261d32e6.slice/crio-73ddcbfc640476fe8bc91bd1d504a6300a490d05f989cc87998b859923ec5e88 WatchSource:0}: Error finding container 73ddcbfc640476fe8bc91bd1d504a6300a490d05f989cc87998b859923ec5e88: Status 404 returned error can't find the container with id 73ddcbfc640476fe8bc91bd1d504a6300a490d05f989cc87998b859923ec5e88 Jun 02 17:02:27.609574 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:27.609551 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c6qxb"] Jun 02 17:02:27.612529 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:27.612502 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63358fee_6cd3_4e42_91ae_7407f8e4162e.slice/crio-2e0ecf1ddcb3099f2ab65d04467679a014d36f8acd22c59f8c88c06144bb598b WatchSource:0}: Error finding container 2e0ecf1ddcb3099f2ab65d04467679a014d36f8acd22c59f8c88c06144bb598b: Status 404 returned error can't find the container with id 2e0ecf1ddcb3099f2ab65d04467679a014d36f8acd22c59f8c88c06144bb598b Jun 02 17:02:28.251574 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:28.251543 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c6qxb" event={"ID":"63358fee-6cd3-4e42-91ae-7407f8e4162e","Type":"ContainerStarted","Data":"5074a14d480c22d565cd4345762955468896aa4c52a229ce1edefa93fb31d82b"} Jun 02 17:02:28.252023 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:28.251595 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c6qxb" event={"ID":"63358fee-6cd3-4e42-91ae-7407f8e4162e","Type":"ContainerStarted","Data":"21079e0b745e4a4bae216ddc6f6b6587010a2b4e9cb1286ddc97c85342ebbf9e"} Jun 02 17:02:28.252023 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:28.251610 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c6qxb" event={"ID":"63358fee-6cd3-4e42-91ae-7407f8e4162e","Type":"ContainerStarted","Data":"2e0ecf1ddcb3099f2ab65d04467679a014d36f8acd22c59f8c88c06144bb598b"} Jun 02 17:02:28.252539 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:28.252517 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-7xkdq" event={"ID":"3812feaa-6803-4d19-bc4d-03d6261d32e6","Type":"ContainerStarted","Data":"73ddcbfc640476fe8bc91bd1d504a6300a490d05f989cc87998b859923ec5e88"} Jun 02 17:02:30.237498 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:30.237461 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cjmfr" Jun 02 17:02:30.263631 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:30.263592 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c6qxb" event={"ID":"63358fee-6cd3-4e42-91ae-7407f8e4162e","Type":"ContainerStarted","Data":"6eb0fc5f912fccb8dd00756732f82bbd10eb93ce162b4a39f69e9c281eb68ca8"} Jun 02 17:02:30.280343 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:30.280299 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c6qxb" podStartSLOduration=0.897628375 podStartE2EDuration="3.280285343s" podCreationTimestamp="2026-06-02 17:02:27 +0000 UTC" firstStartedPulling="2026-06-02 17:02:27.662551017 +0000 UTC m=+61.149258443" lastFinishedPulling="2026-06-02 17:02:30.045207984 +0000 UTC m=+63.531915411" observedRunningTime="2026-06-02 17:02:30.279707915 +0000 UTC m=+63.766415373" watchObservedRunningTime="2026-06-02 17:02:30.280285343 +0000 UTC m=+63.766992791" Jun 02 17:02:32.718725 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.718685 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:02:32.721304 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.721279 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 17:02:32.732353 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.732323 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46629318-af6e-4221-8694-2f1cc2a21d9e-metrics-certs\") pod \"network-metrics-daemon-pd7mm\" (UID: \"46629318-af6e-4221-8694-2f1cc2a21d9e\") " pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:02:32.819674 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.819632 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:02:32.819866 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.819685 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:02:32.822510 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.822479 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 17:02:32.822636 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.822525 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 17:02:32.832466 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.832442 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fd3d63de-f035-4b13-b443-b2669d1e523a-original-pull-secret\") pod \"global-pull-secret-syncer-sp2qr\" (UID: \"fd3d63de-f035-4b13-b443-b2669d1e523a\") " pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:02:32.832610 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.832597 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 17:02:32.843364 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.843343 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvwq\" (UniqueName: \"kubernetes.io/projected/3e07d9f5-8072-45ce-9445-6f63761014f3-kube-api-access-4zvwq\") pod \"network-check-target-jfbct\" (UID: \"3e07d9f5-8072-45ce-9445-6f63761014f3\") " pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:02:32.849210 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.849191 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sp2qr" Jun 02 17:02:32.860947 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.860712 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z8p26\"" Jun 02 17:02:32.865370 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.865345 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dkzqv\"" Jun 02 17:02:32.868606 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.868582 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:02:32.873462 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:32.873437 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pd7mm" Jun 02 17:02:33.019322 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:33.019270 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sp2qr"] Jun 02 17:02:33.022765 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:33.022739 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3d63de_f035_4b13_b443_b2669d1e523a.slice/crio-8abecabaef20dd5331b7fbd0f6e5d7bf4b9ebf6726e11ab985d5e7b4c64b9de5 WatchSource:0}: Error finding container 8abecabaef20dd5331b7fbd0f6e5d7bf4b9ebf6726e11ab985d5e7b4c64b9de5: Status 404 returned error can't find the container with id 8abecabaef20dd5331b7fbd0f6e5d7bf4b9ebf6726e11ab985d5e7b4c64b9de5 Jun 02 17:02:33.240387 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:33.240204 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pd7mm"] Jun 02 17:02:33.242533 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:33.242503 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfbct"] Jun 02 17:02:33.245413 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:33.245383 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46629318_af6e_4221_8694_2f1cc2a21d9e.slice/crio-1097ad6e83f6534f11022d46727e34a6e6cc8b529de74b4550d696ce88bad9e9 WatchSource:0}: Error finding container 1097ad6e83f6534f11022d46727e34a6e6cc8b529de74b4550d696ce88bad9e9: Status 404 returned error can't find the container with id 1097ad6e83f6534f11022d46727e34a6e6cc8b529de74b4550d696ce88bad9e9 Jun 02 17:02:33.246372 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:33.246346 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e07d9f5_8072_45ce_9445_6f63761014f3.slice/crio-bbaf668960d975296f6e02c9aa4e571305cee23be6af2f2cb95fc58def16f50d WatchSource:0}: Error finding container bbaf668960d975296f6e02c9aa4e571305cee23be6af2f2cb95fc58def16f50d: Status 404 returned error can't find the container with id bbaf668960d975296f6e02c9aa4e571305cee23be6af2f2cb95fc58def16f50d Jun 02 17:02:33.272540 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:33.272514 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sp2qr" event={"ID":"fd3d63de-f035-4b13-b443-b2669d1e523a","Type":"ContainerStarted","Data":"8abecabaef20dd5331b7fbd0f6e5d7bf4b9ebf6726e11ab985d5e7b4c64b9de5"} Jun 02 17:02:33.273614 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:33.273589 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd7mm" event={"ID":"46629318-af6e-4221-8694-2f1cc2a21d9e","Type":"ContainerStarted","Data":"1097ad6e83f6534f11022d46727e34a6e6cc8b529de74b4550d696ce88bad9e9"} Jun 02 17:02:33.274675 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:33.274650 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfbct" event={"ID":"3e07d9f5-8072-45ce-9445-6f63761014f3","Type":"ContainerStarted","Data":"bbaf668960d975296f6e02c9aa4e571305cee23be6af2f2cb95fc58def16f50d"} Jun 02 17:02:35.284058 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.283235 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd7mm" event={"ID":"46629318-af6e-4221-8694-2f1cc2a21d9e","Type":"ContainerStarted","Data":"b0be365b2fa51fc2c28509af70cce17322569d0ed0b1675ed00e1ebb05bcce01"} Jun 02 17:02:35.284058 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.283280 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pd7mm" event={"ID":"46629318-af6e-4221-8694-2f1cc2a21d9e","Type":"ContainerStarted","Data":"09a06df9f53853a6790adde445c67d5db4e37fd20831ffb4d83f3d5948da6cd0"} Jun 02 17:02:35.300495 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.300435 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pd7mm" podStartSLOduration=66.888537279 podStartE2EDuration="1m8.300417086s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:02:33.247597639 +0000 UTC m=+66.734305064" lastFinishedPulling="2026-06-02 17:02:34.659477446 +0000 UTC m=+68.146184871" observedRunningTime="2026-06-02 17:02:35.298882287 +0000 UTC m=+68.785589736" watchObservedRunningTime="2026-06-02 17:02:35.300417086 +0000 UTC m=+68.787124537" Jun 02 17:02:35.883658 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.883542 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-576d6476d5-vfxg8"] Jun 02 17:02:35.889037 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.888183 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:35.898860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.893105 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 17:02:35.898860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.893303 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 17:02:35.898860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.893464 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 17:02:35.898860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.893611 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 17:02:35.898860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.893850 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 17:02:35.898860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.894701 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jmjpp\"" Jun 02 17:02:35.898860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.897729 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576d6476d5-vfxg8"] Jun 02 17:02:35.901979 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.901752 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 17:02:35.941652 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.941619 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-trusted-ca-bundle\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:35.941852 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.941708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-config\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:35.941852 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.941755 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2hzw\" (UniqueName: \"kubernetes.io/projected/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-kube-api-access-r2hzw\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:35.941852 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.941784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-oauth-config\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:35.942033 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.941865 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-serving-cert\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:35.942033 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.941891 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-service-ca\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:35.942033 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:35.941933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-oauth-serving-cert\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.042487 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.042445 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-serving-cert\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.042650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.042497 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-service-ca\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.042650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.042534 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-oauth-serving-cert\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.042650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.042578 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-trusted-ca-bundle\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.042650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.042614 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-config\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.042650 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.042648 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2hzw\" (UniqueName: \"kubernetes.io/projected/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-kube-api-access-r2hzw\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.042938 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.042675 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-oauth-config\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.043568 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.043520 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-oauth-serving-cert\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.044365 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.044342 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-service-ca\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.044959 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.044934 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-config\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.045264 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.045220 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-trusted-ca-bundle\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.047510 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.047484 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-oauth-config\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.048014 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.047990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-serving-cert\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.056368 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.053523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2hzw\" (UniqueName: \"kubernetes.io/projected/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-kube-api-access-r2hzw\") pod \"console-576d6476d5-vfxg8\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:36.207675 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:36.207638 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:37.191483 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:37.191116 2555 patch_prober.go:28] interesting pod/image-registry-64484bdd95-kt2pn container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 17:02:37.191483 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:37.191201 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" podUID="47f5f7a4-15f4-4c43-962b-b9193f6a85a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 17:02:45.317225 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:45.317176 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576d6476d5-vfxg8"] Jun 02 17:02:45.318121 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:45.317958 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfbct" event={"ID":"3e07d9f5-8072-45ce-9445-6f63761014f3","Type":"ContainerStarted","Data":"b1210d92b79f20df56c13a7ffc1c264944007b2e05d62004bc32f933f8f7c72a"} Jun 02 17:02:45.318405 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:45.318284 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:02:45.319573 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:45.319498 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sp2qr" event={"ID":"fd3d63de-f035-4b13-b443-b2669d1e523a","Type":"ContainerStarted","Data":"29baef9549754a57a27e562e970204e74439ea11954d631a4edbf567992c5831"} Jun 02 17:02:45.321588 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:45.321562 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1fb418_8b94_436f_9812_7c0e4b6e9c86.slice/crio-d8e568c08d7fe509e5c838c588a2b8330d9b20883ef5f0eb7e1f4bbbcc03190b WatchSource:0}: Error finding container d8e568c08d7fe509e5c838c588a2b8330d9b20883ef5f0eb7e1f4bbbcc03190b: Status 404 returned error can't find the container with id d8e568c08d7fe509e5c838c588a2b8330d9b20883ef5f0eb7e1f4bbbcc03190b Jun 02 17:02:45.351554 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:45.351474 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfbct" podStartSLOduration=66.4204372 podStartE2EDuration="1m18.351457203s" podCreationTimestamp="2026-06-02 17:01:27 +0000 UTC" firstStartedPulling="2026-06-02 17:02:33.248831971 +0000 UTC m=+66.735539404" lastFinishedPulling="2026-06-02 17:02:45.179851967 +0000 UTC m=+78.666559407" observedRunningTime="2026-06-02 17:02:45.334049095 +0000 UTC m=+78.820756539" watchObservedRunningTime="2026-06-02 17:02:45.351457203 +0000 UTC m=+78.838164653" Jun 02 17:02:45.352099 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:45.352066 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sp2qr" podStartSLOduration=65.190593505 podStartE2EDuration="1m17.352055665s" podCreationTimestamp="2026-06-02 17:01:28 +0000 UTC" firstStartedPulling="2026-06-02 17:02:33.024821768 +0000 UTC m=+66.511529193" lastFinishedPulling="2026-06-02 17:02:45.186283915 +0000 UTC m=+78.672991353" observedRunningTime="2026-06-02 17:02:45.351291098 +0000 UTC m=+78.837998548" watchObservedRunningTime="2026-06-02 17:02:45.352055665 +0000 UTC m=+78.838763111" Jun 02 17:02:46.323990 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:46.323952 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d6476d5-vfxg8" event={"ID":"cd1fb418-8b94-436f-9812-7c0e4b6e9c86","Type":"ContainerStarted","Data":"d8e568c08d7fe509e5c838c588a2b8330d9b20883ef5f0eb7e1f4bbbcc03190b"} Jun 02 17:02:46.325677 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:46.325638 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-7xkdq" event={"ID":"3812feaa-6803-4d19-bc4d-03d6261d32e6","Type":"ContainerStarted","Data":"be567681db920d40ef38910a0b348716f3bf39bbc19a7f56f5c7c644a060364e"} Jun 02 17:02:47.059632 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:47.059546 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-7xkdq" podStartSLOduration=2.4103625 podStartE2EDuration="20.059527012s" podCreationTimestamp="2026-06-02 17:02:27 +0000 UTC" firstStartedPulling="2026-06-02 17:02:27.599023366 +0000 UTC m=+61.085730791" lastFinishedPulling="2026-06-02 17:02:45.248187878 +0000 UTC m=+78.734895303" observedRunningTime="2026-06-02 17:02:46.344608386 +0000 UTC m=+79.831315834" watchObservedRunningTime="2026-06-02 17:02:47.059527012 +0000 UTC m=+80.546234460" Jun 02 17:02:47.188397 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:47.188362 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:47.331273 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:47.331188 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-7xkdq" Jun 02 17:02:47.343477 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:47.343444 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-7xkdq" Jun 02 17:02:50.343289 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:50.343201 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d6476d5-vfxg8" event={"ID":"cd1fb418-8b94-436f-9812-7c0e4b6e9c86","Type":"ContainerStarted","Data":"c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997"} Jun 02 17:02:52.203009 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.202936 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" podUID="47f5f7a4-15f4-4c43-962b-b9193f6a85a5" containerName="registry" containerID="cri-o://4bac848b62df00695f795bed15582c3f91bf4e76cfcf07a153a6ccd04237dbb4" gracePeriod=30 Jun 02 17:02:52.351924 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.351888 2555 generic.go:358] "Generic (PLEG): container finished" podID="47f5f7a4-15f4-4c43-962b-b9193f6a85a5" containerID="4bac848b62df00695f795bed15582c3f91bf4e76cfcf07a153a6ccd04237dbb4" exitCode=0 Jun 02 17:02:52.352115 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.351937 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" event={"ID":"47f5f7a4-15f4-4c43-962b-b9193f6a85a5","Type":"ContainerDied","Data":"4bac848b62df00695f795bed15582c3f91bf4e76cfcf07a153a6ccd04237dbb4"} Jun 02 17:02:52.482648 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.482622 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:52.505044 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.504980 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-576d6476d5-vfxg8" podStartSLOduration=12.818673131 podStartE2EDuration="17.504961686s" podCreationTimestamp="2026-06-02 17:02:35 +0000 UTC" firstStartedPulling="2026-06-02 17:02:45.323907591 +0000 UTC m=+78.810615015" lastFinishedPulling="2026-06-02 17:02:50.010196129 +0000 UTC m=+83.496903570" observedRunningTime="2026-06-02 17:02:50.365338377 +0000 UTC m=+83.852045824" watchObservedRunningTime="2026-06-02 17:02:52.504961686 +0000 UTC m=+85.991669133" Jun 02 17:02:52.574361 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574326 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574529 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574382 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-image-registry-private-configuration\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574529 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574436 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-trusted-ca\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574529 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574473 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-ca-trust-extracted\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574529 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574504 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-installation-pull-secrets\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574754 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574538 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-certificates\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574754 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574561 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-bound-sa-token\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574754 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574595 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd8n2\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-kube-api-access-pd8n2\") pod \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\" (UID: \"47f5f7a4-15f4-4c43-962b-b9193f6a85a5\") " Jun 02 17:02:52.574941 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.574796 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:02:52.575299 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.575194 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:02:52.577691 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.577644 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-kube-api-access-pd8n2" (OuterVolumeSpecName: "kube-api-access-pd8n2") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "kube-api-access-pd8n2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:02:52.578083 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.578055 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:02:52.578234 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.578210 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:02:52.578364 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.578207 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:02:52.578364 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.578354 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:02:52.587439 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.587412 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "47f5f7a4-15f4-4c43-962b-b9193f6a85a5" (UID: "47f5f7a4-15f4-4c43-962b-b9193f6a85a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676456 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-trusted-ca\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676503 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-ca-trust-extracted\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676519 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-installation-pull-secrets\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676534 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-certificates\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676548 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-bound-sa-token\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676567 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd8n2\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-kube-api-access-pd8n2\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676580 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-registry-tls\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:52.679169 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:52.676595 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47f5f7a4-15f4-4c43-962b-b9193f6a85a5-image-registry-private-configuration\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:02:53.356197 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:53.356116 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" event={"ID":"47f5f7a4-15f4-4c43-962b-b9193f6a85a5","Type":"ContainerDied","Data":"d08b9f39476b6237b49879a5437be6de92c9685b22f3c316d8aa4a38277014d5"} Jun 02 17:02:53.356197 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:53.356171 2555 scope.go:117] "RemoveContainer" containerID="4bac848b62df00695f795bed15582c3f91bf4e76cfcf07a153a6ccd04237dbb4" Jun 02 17:02:53.356692 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:53.356209 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64484bdd95-kt2pn" Jun 02 17:02:53.375142 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:53.375110 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64484bdd95-kt2pn"] Jun 02 17:02:53.381909 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:53.381874 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64484bdd95-kt2pn"] Jun 02 17:02:54.788686 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.788650 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp"] Jun 02 17:02:54.789100 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.788875 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f5f7a4-15f4-4c43-962b-b9193f6a85a5" containerName="registry" Jun 02 17:02:54.789100 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.788885 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f5f7a4-15f4-4c43-962b-b9193f6a85a5" containerName="registry" Jun 02 17:02:54.789100 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.788931 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="47f5f7a4-15f4-4c43-962b-b9193f6a85a5" containerName="registry" Jun 02 17:02:54.817668 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.817636 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp"] Jun 02 17:02:54.817839 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.817768 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.821127 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.821104 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 17:02:54.821263 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.821148 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 17:02:54.822405 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.822391 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 17:02:54.822542 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.822521 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-48dn6\"" Jun 02 17:02:54.822542 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.822523 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 17:02:54.822696 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.822521 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 17:02:54.895056 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.895027 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/adc5b620-981d-4b69-9ce8-5328a54ce509-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.895056 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.895062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adc5b620-981d-4b69-9ce8-5328a54ce509-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.895247 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.895102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f42w\" (UniqueName: \"kubernetes.io/projected/adc5b620-981d-4b69-9ce8-5328a54ce509-kube-api-access-4f42w\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.895247 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.895125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc5b620-981d-4b69-9ce8-5328a54ce509-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.996281 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.996248 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4f42w\" (UniqueName: \"kubernetes.io/projected/adc5b620-981d-4b69-9ce8-5328a54ce509-kube-api-access-4f42w\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.996281 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.996292 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc5b620-981d-4b69-9ce8-5328a54ce509-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.996486 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.996315 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/adc5b620-981d-4b69-9ce8-5328a54ce509-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.996486 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.996335 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adc5b620-981d-4b69-9ce8-5328a54ce509-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.996973 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.996945 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adc5b620-981d-4b69-9ce8-5328a54ce509-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.998844 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.998814 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adc5b620-981d-4b69-9ce8-5328a54ce509-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:54.998915 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:54.998874 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/adc5b620-981d-4b69-9ce8-5328a54ce509-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:55.004449 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:55.004425 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f42w\" (UniqueName: \"kubernetes.io/projected/adc5b620-981d-4b69-9ce8-5328a54ce509-kube-api-access-4f42w\") pod \"prometheus-operator-658bcd8bdf-gjvxp\" (UID: \"adc5b620-981d-4b69-9ce8-5328a54ce509\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:55.041664 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:55.041585 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f5f7a4-15f4-4c43-962b-b9193f6a85a5" path="/var/lib/kubelet/pods/47f5f7a4-15f4-4c43-962b-b9193f6a85a5/volumes" Jun 02 17:02:55.127239 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:55.127213 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" Jun 02 17:02:55.249515 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:55.249485 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp"] Jun 02 17:02:55.253533 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:55.253506 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc5b620_981d_4b69_9ce8_5328a54ce509.slice/crio-26222e0e9a2aee82bac5cc59ad689952003d70df7e8ceca17b31d7e98e4bc1de WatchSource:0}: Error finding container 26222e0e9a2aee82bac5cc59ad689952003d70df7e8ceca17b31d7e98e4bc1de: Status 404 returned error can't find the container with id 26222e0e9a2aee82bac5cc59ad689952003d70df7e8ceca17b31d7e98e4bc1de Jun 02 17:02:55.363143 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:55.363063 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" event={"ID":"adc5b620-981d-4b69-9ce8-5328a54ce509","Type":"ContainerStarted","Data":"26222e0e9a2aee82bac5cc59ad689952003d70df7e8ceca17b31d7e98e4bc1de"} Jun 02 17:02:56.207943 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:56.207913 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:56.207943 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:56.207953 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:56.214590 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:56.214567 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:56.370288 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:56.370259 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:02:57.371397 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:57.371313 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" event={"ID":"adc5b620-981d-4b69-9ce8-5328a54ce509","Type":"ContainerStarted","Data":"b8e4c9b2c478dbce3bebe0b6f5bfc0bd2c6181330e419f22be4f0c059daaa2f8"} Jun 02 17:02:57.371397 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:57.371355 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" event={"ID":"adc5b620-981d-4b69-9ce8-5328a54ce509","Type":"ContainerStarted","Data":"dadc2f9bd2ff5294786a14a8a01f43d4b8fa2bf4174e69186015b315058c20ea"} Jun 02 17:02:57.388566 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:57.388512 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-gjvxp" podStartSLOduration=1.5790478000000001 podStartE2EDuration="3.388497777s" podCreationTimestamp="2026-06-02 17:02:54 +0000 UTC" firstStartedPulling="2026-06-02 17:02:55.255480268 +0000 UTC m=+88.742187692" lastFinishedPulling="2026-06-02 17:02:57.064930242 +0000 UTC m=+90.551637669" observedRunningTime="2026-06-02 17:02:57.387540874 +0000 UTC m=+90.874248334" watchObservedRunningTime="2026-06-02 17:02:57.388497777 +0000 UTC m=+90.875205225" Jun 02 17:02:59.127405 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.127371 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bt4nj"] Jun 02 17:02:59.153864 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.153830 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw"] Jun 02 17:02:59.154076 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.154002 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.156747 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.156718 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 17:02:59.156896 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.156856 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ck7gx\"" Jun 02 17:02:59.156978 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.156966 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 17:02:59.168054 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.168032 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bt4nj"] Jun 02 17:02:59.168144 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.168062 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cx644"] Jun 02 17:02:59.168198 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.168182 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.170923 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.170901 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 17:02:59.173218 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.173195 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 17:02:59.173218 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.173208 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mfxs2\"" Jun 02 17:02:59.173376 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.173211 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 17:02:59.186413 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.186384 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw"] Jun 02 17:02:59.186554 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.186524 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.189173 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.189154 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 17:02:59.189280 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.189266 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 17:02:59.189348 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.189289 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rs9rd\"" Jun 02 17:02:59.189348 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.189269 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 17:02:59.228138 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228108 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.228319 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.228319 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228176 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6z5x\" (UniqueName: \"kubernetes.io/projected/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-api-access-p6z5x\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.228319 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228235 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.228319 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228271 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpqwt\" (UniqueName: \"kubernetes.io/projected/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-kube-api-access-lpqwt\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.228319 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228293 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.228480 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.228480 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed445928-ba3e-48e4-af6c-677f5aa37123-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.228480 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.228480 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.228423 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed445928-ba3e-48e4-af6c-677f5aa37123-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329054 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329012 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed445928-ba3e-48e4-af6c-677f5aa37123-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329054 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329057 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-tls\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329110 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5455f15-f33e-4be5-b10d-b295e21694e2-metrics-client-ca\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329169 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-root\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329297 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329306 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-wtmp\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329343 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329373 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6z5x\" (UniqueName: \"kubernetes.io/projected/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-api-access-p6z5x\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329416 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-textfile\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329457 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329491 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpqwt\" (UniqueName: \"kubernetes.io/projected/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-kube-api-access-lpqwt\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xh6q\" (UniqueName: \"kubernetes.io/projected/c5455f15-f33e-4be5-b10d-b295e21694e2-kube-api-access-6xh6q\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329559 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329556 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:59.329569 2555 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329595 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329627 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed445928-ba3e-48e4-af6c-677f5aa37123-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:02:59.329648 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-tls podName:f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe nodeName:}" failed. No retries permitted until 2026-06-02 17:02:59.8296272 +0000 UTC m=+93.316334646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-bt4nj" (UID: "f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe") : secret "openshift-state-metrics-tls" not found Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329683 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329718 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-sys\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329864 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329889 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed445928-ba3e-48e4-af6c-677f5aa37123-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.329975 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.329973 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed445928-ba3e-48e4-af6c-677f5aa37123-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.330258 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.330162 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.332312 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.332284 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.332312 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.332297 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.332485 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.332348 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.338482 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.338456 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpqwt\" (UniqueName: \"kubernetes.io/projected/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-kube-api-access-lpqwt\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.338585 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.338517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6z5x\" (UniqueName: \"kubernetes.io/projected/ed445928-ba3e-48e4-af6c-677f5aa37123-kube-api-access-p6z5x\") pod \"kube-state-metrics-8469c486bb-vqbpw\" (UID: \"ed445928-ba3e-48e4-af6c-677f5aa37123\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.430183 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430158 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xh6q\" (UniqueName: \"kubernetes.io/projected/c5455f15-f33e-4be5-b10d-b295e21694e2-kube-api-access-6xh6q\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430292 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430194 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-sys\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430292 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430218 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-tls\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430292 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430236 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430436 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430380 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-sys\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430486 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430433 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5455f15-f33e-4be5-b10d-b295e21694e2-metrics-client-ca\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430486 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430475 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-root\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430584 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430510 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430584 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430544 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-wtmp\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430584 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-root\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430710 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430607 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-textfile\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430710 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430693 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-wtmp\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430757 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430968 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430889 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5455f15-f33e-4be5-b10d-b295e21694e2-metrics-client-ca\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.430968 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.430938 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-textfile\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.432400 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.432381 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-tls\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.432816 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.432770 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5455f15-f33e-4be5-b10d-b295e21694e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.438496 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.438476 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xh6q\" (UniqueName: \"kubernetes.io/projected/c5455f15-f33e-4be5-b10d-b295e21694e2-kube-api-access-6xh6q\") pod \"node-exporter-cx644\" (UID: \"c5455f15-f33e-4be5-b10d-b295e21694e2\") " pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.480136 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.480105 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" Jun 02 17:02:59.495887 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.495862 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cx644" Jun 02 17:02:59.504390 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:59.504365 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5455f15_f33e_4be5_b10d_b295e21694e2.slice/crio-baef0cd93f37fde678cdabe85404882f9956f3b70245e3201d813808e148ee40 WatchSource:0}: Error finding container baef0cd93f37fde678cdabe85404882f9956f3b70245e3201d813808e148ee40: Status 404 returned error can't find the container with id baef0cd93f37fde678cdabe85404882f9956f3b70245e3201d813808e148ee40 Jun 02 17:02:59.609356 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.609321 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw"] Jun 02 17:02:59.612263 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:02:59.612239 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded445928_ba3e_48e4_af6c_677f5aa37123.slice/crio-42a32f6a1a1278921c4b97f60d64369fc0f23f619e8a776008c80ff458873888 WatchSource:0}: Error finding container 42a32f6a1a1278921c4b97f60d64369fc0f23f619e8a776008c80ff458873888: Status 404 returned error can't find the container with id 42a32f6a1a1278921c4b97f60d64369fc0f23f619e8a776008c80ff458873888 Jun 02 17:02:59.835089 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.835006 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:02:59.837487 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:02:59.837466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4nj\" (UID: \"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:03:00.065083 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.065043 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" Jun 02 17:03:00.190826 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.190779 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:00.207977 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.207919 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:00.208148 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.208114 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.209724 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.209695 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bt4nj"] Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.214863 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.214962 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.214868 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.215179 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.215296 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.215369 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.215367 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.215491 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.215605 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 17:03:00.215623 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.215620 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xf8vp\"" Jun 02 17:03:00.220153 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:03:00.219759 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21c0f2f_8ade_40be_941c_fd8b9f1a2dbe.slice/crio-addc937b163283a4740738ec64a5bd264ddc66caa4ad85362bc5112443afa97a WatchSource:0}: Error finding container addc937b163283a4740738ec64a5bd264ddc66caa4ad85362bc5112443afa97a: Status 404 returned error can't find the container with id addc937b163283a4740738ec64a5bd264ddc66caa4ad85362bc5112443afa97a Jun 02 17:03:00.339028 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.338993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339028 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339039 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339260 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339260 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339260 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339426 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339426 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339301 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339426 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-web-config\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339426 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339377 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgphn\" (UniqueName: \"kubernetes.io/projected/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-kube-api-access-mgphn\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339426 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339409 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-config-out\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339676 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339676 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-config-volume\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.339676 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.339485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.381666 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.381625 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" event={"ID":"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe","Type":"ContainerStarted","Data":"e5c43d071a9d4e1379e83dacc72e58993782fa3511a9e36a604678f9c310fff2"} Jun 02 17:03:00.381889 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.381672 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" event={"ID":"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe","Type":"ContainerStarted","Data":"addc937b163283a4740738ec64a5bd264ddc66caa4ad85362bc5112443afa97a"} Jun 02 17:03:00.382631 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.382605 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" event={"ID":"ed445928-ba3e-48e4-af6c-677f5aa37123","Type":"ContainerStarted","Data":"42a32f6a1a1278921c4b97f60d64369fc0f23f619e8a776008c80ff458873888"} Jun 02 17:03:00.383659 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.383624 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cx644" event={"ID":"c5455f15-f33e-4be5-b10d-b295e21694e2","Type":"ContainerStarted","Data":"baef0cd93f37fde678cdabe85404882f9956f3b70245e3201d813808e148ee40"} Jun 02 17:03:00.440029 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440000 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.440150 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440050 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.440150 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440085 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.440150 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440118 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.440150 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440142 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440594 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440671 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-web-config\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440701 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgphn\" (UniqueName: \"kubernetes.io/projected/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-kube-api-access-mgphn\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440733 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-config-out\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440763 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440768 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440794 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-config-volume\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440862 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.442465 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.440902 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.443881 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.443509 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.443881 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.443620 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.444329 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.444282 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.446013 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.445501 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.446013 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.445966 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.446641 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.446615 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-web-config\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.447163 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.447115 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.447163 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.447126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.447305 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.447267 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-config-out\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.447829 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.447761 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.449062 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.448792 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-config-volume\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.450046 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.450011 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgphn\" (UniqueName: \"kubernetes.io/projected/533a9a4b-94e5-4a1e-8c01-651ca5014ee4-kube-api-access-mgphn\") pod \"alertmanager-main-0\" (UID: \"533a9a4b-94e5-4a1e-8c01-651ca5014ee4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.523786 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.523751 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:00.674864 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:00.674829 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:00.857141 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:03:00.857102 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533a9a4b_94e5_4a1e_8c01_651ca5014ee4.slice/crio-22d6b8b67f1a54fea6842278530bf4570db9f5e7ca421190138f105454099395 WatchSource:0}: Error finding container 22d6b8b67f1a54fea6842278530bf4570db9f5e7ca421190138f105454099395: Status 404 returned error can't find the container with id 22d6b8b67f1a54fea6842278530bf4570db9f5e7ca421190138f105454099395 Jun 02 17:03:01.127082 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.127000 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77bbff8785-gmr9d"] Jun 02 17:03:01.144181 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.143620 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.144528 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.144504 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77bbff8785-gmr9d"] Jun 02 17:03:01.146613 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.146586 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ds4fh\"" Jun 02 17:03:01.146755 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.146598 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 17:03:01.146885 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.146864 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 17:03:01.147022 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.146907 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bgb89hepm4ve6\"" Jun 02 17:03:01.147022 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.146934 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 17:03:01.147022 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.146979 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 17:03:01.147194 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.147174 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 17:03:01.247534 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.247929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.247929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.247929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-grpc-tls\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.247929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247692 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-tls\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.247929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.247929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247763 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60587889-8ecf-4a28-915f-5d71ffb7331f-metrics-client-ca\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.247929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.247778 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qwzk\" (UniqueName: \"kubernetes.io/projected/60587889-8ecf-4a28-915f-5d71ffb7331f-kube-api-access-9qwzk\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349096 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349064 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349259 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349104 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349259 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349130 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349259 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349159 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-grpc-tls\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349259 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349181 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-tls\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349259 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349211 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349259 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349231 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60587889-8ecf-4a28-915f-5d71ffb7331f-metrics-client-ca\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.349522 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.349476 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qwzk\" (UniqueName: \"kubernetes.io/projected/60587889-8ecf-4a28-915f-5d71ffb7331f-kube-api-access-9qwzk\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.350288 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.350235 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60587889-8ecf-4a28-915f-5d71ffb7331f-metrics-client-ca\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.351926 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.351895 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.352198 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.352177 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-tls\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.352277 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.352213 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.352634 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.352611 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.352706 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.352678 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.352841 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.352824 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60587889-8ecf-4a28-915f-5d71ffb7331f-secret-grpc-tls\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.358101 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.358079 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qwzk\" (UniqueName: \"kubernetes.io/projected/60587889-8ecf-4a28-915f-5d71ffb7331f-kube-api-access-9qwzk\") pod \"thanos-querier-77bbff8785-gmr9d\" (UID: \"60587889-8ecf-4a28-915f-5d71ffb7331f\") " pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.387566 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.387513 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" event={"ID":"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe","Type":"ContainerStarted","Data":"c1d15a96b153dd9c1f232526970f7f2870537769ac0c3c8a970790cd2618fa76"} Jun 02 17:03:01.388635 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.388615 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerStarted","Data":"22d6b8b67f1a54fea6842278530bf4570db9f5e7ca421190138f105454099395"} Jun 02 17:03:01.456106 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.456072 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:01.727727 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:01.727673 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77bbff8785-gmr9d"] Jun 02 17:03:01.732292 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:03:01.732260 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60587889_8ecf_4a28_915f_5d71ffb7331f.slice/crio-6f7781af35abd72ab36935d59c960abe857540050376465cc2493fa962e41ff8 WatchSource:0}: Error finding container 6f7781af35abd72ab36935d59c960abe857540050376465cc2493fa962e41ff8: Status 404 returned error can't find the container with id 6f7781af35abd72ab36935d59c960abe857540050376465cc2493fa962e41ff8 Jun 02 17:03:02.392929 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:02.392892 2555 generic.go:358] "Generic (PLEG): container finished" podID="c5455f15-f33e-4be5-b10d-b295e21694e2" containerID="a27e1b330e2b93b1f47ec07ccbbc74443db6efc515ed897e512556d3eb2a0efa" exitCode=0 Jun 02 17:03:02.393434 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:02.392978 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cx644" event={"ID":"c5455f15-f33e-4be5-b10d-b295e21694e2","Type":"ContainerDied","Data":"a27e1b330e2b93b1f47ec07ccbbc74443db6efc515ed897e512556d3eb2a0efa"} Jun 02 17:03:02.394552 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:02.394513 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" event={"ID":"60587889-8ecf-4a28-915f-5d71ffb7331f","Type":"ContainerStarted","Data":"6f7781af35abd72ab36935d59c960abe857540050376465cc2493fa962e41ff8"} Jun 02 17:03:02.396636 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:02.396567 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" event={"ID":"ed445928-ba3e-48e4-af6c-677f5aa37123","Type":"ContainerStarted","Data":"3cd197a45674acb67bb957ea8753c420c6ddf7756003d482da966172010b9783"} Jun 02 17:03:02.396636 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:02.396599 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" event={"ID":"ed445928-ba3e-48e4-af6c-677f5aa37123","Type":"ContainerStarted","Data":"19d0521c438ad334fda348951d51d20feebeef1eefbd8a3728a1084a47cf3c9b"} Jun 02 17:03:02.396636 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:02.396616 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" event={"ID":"ed445928-ba3e-48e4-af6c-677f5aa37123","Type":"ContainerStarted","Data":"34c463f43df1023418ad4e0afde1f753aa7ec8055e9b19e118ca6973cb0dd607"} Jun 02 17:03:02.428392 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:02.428351 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-vqbpw" podStartSLOduration=1.449838436 podStartE2EDuration="3.42833398s" podCreationTimestamp="2026-06-02 17:02:59 +0000 UTC" firstStartedPulling="2026-06-02 17:02:59.614041856 +0000 UTC m=+93.100749281" lastFinishedPulling="2026-06-02 17:03:01.592537395 +0000 UTC m=+95.079244825" observedRunningTime="2026-06-02 17:03:02.427476749 +0000 UTC m=+95.914184212" watchObservedRunningTime="2026-06-02 17:03:02.42833398 +0000 UTC m=+95.915041429" Jun 02 17:03:03.402029 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.401980 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" event={"ID":"f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe","Type":"ContainerStarted","Data":"1518b83860efbb6e4f5896b775ffe04530b36a44a4deee739cd39846d70fba0c"} Jun 02 17:03:03.403687 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.403652 2555 generic.go:358] "Generic (PLEG): container finished" podID="533a9a4b-94e5-4a1e-8c01-651ca5014ee4" containerID="cac0031d0fed484124903637b745354215203074ac3061c46a4ae90098f77195" exitCode=0 Jun 02 17:03:03.403837 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.403785 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerDied","Data":"cac0031d0fed484124903637b745354215203074ac3061c46a4ae90098f77195"} Jun 02 17:03:03.406258 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.406231 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cx644" event={"ID":"c5455f15-f33e-4be5-b10d-b295e21694e2","Type":"ContainerStarted","Data":"970b582c4ab2bdaa3d1c032052f2040dabf969d037466b16ca4e9ddd039e7b07"} Jun 02 17:03:03.406375 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.406268 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cx644" event={"ID":"c5455f15-f33e-4be5-b10d-b295e21694e2","Type":"ContainerStarted","Data":"2cf8bbaeb7a9aa5b86be29f91a54493929dbb194bb03b79f57cfa0bc4bad0290"} Jun 02 17:03:03.449864 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.449775 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4nj" podStartSLOduration=1.917222167 podStartE2EDuration="4.449759495s" podCreationTimestamp="2026-06-02 17:02:59 +0000 UTC" firstStartedPulling="2026-06-02 17:03:00.557254464 +0000 UTC m=+94.043961894" lastFinishedPulling="2026-06-02 17:03:03.089791787 +0000 UTC m=+96.576499222" observedRunningTime="2026-06-02 17:03:03.419670105 +0000 UTC m=+96.906377551" watchObservedRunningTime="2026-06-02 17:03:03.449759495 +0000 UTC m=+96.936466942" Jun 02 17:03:03.590119 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.590046 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c49fb5f5c-g24j9"] Jun 02 17:03:03.618023 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.617994 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c49fb5f5c-g24j9"] Jun 02 17:03:03.618175 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.618136 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.621327 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.621051 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 17:03:03.621327 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.621071 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sv2kw\"" Jun 02 17:03:03.621327 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.621194 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7n1vgg40ut0fg\"" Jun 02 17:03:03.621534 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.621433 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 17:03:03.621621 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.621607 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 17:03:03.621837 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.621777 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 17:03:03.770348 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.770312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23660e3b-3155-44ea-baff-db5d743732b9-metrics-server-audit-profiles\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.770507 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.770360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-client-ca-bundle\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.770507 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.770401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-secret-metrics-server-client-certs\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.770507 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.770424 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23660e3b-3155-44ea-baff-db5d743732b9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.770507 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.770443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23660e3b-3155-44ea-baff-db5d743732b9-audit-log\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.770507 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.770474 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpx4s\" (UniqueName: \"kubernetes.io/projected/23660e3b-3155-44ea-baff-db5d743732b9-kube-api-access-cpx4s\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.770664 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.770523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-secret-metrics-server-tls\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.871853 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.871771 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23660e3b-3155-44ea-baff-db5d743732b9-metrics-server-audit-profiles\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.871853 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.871830 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-client-ca-bundle\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.871853 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.871852 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-secret-metrics-server-client-certs\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.872130 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.871876 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23660e3b-3155-44ea-baff-db5d743732b9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.872130 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.871895 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23660e3b-3155-44ea-baff-db5d743732b9-audit-log\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.872130 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.871914 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpx4s\" (UniqueName: \"kubernetes.io/projected/23660e3b-3155-44ea-baff-db5d743732b9-kube-api-access-cpx4s\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.872130 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.871968 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-secret-metrics-server-tls\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.872364 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.872311 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23660e3b-3155-44ea-baff-db5d743732b9-audit-log\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.872651 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.872585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23660e3b-3155-44ea-baff-db5d743732b9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.872999 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.872978 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23660e3b-3155-44ea-baff-db5d743732b9-metrics-server-audit-profiles\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.874518 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.874494 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-client-ca-bundle\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.874599 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.874516 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-secret-metrics-server-client-certs\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.874599 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.874523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23660e3b-3155-44ea-baff-db5d743732b9-secret-metrics-server-tls\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.892916 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.890278 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpx4s\" (UniqueName: \"kubernetes.io/projected/23660e3b-3155-44ea-baff-db5d743732b9-kube-api-access-cpx4s\") pod \"metrics-server-c49fb5f5c-g24j9\" (UID: \"23660e3b-3155-44ea-baff-db5d743732b9\") " pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.930039 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.930010 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:03.935362 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.935331 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42"] Jun 02 17:03:03.955200 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.955171 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42"] Jun 02 17:03:03.955391 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.955288 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" Jun 02 17:03:03.957849 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.957828 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 17:03:03.957982 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:03.957889 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-sb9zq\"" Jun 02 17:03:04.073755 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:04.073713 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd4bfef-2289-43b6-863a-830fff75a3fa-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-vzh42\" (UID: \"4fd4bfef-2289-43b6-863a-830fff75a3fa\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" Jun 02 17:03:04.175007 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:04.174964 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd4bfef-2289-43b6-863a-830fff75a3fa-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-vzh42\" (UID: \"4fd4bfef-2289-43b6-863a-830fff75a3fa\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" Jun 02 17:03:04.177889 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:04.177870 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd4bfef-2289-43b6-863a-830fff75a3fa-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-vzh42\" (UID: \"4fd4bfef-2289-43b6-863a-830fff75a3fa\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" Jun 02 17:03:04.268302 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:04.268268 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" Jun 02 17:03:04.429516 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:04.428914 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cx644" podStartSLOduration=3.344404001 podStartE2EDuration="5.428894197s" podCreationTimestamp="2026-06-02 17:02:59 +0000 UTC" firstStartedPulling="2026-06-02 17:02:59.50655264 +0000 UTC m=+92.993260065" lastFinishedPulling="2026-06-02 17:03:01.591042831 +0000 UTC m=+95.077750261" observedRunningTime="2026-06-02 17:03:04.427190145 +0000 UTC m=+97.913897605" watchObservedRunningTime="2026-06-02 17:03:04.428894197 +0000 UTC m=+97.915601645" Jun 02 17:03:04.671252 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:04.671219 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42"] Jun 02 17:03:04.674101 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:03:04.674073 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd4bfef_2289_43b6_863a_830fff75a3fa.slice/crio-1872dd4a6ff6ba3ce5aa30ed3f8e2281cb9fbce56b6ac18787c01d9d4a2240b2 WatchSource:0}: Error finding container 1872dd4a6ff6ba3ce5aa30ed3f8e2281cb9fbce56b6ac18787c01d9d4a2240b2: Status 404 returned error can't find the container with id 1872dd4a6ff6ba3ce5aa30ed3f8e2281cb9fbce56b6ac18787c01d9d4a2240b2 Jun 02 17:03:04.699174 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:04.699109 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c49fb5f5c-g24j9"] Jun 02 17:03:04.703149 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:03:04.703121 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23660e3b_3155_44ea_baff_db5d743732b9.slice/crio-873d6af3b9a3e42f3693061ba51f8d8f836e993558d8bd7de748c6b0943993df WatchSource:0}: Error finding container 873d6af3b9a3e42f3693061ba51f8d8f836e993558d8bd7de748c6b0943993df: Status 404 returned error can't find the container with id 873d6af3b9a3e42f3693061ba51f8d8f836e993558d8bd7de748c6b0943993df Jun 02 17:03:05.364690 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.363222 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 17:03:05.379031 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.378783 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 17:03:05.379235 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.379001 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.384191 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.383050 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 17:03:05.384191 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.383335 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6stc06eong6jh\"" Jun 02 17:03:05.384191 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.383548 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 17:03:05.384191 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.383791 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 17:03:05.384191 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.384007 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 17:03:05.384191 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.384023 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 17:03:05.385720 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.384722 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bvbkn\"" Jun 02 17:03:05.385720 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.384971 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 17:03:05.385720 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.385225 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 17:03:05.385720 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.384974 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 17:03:05.385720 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.385664 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 17:03:05.386527 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.386056 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 17:03:05.388426 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.388164 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 17:03:05.391365 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.391331 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 17:03:05.415031 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.414999 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" event={"ID":"60587889-8ecf-4a28-915f-5d71ffb7331f","Type":"ContainerStarted","Data":"738bbee9caab2f45c74424bc7277b59c4c69a32a441f74dbc186768eeabc4b91"} Jun 02 17:03:05.415180 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.415041 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" event={"ID":"60587889-8ecf-4a28-915f-5d71ffb7331f","Type":"ContainerStarted","Data":"1d739bd1efb868ccd7c7ad1afd053805dc6d1ccf28f74f9e0cf1b4c97ca49107"} Jun 02 17:03:05.416515 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.416484 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" event={"ID":"23660e3b-3155-44ea-baff-db5d743732b9","Type":"ContainerStarted","Data":"873d6af3b9a3e42f3693061ba51f8d8f836e993558d8bd7de748c6b0943993df"} Jun 02 17:03:05.421083 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.421051 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" event={"ID":"4fd4bfef-2289-43b6-863a-830fff75a3fa","Type":"ContainerStarted","Data":"1872dd4a6ff6ba3ce5aa30ed3f8e2281cb9fbce56b6ac18787c01d9d4a2240b2"} Jun 02 17:03:05.490646 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.490602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.490660 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.490749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.490817 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gbnv\" (UniqueName: \"kubernetes.io/projected/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-kube-api-access-5gbnv\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.490872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.490911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.490939 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491003 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-config\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491127 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491151 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491713 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491182 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491713 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491210 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491713 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491235 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491713 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491713 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.491713 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.491327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592427 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592484 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592513 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592541 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592692 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-config\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592745 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592783 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592831 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592857 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592889 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592914 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592949 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.592985 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.593010 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.593045 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.593075 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.602586 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.593123 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.593149 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gbnv\" (UniqueName: \"kubernetes.io/projected/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-kube-api-access-5gbnv\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.594094 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.594753 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.595365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.597224 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.597693 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.600593 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.600772 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.601285 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.603541 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.602329 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.604153 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.604111 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gbnv\" (UniqueName: \"kubernetes.io/projected/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-kube-api-access-5gbnv\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.605468 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.605412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.606078 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.606026 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.606637 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.606601 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-config\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.607000 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.606958 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.607183 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.607157 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.607903 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.607859 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.610085 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.609665 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.610085 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.611439 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8288b70b-9eae-444b-b7ee-5da06eeb1b1c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8288b70b-9eae-444b-b7ee-5da06eeb1b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.700725 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.700694 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:05.857452 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:05.857119 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 17:03:05.861912 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:03:05.861760 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8288b70b_9eae_444b_b7ee_5da06eeb1b1c.slice/crio-85f87f0b9be78b4e6a494d0e8a3222135ab0fbe1ee1c99e3a38a01f6ffecc6e6 WatchSource:0}: Error finding container 85f87f0b9be78b4e6a494d0e8a3222135ab0fbe1ee1c99e3a38a01f6ffecc6e6: Status 404 returned error can't find the container with id 85f87f0b9be78b4e6a494d0e8a3222135ab0fbe1ee1c99e3a38a01f6ffecc6e6 Jun 02 17:03:06.426403 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:06.426361 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerStarted","Data":"85f87f0b9be78b4e6a494d0e8a3222135ab0fbe1ee1c99e3a38a01f6ffecc6e6"} Jun 02 17:03:06.428777 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:06.428745 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" event={"ID":"60587889-8ecf-4a28-915f-5d71ffb7331f","Type":"ContainerStarted","Data":"4681871d59a4b8bc639354ece9d9eaf06bf6d91eb6352d555c62c184b16dd951"} Jun 02 17:03:07.434095 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:07.434050 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerStarted","Data":"7e47b8aa16f59c56a68f1c7e3ad1b4fa4ec7889508d55bb10fb23a9c0c3fd2fa"} Jun 02 17:03:07.434552 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:07.434099 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerStarted","Data":"a5d02265935e09c27d18da34570730c62c54fab6bfcaa371d9789ebf87871f81"} Jun 02 17:03:07.435819 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:07.435707 2555 generic.go:358] "Generic (PLEG): container finished" podID="8288b70b-9eae-444b-b7ee-5da06eeb1b1c" containerID="dcf6d87f042a596d8143cec478b72b6ed0d10ab35318fc26f28a32ec1ebe39be" exitCode=0 Jun 02 17:03:07.435941 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:07.435822 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerDied","Data":"dcf6d87f042a596d8143cec478b72b6ed0d10ab35318fc26f28a32ec1ebe39be"} Jun 02 17:03:07.437875 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:07.437848 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" event={"ID":"23660e3b-3155-44ea-baff-db5d743732b9","Type":"ContainerStarted","Data":"6bcddc9ebded42e10f3638fece420e93c84972ab4e2c0840f16d950e24c7c111"} Jun 02 17:03:07.480371 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:07.480299 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" podStartSLOduration=2.3645520859999998 podStartE2EDuration="4.480282934s" podCreationTimestamp="2026-06-02 17:03:03 +0000 UTC" firstStartedPulling="2026-06-02 17:03:04.705118135 +0000 UTC m=+98.191825563" lastFinishedPulling="2026-06-02 17:03:06.820848984 +0000 UTC m=+100.307556411" observedRunningTime="2026-06-02 17:03:07.478021693 +0000 UTC m=+100.964729174" watchObservedRunningTime="2026-06-02 17:03:07.480282934 +0000 UTC m=+100.966990380" Jun 02 17:03:08.442520 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.442470 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" event={"ID":"4fd4bfef-2289-43b6-863a-830fff75a3fa","Type":"ContainerStarted","Data":"d3dd7c18a1c8f361acf0f7fc5451aac8db5f9e28959e2899d9b320023dd8fbfa"} Jun 02 17:03:08.443054 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.442718 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" Jun 02 17:03:08.446337 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.446300 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerStarted","Data":"c4d7f20838ddd8497ec5d98f6a5e2594f9d200ebbf9cc0378f5b30efaa3fce0f"} Jun 02 17:03:08.446463 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.446340 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerStarted","Data":"b97ac2ee2c8ad66134759d25d340ddcd2a58916676a7d5f8010cdb3b44a7a53d"} Jun 02 17:03:08.446463 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.446357 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerStarted","Data":"bdf68302c4e77eb254f0517dcf78422d8e146709f17194a090ad60873221e30c"} Jun 02 17:03:08.446463 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.446369 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"533a9a4b-94e5-4a1e-8c01-651ca5014ee4","Type":"ContainerStarted","Data":"b15e7986088cd21b877943e4c619cade3b10de5590290e59a5b6c54a006ad6a3"} Jun 02 17:03:08.449494 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.449475 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" Jun 02 17:03:08.450276 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.450204 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" event={"ID":"60587889-8ecf-4a28-915f-5d71ffb7331f","Type":"ContainerStarted","Data":"9bd138b8af3f70948fabbff86bb724b3f3bf5b0cfb4abefd74ced758f01648c9"} Jun 02 17:03:08.450276 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.450239 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" event={"ID":"60587889-8ecf-4a28-915f-5d71ffb7331f","Type":"ContainerStarted","Data":"f90623163b1fef4abd5e922c8dea37e06820cbf080fdd48ac8dddab69d9de083"} Jun 02 17:03:08.450276 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.450257 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" event={"ID":"60587889-8ecf-4a28-915f-5d71ffb7331f","Type":"ContainerStarted","Data":"5b680e566138cd36f137fe167cd5b4aa9f5a01cef80799e0a7f1f23010b379b6"} Jun 02 17:03:08.458915 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.458878 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-vzh42" podStartSLOduration=2.214388222 podStartE2EDuration="5.458867796s" podCreationTimestamp="2026-06-02 17:03:03 +0000 UTC" firstStartedPulling="2026-06-02 17:03:04.676908352 +0000 UTC m=+98.163615784" lastFinishedPulling="2026-06-02 17:03:07.921387918 +0000 UTC m=+101.408095358" observedRunningTime="2026-06-02 17:03:08.456867246 +0000 UTC m=+101.943574691" watchObservedRunningTime="2026-06-02 17:03:08.458867796 +0000 UTC m=+101.945575245" Jun 02 17:03:08.483402 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.483359 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.82200805 podStartE2EDuration="8.483345487s" podCreationTimestamp="2026-06-02 17:03:00 +0000 UTC" firstStartedPulling="2026-06-02 17:03:00.859789568 +0000 UTC m=+94.346496993" lastFinishedPulling="2026-06-02 17:03:06.521126994 +0000 UTC m=+100.007834430" observedRunningTime="2026-06-02 17:03:08.481053255 +0000 UTC m=+101.967760743" watchObservedRunningTime="2026-06-02 17:03:08.483345487 +0000 UTC m=+101.970052933" Jun 02 17:03:08.503017 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:08.502894 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" podStartSLOduration=1.314520093 podStartE2EDuration="7.502875629s" podCreationTimestamp="2026-06-02 17:03:01 +0000 UTC" firstStartedPulling="2026-06-02 17:03:01.734165253 +0000 UTC m=+95.220872678" lastFinishedPulling="2026-06-02 17:03:07.922520775 +0000 UTC m=+101.409228214" observedRunningTime="2026-06-02 17:03:08.501797207 +0000 UTC m=+101.988504656" watchObservedRunningTime="2026-06-02 17:03:08.502875629 +0000 UTC m=+101.989583059" Jun 02 17:03:09.454794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:09.454761 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:10.466302 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:10.466274 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77bbff8785-gmr9d" Jun 02 17:03:11.466445 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:11.466409 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerStarted","Data":"8319f4f7513be87a79aa84a75f52a8b1413987359dd87c2d3a91f5aa2db7fbcb"} Jun 02 17:03:11.466794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:11.466457 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerStarted","Data":"5899e194ca3067513c638eb0814f4a508d9f5dcad83c236ffb1f3f68f6ca32ec"} Jun 02 17:03:11.466794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:11.466472 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerStarted","Data":"94800559dadc615fbbdbb45c205f5423161471ba4d6ee79c480e7bdeba7b2daa"} Jun 02 17:03:11.466794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:11.466483 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerStarted","Data":"932983eede4958b53709ed2ff5f1b29d6b6a706b046f578d12801d5053d31fdf"} Jun 02 17:03:12.472403 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:12.472366 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerStarted","Data":"6e739cf12f336691d0a82a682176d16615fd75f7a93f4d13f1bf450a0f8686a1"} Jun 02 17:03:12.472403 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:12.472405 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8288b70b-9eae-444b-b7ee-5da06eeb1b1c","Type":"ContainerStarted","Data":"3f7bc44d4b3b34a7b728de4a54a8f9ee8b0de230830c52b2e2e05aacff8f84d2"} Jun 02 17:03:12.500822 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:12.500759 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.985688467 podStartE2EDuration="7.500746209s" podCreationTimestamp="2026-06-02 17:03:05 +0000 UTC" firstStartedPulling="2026-06-02 17:03:07.437115809 +0000 UTC m=+100.923823237" lastFinishedPulling="2026-06-02 17:03:10.952173551 +0000 UTC m=+104.438880979" observedRunningTime="2026-06-02 17:03:12.498919012 +0000 UTC m=+105.985626459" watchObservedRunningTime="2026-06-02 17:03:12.500746209 +0000 UTC m=+105.987453659" Jun 02 17:03:15.701600 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:15.701557 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:03:16.328401 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:16.328367 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfbct" Jun 02 17:03:21.730593 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:21.730554 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576d6476d5-vfxg8"] Jun 02 17:03:23.930730 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:23.930688 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:23.930730 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:23.930731 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:43.942887 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:43.941173 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:43.949025 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:43.949004 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c49fb5f5c-g24j9" Jun 02 17:03:46.751400 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:46.751360 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-576d6476d5-vfxg8" podUID="cd1fb418-8b94-436f-9812-7c0e4b6e9c86" containerName="console" containerID="cri-o://c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997" gracePeriod=15 Jun 02 17:03:46.995952 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:46.995928 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-576d6476d5-vfxg8_cd1fb418-8b94-436f-9812-7c0e4b6e9c86/console/0.log" Jun 02 17:03:46.996081 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:46.995998 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:03:47.073543 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073466 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-service-ca\") pod \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " Jun 02 17:03:47.073543 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073503 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-config\") pod \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " Jun 02 17:03:47.073543 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073540 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-oauth-config\") pod \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " Jun 02 17:03:47.073836 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073564 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-trusted-ca-bundle\") pod \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " Jun 02 17:03:47.073836 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073581 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-serving-cert\") pod \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " Jun 02 17:03:47.073836 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073611 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-oauth-serving-cert\") pod \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " Jun 02 17:03:47.073836 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073719 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2hzw\" (UniqueName: \"kubernetes.io/projected/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-kube-api-access-r2hzw\") pod \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\" (UID: \"cd1fb418-8b94-436f-9812-7c0e4b6e9c86\") " Jun 02 17:03:47.074026 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.073945 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd1fb418-8b94-436f-9812-7c0e4b6e9c86" (UID: "cd1fb418-8b94-436f-9812-7c0e4b6e9c86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:47.074119 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.074092 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd1fb418-8b94-436f-9812-7c0e4b6e9c86" (UID: "cd1fb418-8b94-436f-9812-7c0e4b6e9c86"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:47.074279 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.074128 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-config" (OuterVolumeSpecName: "console-config") pod "cd1fb418-8b94-436f-9812-7c0e4b6e9c86" (UID: "cd1fb418-8b94-436f-9812-7c0e4b6e9c86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:47.074279 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.074204 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd1fb418-8b94-436f-9812-7c0e4b6e9c86" (UID: "cd1fb418-8b94-436f-9812-7c0e4b6e9c86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:47.076179 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.076126 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd1fb418-8b94-436f-9812-7c0e4b6e9c86" (UID: "cd1fb418-8b94-436f-9812-7c0e4b6e9c86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:47.076270 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.076209 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd1fb418-8b94-436f-9812-7c0e4b6e9c86" (UID: "cd1fb418-8b94-436f-9812-7c0e4b6e9c86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:47.076433 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.076411 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-kube-api-access-r2hzw" (OuterVolumeSpecName: "kube-api-access-r2hzw") pod "cd1fb418-8b94-436f-9812-7c0e4b6e9c86" (UID: "cd1fb418-8b94-436f-9812-7c0e4b6e9c86"). InnerVolumeSpecName "kube-api-access-r2hzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:03:47.174618 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.174589 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-oauth-config\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:03:47.174618 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.174613 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-trusted-ca-bundle\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:03:47.174794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.174624 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-serving-cert\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:03:47.174794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.174636 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-oauth-serving-cert\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:03:47.174794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.174647 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2hzw\" (UniqueName: \"kubernetes.io/projected/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-kube-api-access-r2hzw\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:03:47.174794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.174658 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-service-ca\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:03:47.174794 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.174666 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd1fb418-8b94-436f-9812-7c0e4b6e9c86-console-config\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:03:47.581266 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.581239 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-576d6476d5-vfxg8_cd1fb418-8b94-436f-9812-7c0e4b6e9c86/console/0.log" Jun 02 17:03:47.581454 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.581281 2555 generic.go:358] "Generic (PLEG): container finished" podID="cd1fb418-8b94-436f-9812-7c0e4b6e9c86" containerID="c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997" exitCode=2 Jun 02 17:03:47.581454 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.581322 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d6476d5-vfxg8" event={"ID":"cd1fb418-8b94-436f-9812-7c0e4b6e9c86","Type":"ContainerDied","Data":"c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997"} Jun 02 17:03:47.581454 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.581371 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d6476d5-vfxg8" event={"ID":"cd1fb418-8b94-436f-9812-7c0e4b6e9c86","Type":"ContainerDied","Data":"d8e568c08d7fe509e5c838c588a2b8330d9b20883ef5f0eb7e1f4bbbcc03190b"} Jun 02 17:03:47.581454 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.581382 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d6476d5-vfxg8" Jun 02 17:03:47.581454 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.581394 2555 scope.go:117] "RemoveContainer" containerID="c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997" Jun 02 17:03:47.589613 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.589587 2555 scope.go:117] "RemoveContainer" containerID="c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997" Jun 02 17:03:47.589897 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:03:47.589879 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997\": container with ID starting with c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997 not found: ID does not exist" containerID="c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997" Jun 02 17:03:47.589954 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.589906 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997"} err="failed to get container status \"c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997\": rpc error: code = NotFound desc = could not find container \"c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997\": container with ID starting with c47d3cad013d04bb5c22bf1651473bc630ff3971df6c24b5253834d888560997 not found: ID does not exist" Jun 02 17:03:47.602998 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.602974 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576d6476d5-vfxg8"] Jun 02 17:03:47.606078 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:47.606059 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-576d6476d5-vfxg8"] Jun 02 17:03:49.042340 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:03:49.042301 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd1fb418-8b94-436f-9812-7c0e4b6e9c86" path="/var/lib/kubelet/pods/cd1fb418-8b94-436f-9812-7c0e4b6e9c86/volumes" Jun 02 17:04:05.701076 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:04:05.701038 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:04:05.721437 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:04:05.721408 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:04:06.654612 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:04:06.654585 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 17:06:08.217192 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.217157 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-cmv9x"] Jun 02 17:06:08.217593 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.217520 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd1fb418-8b94-436f-9812-7c0e4b6e9c86" containerName="console" Jun 02 17:06:08.217593 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.217533 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd1fb418-8b94-436f-9812-7c0e4b6e9c86" containerName="console" Jun 02 17:06:08.217668 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.217611 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd1fb418-8b94-436f-9812-7c0e4b6e9c86" containerName="console" Jun 02 17:06:08.220414 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.220398 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.223156 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.223133 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 17:06:08.223279 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.223166 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 17:06:08.224251 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.224235 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sr4m9\"" Jun 02 17:06:08.230074 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.230048 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-cmv9x"] Jun 02 17:06:08.271692 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.271657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/341c197e-a895-46f8-9aaa-c60099b5c0e9-bound-sa-token\") pod \"cert-manager-79c8d999ff-cmv9x\" (UID: \"341c197e-a895-46f8-9aaa-c60099b5c0e9\") " pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.271876 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.271842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kpgt\" (UniqueName: \"kubernetes.io/projected/341c197e-a895-46f8-9aaa-c60099b5c0e9-kube-api-access-5kpgt\") pod \"cert-manager-79c8d999ff-cmv9x\" (UID: \"341c197e-a895-46f8-9aaa-c60099b5c0e9\") " pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.372445 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.372397 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kpgt\" (UniqueName: \"kubernetes.io/projected/341c197e-a895-46f8-9aaa-c60099b5c0e9-kube-api-access-5kpgt\") pod \"cert-manager-79c8d999ff-cmv9x\" (UID: \"341c197e-a895-46f8-9aaa-c60099b5c0e9\") " pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.372619 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.372463 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/341c197e-a895-46f8-9aaa-c60099b5c0e9-bound-sa-token\") pod \"cert-manager-79c8d999ff-cmv9x\" (UID: \"341c197e-a895-46f8-9aaa-c60099b5c0e9\") " pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.383510 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.383473 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/341c197e-a895-46f8-9aaa-c60099b5c0e9-bound-sa-token\") pod \"cert-manager-79c8d999ff-cmv9x\" (UID: \"341c197e-a895-46f8-9aaa-c60099b5c0e9\") " pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.383695 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.383669 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kpgt\" (UniqueName: \"kubernetes.io/projected/341c197e-a895-46f8-9aaa-c60099b5c0e9-kube-api-access-5kpgt\") pod \"cert-manager-79c8d999ff-cmv9x\" (UID: \"341c197e-a895-46f8-9aaa-c60099b5c0e9\") " pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.541200 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.541111 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-cmv9x" Jun 02 17:06:08.666004 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.665917 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-cmv9x"] Jun 02 17:06:08.668826 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:06:08.668775 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod341c197e_a895_46f8_9aaa_c60099b5c0e9.slice/crio-d6649e2d2ab1c9f42fece6c67dc85a18306b2c70845fc415fe6a93ba008e8a96 WatchSource:0}: Error finding container d6649e2d2ab1c9f42fece6c67dc85a18306b2c70845fc415fe6a93ba008e8a96: Status 404 returned error can't find the container with id d6649e2d2ab1c9f42fece6c67dc85a18306b2c70845fc415fe6a93ba008e8a96 Jun 02 17:06:08.997585 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:08.997548 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-cmv9x" event={"ID":"341c197e-a895-46f8-9aaa-c60099b5c0e9","Type":"ContainerStarted","Data":"d6649e2d2ab1c9f42fece6c67dc85a18306b2c70845fc415fe6a93ba008e8a96"} Jun 02 17:06:12.011735 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:12.011688 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-cmv9x" event={"ID":"341c197e-a895-46f8-9aaa-c60099b5c0e9","Type":"ContainerStarted","Data":"b9550544c19830c17a760f4c2851376a5d5391a550bc382dc16174fff78c56e7"} Jun 02 17:06:12.030937 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:12.030887 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-cmv9x" podStartSLOduration=1.243717537 podStartE2EDuration="4.030871269s" podCreationTimestamp="2026-06-02 17:06:08 +0000 UTC" firstStartedPulling="2026-06-02 17:06:08.670721273 +0000 UTC m=+282.157428698" lastFinishedPulling="2026-06-02 17:06:11.457874998 +0000 UTC m=+284.944582430" observedRunningTime="2026-06-02 17:06:12.028349213 +0000 UTC m=+285.515056658" watchObservedRunningTime="2026-06-02 17:06:12.030871269 +0000 UTC m=+285.517578716" Jun 02 17:06:25.468855 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.468823 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr"] Jun 02 17:06:25.472499 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.472478 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.475117 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.475095 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:06:25.476213 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.476195 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 02 17:06:25.476308 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.476232 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-mvsdf\"" Jun 02 17:06:25.478708 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.478684 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr"] Jun 02 17:06:25.622857 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.622820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c846t\" (UniqueName: \"kubernetes.io/projected/2495c3a2-eab0-4e93-af00-ac21c12587ee-kube-api-access-c846t\") pod \"jobset-operator-747c5859c7-xfzvr\" (UID: \"2495c3a2-eab0-4e93-af00-ac21c12587ee\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.623030 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.622886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2495c3a2-eab0-4e93-af00-ac21c12587ee-tmp\") pod \"jobset-operator-747c5859c7-xfzvr\" (UID: \"2495c3a2-eab0-4e93-af00-ac21c12587ee\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.723733 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.723654 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2495c3a2-eab0-4e93-af00-ac21c12587ee-tmp\") pod \"jobset-operator-747c5859c7-xfzvr\" (UID: \"2495c3a2-eab0-4e93-af00-ac21c12587ee\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.723733 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.723712 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c846t\" (UniqueName: \"kubernetes.io/projected/2495c3a2-eab0-4e93-af00-ac21c12587ee-kube-api-access-c846t\") pod \"jobset-operator-747c5859c7-xfzvr\" (UID: \"2495c3a2-eab0-4e93-af00-ac21c12587ee\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.724034 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.724014 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2495c3a2-eab0-4e93-af00-ac21c12587ee-tmp\") pod \"jobset-operator-747c5859c7-xfzvr\" (UID: \"2495c3a2-eab0-4e93-af00-ac21c12587ee\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.731590 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.731571 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c846t\" (UniqueName: \"kubernetes.io/projected/2495c3a2-eab0-4e93-af00-ac21c12587ee-kube-api-access-c846t\") pod \"jobset-operator-747c5859c7-xfzvr\" (UID: \"2495c3a2-eab0-4e93-af00-ac21c12587ee\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.782651 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.782616 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" Jun 02 17:06:25.922346 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:25.922320 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr"] Jun 02 17:06:25.925143 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:06:25.925112 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2495c3a2_eab0_4e93_af00_ac21c12587ee.slice/crio-7f1eb6caab199fe0619ec15f6349d7ea8b83ad3a378426264334374bd263a0df WatchSource:0}: Error finding container 7f1eb6caab199fe0619ec15f6349d7ea8b83ad3a378426264334374bd263a0df: Status 404 returned error can't find the container with id 7f1eb6caab199fe0619ec15f6349d7ea8b83ad3a378426264334374bd263a0df Jun 02 17:06:26.051016 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:26.050920 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" event={"ID":"2495c3a2-eab0-4e93-af00-ac21c12587ee","Type":"ContainerStarted","Data":"7f1eb6caab199fe0619ec15f6349d7ea8b83ad3a378426264334374bd263a0df"} Jun 02 17:06:26.943177 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:26.943147 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:06:26.943612 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:26.943235 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:06:26.948202 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:26.948175 2555 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 17:06:29.060776 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:29.060740 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" event={"ID":"2495c3a2-eab0-4e93-af00-ac21c12587ee","Type":"ContainerStarted","Data":"98b884afdc18cac19a1d2906bb4430e12b4c26127b5063e8ffa1c62a9dc2aa83"} Jun 02 17:06:29.078491 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:29.078405 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-xfzvr" podStartSLOduration=1.186365529 podStartE2EDuration="4.078391026s" podCreationTimestamp="2026-06-02 17:06:25 +0000 UTC" firstStartedPulling="2026-06-02 17:06:25.927028428 +0000 UTC m=+299.413735854" lastFinishedPulling="2026-06-02 17:06:28.819053923 +0000 UTC m=+302.305761351" observedRunningTime="2026-06-02 17:06:29.07689075 +0000 UTC m=+302.563598198" watchObservedRunningTime="2026-06-02 17:06:29.078391026 +0000 UTC m=+302.565098475" Jun 02 17:06:53.485629 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.485597 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x"] Jun 02 17:06:53.490395 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.490375 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.493060 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.493029 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 17:06:53.493183 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.493118 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 02 17:06:53.494236 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.494216 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 02 17:06:53.494342 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.494241 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 17:06:53.494342 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.494310 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-t76w2\"" Jun 02 17:06:53.499043 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.499021 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x"] Jun 02 17:06:53.547649 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.547614 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9c728886-20f2-40b0-ad9d-ac4005278751-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.547881 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.547679 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rzf\" (UniqueName: \"kubernetes.io/projected/9c728886-20f2-40b0-ad9d-ac4005278751-kube-api-access-s2rzf\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.547881 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.547788 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c728886-20f2-40b0-ad9d-ac4005278751-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.648476 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.648443 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c728886-20f2-40b0-ad9d-ac4005278751-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.648657 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.648503 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9c728886-20f2-40b0-ad9d-ac4005278751-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.648657 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.648586 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rzf\" (UniqueName: \"kubernetes.io/projected/9c728886-20f2-40b0-ad9d-ac4005278751-kube-api-access-s2rzf\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.649150 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.649125 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9c728886-20f2-40b0-ad9d-ac4005278751-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.650925 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.650905 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c728886-20f2-40b0-ad9d-ac4005278751-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.658205 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.658179 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rzf\" (UniqueName: \"kubernetes.io/projected/9c728886-20f2-40b0-ad9d-ac4005278751-kube-api-access-s2rzf\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-l786x\" (UID: \"9c728886-20f2-40b0-ad9d-ac4005278751\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.800556 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.800471 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:53.933547 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.933507 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x"] Jun 02 17:06:53.937134 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:06:53.937102 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c728886_20f2_40b0_ad9d_ac4005278751.slice/crio-4ea849318bc14d658409446512f0843c166ed866978bc9a501869a366296a9e5 WatchSource:0}: Error finding container 4ea849318bc14d658409446512f0843c166ed866978bc9a501869a366296a9e5: Status 404 returned error can't find the container with id 4ea849318bc14d658409446512f0843c166ed866978bc9a501869a366296a9e5 Jun 02 17:06:53.939161 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:53.939146 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 17:06:54.131204 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:54.131110 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" event={"ID":"9c728886-20f2-40b0-ad9d-ac4005278751","Type":"ContainerStarted","Data":"4ea849318bc14d658409446512f0843c166ed866978bc9a501869a366296a9e5"} Jun 02 17:06:57.143193 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:57.143152 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" event={"ID":"9c728886-20f2-40b0-ad9d-ac4005278751","Type":"ContainerStarted","Data":"0ab612508264cd88f9eba3761d4c5ea8897b0c432bda27e2c8f1e8825711f3c6"} Jun 02 17:06:57.143589 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:57.143279 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:06:57.163685 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:06:57.163639 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" podStartSLOduration=1.755177177 podStartE2EDuration="4.163625783s" podCreationTimestamp="2026-06-02 17:06:53 +0000 UTC" firstStartedPulling="2026-06-02 17:06:53.939270771 +0000 UTC m=+327.425978197" lastFinishedPulling="2026-06-02 17:06:56.347719376 +0000 UTC m=+329.834426803" observedRunningTime="2026-06-02 17:06:57.162846725 +0000 UTC m=+330.649554170" watchObservedRunningTime="2026-06-02 17:06:57.163625783 +0000 UTC m=+330.650333230" Jun 02 17:07:13.153876 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:07:13.153764 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-l786x" Jun 02 17:08:50.802645 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.802555 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z"] Jun 02 17:08:50.806146 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.806127 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" Jun 02 17:08:50.808733 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.808712 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-8fbfb\"/\"kube-root-ca.crt\"" Jun 02 17:08:50.812825 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.809201 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-8fbfb\"/\"openshift-service-ca.crt\"" Jun 02 17:08:50.812825 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.809265 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-8fbfb\"/\"default-dockercfg-s7nwq\"" Jun 02 17:08:50.816622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.816600 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z"] Jun 02 17:08:50.840345 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.840303 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtff\" (UniqueName: \"kubernetes.io/projected/c667e5ba-ea7a-4cab-91b0-7da5641cd217-kube-api-access-cjtff\") pod \"test-trainjob-hbl5l-node-0-0-4ng2z\" (UID: \"c667e5ba-ea7a-4cab-91b0-7da5641cd217\") " pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" Jun 02 17:08:50.941071 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.941031 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtff\" (UniqueName: \"kubernetes.io/projected/c667e5ba-ea7a-4cab-91b0-7da5641cd217-kube-api-access-cjtff\") pod \"test-trainjob-hbl5l-node-0-0-4ng2z\" (UID: \"c667e5ba-ea7a-4cab-91b0-7da5641cd217\") " pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" Jun 02 17:08:50.949887 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:50.949859 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtff\" (UniqueName: \"kubernetes.io/projected/c667e5ba-ea7a-4cab-91b0-7da5641cd217-kube-api-access-cjtff\") pod \"test-trainjob-hbl5l-node-0-0-4ng2z\" (UID: \"c667e5ba-ea7a-4cab-91b0-7da5641cd217\") " pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" Jun 02 17:08:51.120385 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:51.120306 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" Jun 02 17:08:51.249368 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:51.249339 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z"] Jun 02 17:08:51.252080 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:08:51.252045 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc667e5ba_ea7a_4cab_91b0_7da5641cd217.slice/crio-5d8bffc4e14435e059c41e5d33c74b85a265bfb05b0021b13d28c992c41ca3ab WatchSource:0}: Error finding container 5d8bffc4e14435e059c41e5d33c74b85a265bfb05b0021b13d28c992c41ca3ab: Status 404 returned error can't find the container with id 5d8bffc4e14435e059c41e5d33c74b85a265bfb05b0021b13d28c992c41ca3ab Jun 02 17:08:51.482642 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:08:51.482599 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" event={"ID":"c667e5ba-ea7a-4cab-91b0-7da5641cd217","Type":"ContainerStarted","Data":"5d8bffc4e14435e059c41e5d33c74b85a265bfb05b0021b13d28c992c41ca3ab"} Jun 02 17:11:26.966874 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:11:26.966848 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:11:26.968044 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:11:26.968018 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:13:24.402207 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:24.402169 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" event={"ID":"c667e5ba-ea7a-4cab-91b0-7da5641cd217","Type":"ContainerStarted","Data":"d10bb9b17ee62e14ad0fb4f250c1316ce5d33b5d590b36484b880fb7dfa14ce8"} Jun 02 17:13:24.432020 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:24.431972 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" podStartSLOduration=2.354906765 podStartE2EDuration="4m34.431957918s" podCreationTimestamp="2026-06-02 17:08:50 +0000 UTC" firstStartedPulling="2026-06-02 17:08:51.254404212 +0000 UTC m=+444.741111638" lastFinishedPulling="2026-06-02 17:13:23.331455363 +0000 UTC m=+716.818162791" observedRunningTime="2026-06-02 17:13:24.430352716 +0000 UTC m=+717.917060163" watchObservedRunningTime="2026-06-02 17:13:24.431957918 +0000 UTC m=+717.918665364" Jun 02 17:13:26.663997 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:26.663967 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8fbfb_test-trainjob-hbl5l-node-0-0-4ng2z_c667e5ba-ea7a-4cab-91b0-7da5641cd217/node/0.log" Jun 02 17:13:29.418816 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:29.418778 2555 generic.go:358] "Generic (PLEG): container finished" podID="c667e5ba-ea7a-4cab-91b0-7da5641cd217" containerID="d10bb9b17ee62e14ad0fb4f250c1316ce5d33b5d590b36484b880fb7dfa14ce8" exitCode=0 Jun 02 17:13:29.419277 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:29.418853 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" event={"ID":"c667e5ba-ea7a-4cab-91b0-7da5641cd217","Type":"ContainerDied","Data":"d10bb9b17ee62e14ad0fb4f250c1316ce5d33b5d590b36484b880fb7dfa14ce8"} Jun 02 17:13:29.661057 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:29.661023 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8fbfb_test-trainjob-hbl5l-node-0-0-4ng2z_c667e5ba-ea7a-4cab-91b0-7da5641cd217/node/0.log" Jun 02 17:13:30.557149 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:30.557126 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" Jun 02 17:13:30.685212 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:30.685122 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjtff\" (UniqueName: \"kubernetes.io/projected/c667e5ba-ea7a-4cab-91b0-7da5641cd217-kube-api-access-cjtff\") pod \"c667e5ba-ea7a-4cab-91b0-7da5641cd217\" (UID: \"c667e5ba-ea7a-4cab-91b0-7da5641cd217\") " Jun 02 17:13:30.687405 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:30.687364 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c667e5ba-ea7a-4cab-91b0-7da5641cd217-kube-api-access-cjtff" (OuterVolumeSpecName: "kube-api-access-cjtff") pod "c667e5ba-ea7a-4cab-91b0-7da5641cd217" (UID: "c667e5ba-ea7a-4cab-91b0-7da5641cd217"). InnerVolumeSpecName "kube-api-access-cjtff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:13:30.786626 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:30.786584 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjtff\" (UniqueName: \"kubernetes.io/projected/c667e5ba-ea7a-4cab-91b0-7da5641cd217-kube-api-access-cjtff\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:13:31.425660 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:31.425624 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" event={"ID":"c667e5ba-ea7a-4cab-91b0-7da5641cd217","Type":"ContainerDied","Data":"5d8bffc4e14435e059c41e5d33c74b85a265bfb05b0021b13d28c992c41ca3ab"} Jun 02 17:13:31.425660 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:31.425663 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d8bffc4e14435e059c41e5d33c74b85a265bfb05b0021b13d28c992c41ca3ab" Jun 02 17:13:31.425904 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:31.425664 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z" Jun 02 17:13:31.975672 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:31.975643 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-8fbfb_test-trainjob-hbl5l-node-0-0-4ng2z_c667e5ba-ea7a-4cab-91b0-7da5641cd217/node/0.log" Jun 02 17:13:33.105469 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.105436 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k2b4n/must-gather-ht8c2"] Jun 02 17:13:33.105870 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.105764 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c667e5ba-ea7a-4cab-91b0-7da5641cd217" containerName="node" Jun 02 17:13:33.105870 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.105774 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c667e5ba-ea7a-4cab-91b0-7da5641cd217" containerName="node" Jun 02 17:13:33.105957 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.105887 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="c667e5ba-ea7a-4cab-91b0-7da5641cd217" containerName="node" Jun 02 17:13:33.139888 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.139853 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k2b4n/must-gather-ht8c2"] Jun 02 17:13:33.140024 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.139954 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.143428 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.143404 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k2b4n\"/\"default-dockercfg-dkd5l\"" Jun 02 17:13:33.143531 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.143446 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k2b4n\"/\"openshift-service-ca.crt\"" Jun 02 17:13:33.143531 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.143453 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k2b4n\"/\"kube-root-ca.crt\"" Jun 02 17:13:33.207949 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.207909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qt5\" (UniqueName: \"kubernetes.io/projected/488a7280-5c76-4ef2-bae7-d43111f8a91c-kube-api-access-g2qt5\") pod \"must-gather-ht8c2\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.208138 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.207961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/488a7280-5c76-4ef2-bae7-d43111f8a91c-must-gather-output\") pod \"must-gather-ht8c2\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.308640 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.308612 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qt5\" (UniqueName: \"kubernetes.io/projected/488a7280-5c76-4ef2-bae7-d43111f8a91c-kube-api-access-g2qt5\") pod \"must-gather-ht8c2\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.308780 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.308652 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/488a7280-5c76-4ef2-bae7-d43111f8a91c-must-gather-output\") pod \"must-gather-ht8c2\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.308959 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.308943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/488a7280-5c76-4ef2-bae7-d43111f8a91c-must-gather-output\") pod \"must-gather-ht8c2\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.320769 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.320739 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qt5\" (UniqueName: \"kubernetes.io/projected/488a7280-5c76-4ef2-bae7-d43111f8a91c-kube-api-access-g2qt5\") pod \"must-gather-ht8c2\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.449063 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.449040 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:13:33.580005 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.578742 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k2b4n/must-gather-ht8c2"] Jun 02 17:13:33.583586 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:13:33.583553 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod488a7280_5c76_4ef2_bae7_d43111f8a91c.slice/crio-6ac6a3086e13706265c7033e88cf7c41745d9e639487e6b0806a61a188386b61 WatchSource:0}: Error finding container 6ac6a3086e13706265c7033e88cf7c41745d9e639487e6b0806a61a188386b61: Status 404 returned error can't find the container with id 6ac6a3086e13706265c7033e88cf7c41745d9e639487e6b0806a61a188386b61 Jun 02 17:13:33.585457 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:33.585436 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 17:13:34.439549 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:34.439504 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" event={"ID":"488a7280-5c76-4ef2-bae7-d43111f8a91c","Type":"ContainerStarted","Data":"6ac6a3086e13706265c7033e88cf7c41745d9e639487e6b0806a61a188386b61"} Jun 02 17:13:37.023915 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:37.023881 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z"] Jun 02 17:13:37.027900 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:37.027869 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-8fbfb/test-trainjob-hbl5l-node-0-0-4ng2z"] Jun 02 17:13:37.044034 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:37.044005 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c667e5ba-ea7a-4cab-91b0-7da5641cd217" path="/var/lib/kubelet/pods/c667e5ba-ea7a-4cab-91b0-7da5641cd217/volumes" Jun 02 17:13:41.466545 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:41.466509 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" event={"ID":"488a7280-5c76-4ef2-bae7-d43111f8a91c","Type":"ContainerStarted","Data":"e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7"} Jun 02 17:13:41.466545 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:41.466550 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" event={"ID":"488a7280-5c76-4ef2-bae7-d43111f8a91c","Type":"ContainerStarted","Data":"e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf"} Jun 02 17:13:41.488330 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:41.488273 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" podStartSLOduration=1.0715126719999999 podStartE2EDuration="8.488257663s" podCreationTimestamp="2026-06-02 17:13:33 +0000 UTC" firstStartedPulling="2026-06-02 17:13:33.585618765 +0000 UTC m=+727.072326190" lastFinishedPulling="2026-06-02 17:13:41.002363754 +0000 UTC m=+734.489071181" observedRunningTime="2026-06-02 17:13:41.487045511 +0000 UTC m=+734.973752971" watchObservedRunningTime="2026-06-02 17:13:41.488257663 +0000 UTC m=+734.974965109" Jun 02 17:13:51.716819 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:51.716781 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-l786x_9c728886-20f2-40b0-ad9d-ac4005278751/manager/0.log" Jun 02 17:13:52.283441 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:52.283407 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-l786x_9c728886-20f2-40b0-ad9d-ac4005278751/manager/0.log" Jun 02 17:13:52.870385 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:13:52.870355 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-l786x_9c728886-20f2-40b0-ad9d-ac4005278751/manager/0.log" Jun 02 17:14:33.655996 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:33.655955 2555 generic.go:358] "Generic (PLEG): container finished" podID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerID="e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf" exitCode=0 Jun 02 17:14:33.656408 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:33.656003 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" event={"ID":"488a7280-5c76-4ef2-bae7-d43111f8a91c","Type":"ContainerDied","Data":"e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf"} Jun 02 17:14:33.656408 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:33.656325 2555 scope.go:117] "RemoveContainer" containerID="e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf" Jun 02 17:14:33.756061 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:33.756036 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-k2b4n_must-gather-ht8c2_488a7280-5c76-4ef2-bae7-d43111f8a91c/gather/0.log" Jun 02 17:14:37.000612 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:37.000577 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sp2qr_fd3d63de-f035-4b13-b443-b2669d1e523a/global-pull-secret-syncer/0.log" Jun 02 17:14:37.101627 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:37.101592 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b9c6j_1f8e92c1-5482-4a83-b7dc-01c3da765141/konnectivity-agent/0.log" Jun 02 17:14:37.265429 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:37.265339 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-142.ec2.internal_87e6df01ce1c000adb1652ffb3234aa6/haproxy/0.log" Jun 02 17:14:39.122499 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.122461 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-k2b4n/must-gather-ht8c2"] Jun 02 17:14:39.122921 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.122694 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerName="copy" containerID="cri-o://e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7" gracePeriod=2 Jun 02 17:14:39.148026 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.147995 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-k2b4n/must-gather-ht8c2"] Jun 02 17:14:39.362703 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.362681 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-k2b4n_must-gather-ht8c2_488a7280-5c76-4ef2-bae7-d43111f8a91c/copy/0.log" Jun 02 17:14:39.363055 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.363040 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:14:39.368124 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.368098 2555 status_manager.go:895] "Failed to get status for pod" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" err="pods \"must-gather-ht8c2\" is forbidden: User \"system:node:ip-10-0-141-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-k2b4n\": no relationship found between node 'ip-10-0-141-142.ec2.internal' and this object" Jun 02 17:14:39.490883 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.490859 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2qt5\" (UniqueName: \"kubernetes.io/projected/488a7280-5c76-4ef2-bae7-d43111f8a91c-kube-api-access-g2qt5\") pod \"488a7280-5c76-4ef2-bae7-d43111f8a91c\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " Jun 02 17:14:39.490986 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.490923 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/488a7280-5c76-4ef2-bae7-d43111f8a91c-must-gather-output\") pod \"488a7280-5c76-4ef2-bae7-d43111f8a91c\" (UID: \"488a7280-5c76-4ef2-bae7-d43111f8a91c\") " Jun 02 17:14:39.493108 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.493082 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/488a7280-5c76-4ef2-bae7-d43111f8a91c-kube-api-access-g2qt5" (OuterVolumeSpecName: "kube-api-access-g2qt5") pod "488a7280-5c76-4ef2-bae7-d43111f8a91c" (UID: "488a7280-5c76-4ef2-bae7-d43111f8a91c"). InnerVolumeSpecName "kube-api-access-g2qt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:14:39.493228 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.493203 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/488a7280-5c76-4ef2-bae7-d43111f8a91c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "488a7280-5c76-4ef2-bae7-d43111f8a91c" (UID: "488a7280-5c76-4ef2-bae7-d43111f8a91c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:14:39.591730 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.591689 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2qt5\" (UniqueName: \"kubernetes.io/projected/488a7280-5c76-4ef2-bae7-d43111f8a91c-kube-api-access-g2qt5\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:14:39.591730 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.591723 2555 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/488a7280-5c76-4ef2-bae7-d43111f8a91c-must-gather-output\") on node \"ip-10-0-141-142.ec2.internal\" DevicePath \"\"" Jun 02 17:14:39.676691 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.676658 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-k2b4n_must-gather-ht8c2_488a7280-5c76-4ef2-bae7-d43111f8a91c/copy/0.log" Jun 02 17:14:39.677060 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.677036 2555 generic.go:358] "Generic (PLEG): container finished" podID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerID="e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7" exitCode=143 Jun 02 17:14:39.677142 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.677094 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" Jun 02 17:14:39.677142 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.677112 2555 scope.go:117] "RemoveContainer" containerID="e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7" Jun 02 17:14:39.680972 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.680943 2555 status_manager.go:895] "Failed to get status for pod" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" err="pods \"must-gather-ht8c2\" is forbidden: User \"system:node:ip-10-0-141-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-k2b4n\": no relationship found between node 'ip-10-0-141-142.ec2.internal' and this object" Jun 02 17:14:39.685641 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.685617 2555 scope.go:117] "RemoveContainer" containerID="e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf" Jun 02 17:14:39.688354 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.688332 2555 status_manager.go:895] "Failed to get status for pod" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" pod="openshift-must-gather-k2b4n/must-gather-ht8c2" err="pods \"must-gather-ht8c2\" is forbidden: User \"system:node:ip-10-0-141-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-k2b4n\": no relationship found between node 'ip-10-0-141-142.ec2.internal' and this object" Jun 02 17:14:39.698192 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.698176 2555 scope.go:117] "RemoveContainer" containerID="e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7" Jun 02 17:14:39.698416 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:14:39.698396 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7\": container with ID starting with e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7 not found: ID does not exist" containerID="e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7" Jun 02 17:14:39.698467 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.698424 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7"} err="failed to get container status \"e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7\": rpc error: code = NotFound desc = could not find container \"e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7\": container with ID starting with e0510710040ba6577bae6d3397f23371e9a6321554d7cc6aa79aa7a2dd8942f7 not found: ID does not exist" Jun 02 17:14:39.698467 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.698445 2555 scope.go:117] "RemoveContainer" containerID="e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf" Jun 02 17:14:39.698678 ip-10-0-141-142 kubenswrapper[2555]: E0602 17:14:39.698662 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf\": container with ID starting with e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf not found: ID does not exist" containerID="e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf" Jun 02 17:14:39.698730 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:39.698684 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf"} err="failed to get container status \"e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf\": rpc error: code = NotFound desc = could not find container \"e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf\": container with ID starting with e8f46e921fcf121f5184e82752f7df8929f2fcf77bfe76c76da340bd0838b8bf not found: ID does not exist" Jun 02 17:14:40.036183 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.036158 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_533a9a4b-94e5-4a1e-8c01-651ca5014ee4/alertmanager/0.log" Jun 02 17:14:40.065431 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.065409 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_533a9a4b-94e5-4a1e-8c01-651ca5014ee4/config-reloader/0.log" Jun 02 17:14:40.091453 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.091429 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_533a9a4b-94e5-4a1e-8c01-651ca5014ee4/kube-rbac-proxy-web/0.log" Jun 02 17:14:40.132447 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.132424 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_533a9a4b-94e5-4a1e-8c01-651ca5014ee4/kube-rbac-proxy/0.log" Jun 02 17:14:40.168514 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.168493 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_533a9a4b-94e5-4a1e-8c01-651ca5014ee4/kube-rbac-proxy-metric/0.log" Jun 02 17:14:40.196776 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.196746 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_533a9a4b-94e5-4a1e-8c01-651ca5014ee4/prom-label-proxy/0.log" Jun 02 17:14:40.240852 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.240821 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_533a9a4b-94e5-4a1e-8c01-651ca5014ee4/init-config-reloader/0.log" Jun 02 17:14:40.340881 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.340850 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vqbpw_ed445928-ba3e-48e4-af6c-677f5aa37123/kube-state-metrics/0.log" Jun 02 17:14:40.364110 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.364090 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vqbpw_ed445928-ba3e-48e4-af6c-677f5aa37123/kube-rbac-proxy-main/0.log" Jun 02 17:14:40.387709 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.387683 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-vqbpw_ed445928-ba3e-48e4-af6c-677f5aa37123/kube-rbac-proxy-self/0.log" Jun 02 17:14:40.417208 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.417191 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c49fb5f5c-g24j9_23660e3b-3155-44ea-baff-db5d743732b9/metrics-server/0.log" Jun 02 17:14:40.443945 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.443919 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-vzh42_4fd4bfef-2289-43b6-863a-830fff75a3fa/monitoring-plugin/0.log" Jun 02 17:14:40.578069 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.577980 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cx644_c5455f15-f33e-4be5-b10d-b295e21694e2/node-exporter/0.log" Jun 02 17:14:40.601197 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.601171 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cx644_c5455f15-f33e-4be5-b10d-b295e21694e2/kube-rbac-proxy/0.log" Jun 02 17:14:40.622622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.622602 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cx644_c5455f15-f33e-4be5-b10d-b295e21694e2/init-textfile/0.log" Jun 02 17:14:40.738088 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.738060 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bt4nj_f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe/kube-rbac-proxy-main/0.log" Jun 02 17:14:40.763125 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.763070 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bt4nj_f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe/kube-rbac-proxy-self/0.log" Jun 02 17:14:40.793521 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.793490 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bt4nj_f21c0f2f-8ade-40be-941c-fd8b9f1a2dbe/openshift-state-metrics/0.log" Jun 02 17:14:40.834410 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.834336 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8288b70b-9eae-444b-b7ee-5da06eeb1b1c/prometheus/0.log" Jun 02 17:14:40.861220 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.861188 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8288b70b-9eae-444b-b7ee-5da06eeb1b1c/config-reloader/0.log" Jun 02 17:14:40.887386 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.887360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8288b70b-9eae-444b-b7ee-5da06eeb1b1c/thanos-sidecar/0.log" Jun 02 17:14:40.914306 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.914278 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8288b70b-9eae-444b-b7ee-5da06eeb1b1c/kube-rbac-proxy-web/0.log" Jun 02 17:14:40.943303 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.943276 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8288b70b-9eae-444b-b7ee-5da06eeb1b1c/kube-rbac-proxy/0.log" Jun 02 17:14:40.979189 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:40.979164 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8288b70b-9eae-444b-b7ee-5da06eeb1b1c/kube-rbac-proxy-thanos/0.log" Jun 02 17:14:41.006149 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.006128 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8288b70b-9eae-444b-b7ee-5da06eeb1b1c/init-config-reloader/0.log" Jun 02 17:14:41.041254 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.041227 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" path="/var/lib/kubelet/pods/488a7280-5c76-4ef2-bae7-d43111f8a91c/volumes" Jun 02 17:14:41.045934 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.045917 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-gjvxp_adc5b620-981d-4b69-9ce8-5328a54ce509/prometheus-operator/0.log" Jun 02 17:14:41.073277 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.073247 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-gjvxp_adc5b620-981d-4b69-9ce8-5328a54ce509/kube-rbac-proxy/0.log" Jun 02 17:14:41.246218 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.246185 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77bbff8785-gmr9d_60587889-8ecf-4a28-915f-5d71ffb7331f/thanos-query/0.log" Jun 02 17:14:41.298466 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.298445 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77bbff8785-gmr9d_60587889-8ecf-4a28-915f-5d71ffb7331f/kube-rbac-proxy-web/0.log" Jun 02 17:14:41.373700 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.373649 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77bbff8785-gmr9d_60587889-8ecf-4a28-915f-5d71ffb7331f/kube-rbac-proxy/0.log" Jun 02 17:14:41.410991 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.410967 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77bbff8785-gmr9d_60587889-8ecf-4a28-915f-5d71ffb7331f/prom-label-proxy/0.log" Jun 02 17:14:41.455298 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.455272 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77bbff8785-gmr9d_60587889-8ecf-4a28-915f-5d71ffb7331f/kube-rbac-proxy-rules/0.log" Jun 02 17:14:41.488777 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:41.488743 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77bbff8785-gmr9d_60587889-8ecf-4a28-915f-5d71ffb7331f/kube-rbac-proxy-metrics/0.log" Jun 02 17:14:43.671089 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.671060 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-7xkdq_3812feaa-6803-4d19-bc4d-03d6261d32e6/download-server/0.log" Jun 02 17:14:43.755568 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.755537 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc"] Jun 02 17:14:43.755966 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.755949 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerName="copy" Jun 02 17:14:43.756068 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.755967 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerName="copy" Jun 02 17:14:43.756068 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.755987 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerName="gather" Jun 02 17:14:43.756068 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.755995 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerName="gather" Jun 02 17:14:43.756215 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.756090 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerName="gather" Jun 02 17:14:43.756215 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.756106 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="488a7280-5c76-4ef2-bae7-d43111f8a91c" containerName="copy" Jun 02 17:14:43.759593 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.759575 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:43.764266 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.764237 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-blsj6\"/\"default-dockercfg-69hm5\"" Jun 02 17:14:43.764266 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.764259 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-blsj6\"/\"kube-root-ca.crt\"" Jun 02 17:14:43.764406 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.764238 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-blsj6\"/\"openshift-service-ca.crt\"" Jun 02 17:14:43.769839 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.769817 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc"] Jun 02 17:14:43.932182 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.932155 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgzkf\" (UniqueName: \"kubernetes.io/projected/2d379b54-823e-4b6a-9320-fd90898a1eac-kube-api-access-dgzkf\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:43.932345 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.932212 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-proc\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:43.932345 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.932289 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-lib-modules\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:43.932345 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.932317 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-podres\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:43.932345 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:43.932336 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-sys\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.033665 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033621 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgzkf\" (UniqueName: \"kubernetes.io/projected/2d379b54-823e-4b6a-9320-fd90898a1eac-kube-api-access-dgzkf\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.033876 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033709 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-proc\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.033876 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033741 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-lib-modules\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.033876 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033763 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-podres\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.033876 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033795 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-sys\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.033876 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-proc\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.034104 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033880 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-sys\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.034104 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033925 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-lib-modules\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.034104 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.033964 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d379b54-823e-4b6a-9320-fd90898a1eac-podres\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.044242 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.044217 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgzkf\" (UniqueName: \"kubernetes.io/projected/2d379b54-823e-4b6a-9320-fd90898a1eac-kube-api-access-dgzkf\") pod \"perf-node-gather-daemonset-v2pkc\" (UID: \"2d379b54-823e-4b6a-9320-fd90898a1eac\") " pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.069815 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.069777 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.197433 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.197399 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc"] Jun 02 17:14:44.199996 ip-10-0-141-142 kubenswrapper[2555]: W0602 17:14:44.199969 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d379b54_823e_4b6a_9320_fd90898a1eac.slice/crio-35f8b8637af0823c1b59bb7b1b9a545dc7a93d3afab17bbc09104ac6a2ec2a6d WatchSource:0}: Error finding container 35f8b8637af0823c1b59bb7b1b9a545dc7a93d3afab17bbc09104ac6a2ec2a6d: Status 404 returned error can't find the container with id 35f8b8637af0823c1b59bb7b1b9a545dc7a93d3afab17bbc09104ac6a2ec2a6d Jun 02 17:14:44.699887 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.699848 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" event={"ID":"2d379b54-823e-4b6a-9320-fd90898a1eac","Type":"ContainerStarted","Data":"4f4c05ce8596984ecf1f0c2ed2dd28730c34a9ab1e3b1f15d2c371bcc00c9959"} Jun 02 17:14:44.700273 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.699894 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" event={"ID":"2d379b54-823e-4b6a-9320-fd90898a1eac","Type":"ContainerStarted","Data":"35f8b8637af0823c1b59bb7b1b9a545dc7a93d3afab17bbc09104ac6a2ec2a6d"} Jun 02 17:14:44.700273 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.699957 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:44.723594 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.723548 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" podStartSLOduration=1.723536453 podStartE2EDuration="1.723536453s" podCreationTimestamp="2026-06-02 17:14:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:14:44.722530208 +0000 UTC m=+798.209237656" watchObservedRunningTime="2026-06-02 17:14:44.723536453 +0000 UTC m=+798.210243900" Jun 02 17:14:44.992500 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:44.992427 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cjmfr_51260992-dd01-4775-8210-7728d4076e81/dns/0.log" Jun 02 17:14:45.035417 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:45.035396 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cjmfr_51260992-dd01-4775-8210-7728d4076e81/kube-rbac-proxy/0.log" Jun 02 17:14:45.160371 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:45.160342 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gmcgl_f6429a92-f38c-4f60-869b-3aee5835318a/dns-node-resolver/0.log" Jun 02 17:14:45.736954 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:45.736924 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bdw4_7fc3cb36-c502-41e1-90ad-33255b0ace73/node-ca/0.log" Jun 02 17:14:46.917356 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:46.917321 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4d9m9_3057023f-c2e8-4d1c-b0e5-79df3261432d/serve-healthcheck-canary/0.log" Jun 02 17:14:47.478888 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:47.478859 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c6qxb_63358fee-6cd3-4e42-91ae-7407f8e4162e/kube-rbac-proxy/0.log" Jun 02 17:14:47.514860 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:47.514834 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c6qxb_63358fee-6cd3-4e42-91ae-7407f8e4162e/exporter/0.log" Jun 02 17:14:47.560580 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:47.560550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c6qxb_63358fee-6cd3-4e42-91ae-7407f8e4162e/extractor/0.log" Jun 02 17:14:49.806381 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:49.806351 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-xfzvr_2495c3a2-eab0-4e93-af00-ac21c12587ee/jobset-operator/0.log" Jun 02 17:14:50.711888 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:50.711860 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-blsj6/perf-node-gather-daemonset-v2pkc" Jun 02 17:14:55.326875 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.326846 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhwn6_491c36f1-4223-4f5b-8dcf-fba0a99015ec/kube-multus-additional-cni-plugins/0.log" Jun 02 17:14:55.351622 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.351586 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhwn6_491c36f1-4223-4f5b-8dcf-fba0a99015ec/egress-router-binary-copy/0.log" Jun 02 17:14:55.378024 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.377996 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhwn6_491c36f1-4223-4f5b-8dcf-fba0a99015ec/cni-plugins/0.log" Jun 02 17:14:55.401540 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.401514 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhwn6_491c36f1-4223-4f5b-8dcf-fba0a99015ec/bond-cni-plugin/0.log" Jun 02 17:14:55.426705 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.426678 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhwn6_491c36f1-4223-4f5b-8dcf-fba0a99015ec/routeoverride-cni/0.log" Jun 02 17:14:55.455690 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.455662 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhwn6_491c36f1-4223-4f5b-8dcf-fba0a99015ec/whereabouts-cni-bincopy/0.log" Jun 02 17:14:55.477994 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.477926 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dhwn6_491c36f1-4223-4f5b-8dcf-fba0a99015ec/whereabouts-cni/0.log" Jun 02 17:14:55.703490 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.703446 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fzpwv_b1d034b8-85c8-44bf-ac99-ee9c72a3842d/kube-multus/0.log" Jun 02 17:14:55.803620 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.803542 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pd7mm_46629318-af6e-4221-8694-2f1cc2a21d9e/network-metrics-daemon/0.log" Jun 02 17:14:55.873168 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:55.873138 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pd7mm_46629318-af6e-4221-8694-2f1cc2a21d9e/kube-rbac-proxy/0.log" Jun 02 17:14:56.738510 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.738480 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-controller/0.log" Jun 02 17:14:56.776625 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.776602 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/0.log" Jun 02 17:14:56.787464 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.787436 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovn-acl-logging/1.log" Jun 02 17:14:56.835981 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.835959 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/kube-rbac-proxy-node/0.log" Jun 02 17:14:56.871340 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.871315 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 17:14:56.916477 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.916455 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/northd/0.log" Jun 02 17:14:56.952918 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.952897 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/nbdb/0.log" Jun 02 17:14:56.983908 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:56.983887 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/sbdb/0.log" Jun 02 17:14:57.087608 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:57.087516 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-47xpb_522a9658-3edc-4e24-8e27-28625f1169c1/ovnkube-controller/0.log" Jun 02 17:14:59.369428 ip-10-0-141-142 kubenswrapper[2555]: I0602 17:14:59.369397 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jfbct_3e07d9f5-8072-45ce-9445-6f63761014f3/network-check-target-container/0.log"