Sep 17 17:32:15.072342 ip-10-0-139-254 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 17:32:15.072351 ip-10-0-139-254 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 17:32:15.072358 ip-10-0-139-254 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 17:32:15.072498 ip-10-0-139-254 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 17:32:26.192346 ip-10-0-139-254 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 17:32:26.192363 ip-10-0-139-254 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c2d02d28fa4b44c09d44e8249490bc03 -- Sep 17 17:34:11.766001 ip-10-0-139-254 systemd[1]: Starting Kubernetes Kubelet... Sep 17 17:34:15.655923 ip-10-0-139-254 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:15.655923 ip-10-0-139-254 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 17:34:15.655923 ip-10-0-139-254 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:15.655923 ip-10-0-139-254 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 17:34:15.655923 ip-10-0-139-254 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 17:34:15.656768 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.656049 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 17:34:15.659778 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659761 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:15.659778 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659777 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659782 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659791 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659795 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659798 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659801 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659805 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659808 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659811 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659814 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659817 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659820 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659823 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659826 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659829 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659832 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659835 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659838 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659840 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:15.659845 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659843 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659846 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659849 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659854 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659859 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659862 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659865 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659868 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659871 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659874 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659877 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659879 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659882 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659885 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659888 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659890 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659894 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659896 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659899 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:15.660342 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659902 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659906 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659910 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659913 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659916 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659918 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659921 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659924 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659926 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659929 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659932 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659934 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659937 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659940 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659942 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659948 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659950 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659953 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659958 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:15.661246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659962 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659965 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659968 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659971 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659974 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659977 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659980 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659983 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659985 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659988 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659991 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659994 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.659997 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660000 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660002 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660005 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660007 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660010 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660013 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:15.662154 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660016 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660018 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660021 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660024 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660027 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660029 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660032 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660036 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660039 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660042 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660046 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660048 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660051 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660054 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660057 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660060 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660062 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660065 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660068 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660071 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:15.663078 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660074 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.660077 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662457 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662473 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662480 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662485 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662490 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662498 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662505 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662510 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662516 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662520 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662525 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662529 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662534 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662539 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662544 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662548 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662553 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:15.664019 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662557 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662562 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662566 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662570 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662575 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662579 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662584 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662588 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662593 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662597 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662604 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662611 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662617 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662622 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662627 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662631 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662636 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662642 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662646 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:15.664947 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662651 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662656 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662660 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662665 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662669 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662677 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662684 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662689 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662694 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662699 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662704 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662708 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662713 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662717 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662722 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662727 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662731 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662735 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662755 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662761 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:15.665882 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662765 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662770 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662774 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662779 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662784 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662789 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662794 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662798 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662802 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662808 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662812 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662817 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662822 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662826 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662831 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662836 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662841 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662846 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662850 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662855 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:15.666429 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662860 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662864 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662869 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662873 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662878 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662882 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662887 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662893 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662898 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662902 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662907 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662912 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662916 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662921 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662925 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662930 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662934 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662939 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662943 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662948 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:15.667110 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662952 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662958 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.662962 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663590 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663603 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663610 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663616 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663621 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663626 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663632 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663636 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663641 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663645 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663650 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663655 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663659 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663664 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663668 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663673 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663679 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:15.667720 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663684 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663689 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663693 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663697 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663702 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663706 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663710 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663715 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663719 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663723 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663729 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663751 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663757 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663762 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663767 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663772 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663776 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663780 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663785 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663790 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:15.668446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663797 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663801 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663806 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663810 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663815 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663819 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663824 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663828 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663833 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663837 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663841 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663846 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663853 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663862 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663867 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663873 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663878 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663883 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663888 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:15.669069 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663892 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663897 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663901 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663906 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663910 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663915 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663920 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663924 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663928 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663933 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663937 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663942 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663946 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663952 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663957 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663961 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663966 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663970 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663974 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663979 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:15.669630 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663984 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663988 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663992 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.663997 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664001 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664006 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664011 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664016 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664020 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664024 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664028 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664035 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664041 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664045 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664050 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664057 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664062 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664067 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664071 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:15.670192 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664076 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664080 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664085 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.664089 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664196 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664253 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664263 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664270 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664278 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664283 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664290 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664296 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664302 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664308 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664314 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664319 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664325 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664330 2577 flags.go:64] FLAG: --cgroup-root="" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664335 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664340 2577 flags.go:64] FLAG: --client-ca-file="" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664346 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664351 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664361 2577 flags.go:64] FLAG: --cluster-domain="" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664366 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 17:34:15.670700 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664372 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664377 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664383 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664396 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664401 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664406 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664412 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664417 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664423 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664428 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664433 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664438 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664445 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664450 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664455 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664461 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664466 2577 flags.go:64] FLAG: --enable-server="true" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664471 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664478 2577 flags.go:64] FLAG: --event-burst="100" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664483 2577 flags.go:64] FLAG: --event-qps="50" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664488 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664493 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664499 2577 flags.go:64] FLAG: --eviction-hard="" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664505 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 17:34:15.671356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664510 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664515 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664521 2577 flags.go:64] FLAG: --eviction-soft="" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664526 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664531 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664537 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664546 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664552 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664557 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664562 2577 flags.go:64] FLAG: --feature-gates="" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664568 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664574 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664579 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664584 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664589 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664594 2577 flags.go:64] FLAG: --help="false" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664600 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-254.ec2.internal" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664605 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664610 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664615 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664621 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664627 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664633 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 17:34:15.672039 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664638 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664643 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664648 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664653 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664659 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664664 2577 flags.go:64] FLAG: --kube-reserved="" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664669 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664674 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664679 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664684 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664689 2577 flags.go:64] FLAG: --lock-file="" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664694 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664699 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664705 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664714 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664726 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664731 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664753 2577 flags.go:64] FLAG: --logging-format="text" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664758 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664764 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664769 2577 flags.go:64] FLAG: --manifest-url="" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664773 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664781 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664786 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664793 2577 flags.go:64] FLAG: --max-pods="110" Sep 17 17:34:15.672799 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664798 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664803 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664808 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664813 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664818 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664824 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664829 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664841 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664846 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664851 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664856 2577 flags.go:64] FLAG: --pod-cidr="" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664861 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664870 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664875 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664880 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664885 2577 flags.go:64] FLAG: --port="10250" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664891 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664896 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08cd5163fedcef994" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664901 2577 flags.go:64] FLAG: --qos-reserved="" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664906 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664911 2577 flags.go:64] FLAG: --register-node="true" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664916 2577 flags.go:64] FLAG: --register-with-taints="" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664923 2577 flags.go:64] FLAG: --registry-burst="10" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664931 2577 flags.go:64] FLAG: --registry-qps="5" Sep 17 17:34:15.673465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664936 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664941 2577 flags.go:64] FLAG: --reserved-memory="" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664946 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664951 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664956 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664961 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664968 2577 flags.go:64] FLAG: --runonce="false" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664973 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664978 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664983 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664988 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664993 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.664998 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665003 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665008 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665013 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665018 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665024 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665028 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665034 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665039 2577 flags.go:64] FLAG: --system-cgroups="" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665044 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665054 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665059 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665064 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 17:34:15.674130 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665075 2577 flags.go:64] FLAG: --tls-min-version="" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665080 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665085 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665090 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665095 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665100 2577 flags.go:64] FLAG: --v="2" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665108 2577 flags.go:64] FLAG: --version="false" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665116 2577 flags.go:64] FLAG: --vmodule="" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665123 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.665129 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665328 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665335 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665339 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665346 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665354 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665362 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665370 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665376 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665381 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665386 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665391 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:15.674809 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665397 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665402 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665407 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665412 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665416 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665421 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665425 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665430 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665435 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665439 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665443 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665448 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665453 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665457 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665462 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665466 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665471 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665477 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665481 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665487 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:15.675390 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665491 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665495 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665500 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665504 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665511 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665516 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665520 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665525 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665529 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665533 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665538 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665542 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665547 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665551 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665556 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665561 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665565 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665570 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665574 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:15.675970 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665578 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665583 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665587 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665592 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665596 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665601 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665605 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665609 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665614 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665619 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665625 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665629 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665635 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665644 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665649 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665653 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665658 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665664 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665669 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:15.676468 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665673 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665678 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665682 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665688 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665693 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665697 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665702 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665706 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665711 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665715 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665720 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665726 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665749 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665755 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665760 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665765 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665769 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665774 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665779 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:15.677013 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665783 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665788 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665792 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665796 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665804 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665808 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665813 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665817 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665823 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665828 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.665832 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.666455 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.673876 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.673893 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.673912 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 17:34:15.677513 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.673918 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.673977 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.673983 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.673987 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.673990 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.673993 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.673997 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674000 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674003 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674005 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674009 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674012 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674016 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674020 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674023 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674026 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674029 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674032 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674035 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:15.677948 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674038 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674041 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674044 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674047 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674049 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674052 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674056 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674058 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674061 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674064 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674068 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674071 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674074 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674076 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674079 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674082 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674085 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674088 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674091 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674094 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:15.678465 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674097 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674100 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674102 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674105 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674108 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674111 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674114 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674116 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674119 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674122 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674125 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674128 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674130 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674133 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674137 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674140 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674143 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674146 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674148 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674152 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:15.679005 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674155 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674157 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674161 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674164 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674167 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674170 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674172 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674175 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674178 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674181 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674184 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674186 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674189 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674192 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674195 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674198 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674201 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674203 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674206 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674209 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:15.679554 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674212 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674214 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674219 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674223 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674226 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674229 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674232 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674235 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674238 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674240 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674243 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674246 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674249 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674252 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674255 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674258 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674263 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674266 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674269 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:15.680091 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674272 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674275 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.674281 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674412 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674417 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674420 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674423 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674426 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674429 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674432 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674435 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674438 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674441 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674444 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674446 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 17:34:15.680585 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674449 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674452 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674455 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674458 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674461 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674464 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674466 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674469 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674472 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674475 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674477 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674481 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674483 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674487 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674490 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674492 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674495 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674498 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674501 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674503 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 17:34:15.681111 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674506 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674509 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674512 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674515 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674518 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674521 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674524 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674526 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674530 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674532 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674535 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674538 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674541 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674543 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674547 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674552 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674556 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674560 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674563 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 17:34:15.681631 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674566 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674570 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674573 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674575 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674579 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674583 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674586 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674589 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674592 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674595 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674598 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674601 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674604 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674606 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674609 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674612 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674614 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674617 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674620 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674623 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 17:34:15.682152 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674625 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674628 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674631 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674634 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674636 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674639 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674642 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674645 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674648 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674650 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674653 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674656 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674659 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674661 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674664 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674667 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674669 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674672 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674675 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674678 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 17:34:15.682816 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674681 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674683 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674686 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674689 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674693 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674697 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674700 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:15.674703 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.674708 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.674824 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.676834 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.677755 2577 server.go:1019] "Starting client certificate rotation" Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.677866 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:34:15.683515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.677903 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 17:34:15.683946 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.680299 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:34:15.683946 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.681899 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 17:34:15.687896 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.687877 2577 log.go:25] "Validated CRI v1 runtime API" Sep 17 17:34:15.689683 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.689664 2577 log.go:25] "Validated CRI v1 image API" Sep 17 17:34:15.690542 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.690528 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 17:34:15.693016 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.692996 2577 fs.go:135] Filesystem UUIDs: map[773fcbd3-2960-473e-b824-2fff90c23dde:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a0450b61-203e-4483-bb0b-0e6d8e05ca7a:/dev/nvme0n1p3] Sep 17 17:34:15.693097 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.693015 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 17:34:15.698549 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.698429 2577 manager.go:216] Machine: {Timestamp:2026-09-17 17:34:15.697921857 +0000 UTC m=+2.174932022 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104586 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b6bb76060b3c8d3b83bc9d1af7b96 SystemUUID:ec2b6bb7-6060-b3c8-d3b8-3bc9d1af7b96 BootID:c2d02d28-fa4b-44c0-9d44-e8249490bc03 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d7:bb:b5:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d7:bb:b5:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:d5:44:b6:48:d6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 17:34:15.698549 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.698537 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 17:34:15.698719 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.698634 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 17:34:15.700172 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.700151 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 17:34:15.700313 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.700174 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-254.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 17:34:15.701385 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.701374 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 17:34:15.701430 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.701388 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 17:34:15.701430 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.701400 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:34:15.701430 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.701411 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 17:34:15.701514 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.701476 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 17:34:15.704849 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.704835 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:34:15.704970 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.704960 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 17:34:15.705013 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.704995 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 17 17:34:15.705013 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.705005 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 17:34:15.705083 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.705018 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 17:34:15.705083 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.705027 2577 kubelet.go:398] "Adding apiserver pod source" Sep 17 17:34:15.705083 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.705036 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 17:34:15.705361 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.705345 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:34:15.706103 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.705371 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 17:34:15.707840 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.707822 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 17:34:15.710031 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.710017 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 17:34:15.710097 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.710049 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 17:34:15.711206 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711189 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 17:34:15.711270 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711214 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 17:34:15.711270 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711225 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 17:34:15.711270 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711235 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 17:34:15.711270 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711248 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 17:34:15.711270 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711258 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711279 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711287 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711296 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711304 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711315 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711321 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711354 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 17:34:15.711424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.711360 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 17:34:15.715598 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.715577 2577 server.go:1268] "Started kubelet" Sep 17 17:34:15.715769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.715729 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 17:34:15.716044 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.715831 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 17:34:15.716250 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.716200 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 17:34:15.716450 ip-10-0-139-254 systemd[1]: Started Kubernetes Kubelet. Sep 17 17:34:15.717534 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.717291 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-254.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 17:34:15.717534 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.717410 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 17:34:15.717756 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.717507 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 17:34:15.717756 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.717548 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 17:34:15.718071 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.718044 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:34:15.718175 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.718150 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 17 17:34:15.752173 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.752123 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 17:34:15.753720 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.753697 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 17:34:15.753720 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.753717 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 17:34:15.753882 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.753839 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:15.754358 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754226 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 17:34:15.754358 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754246 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 17:34:15.754497 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754381 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 17 17:34:15.754497 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754389 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 17 17:34:15.754497 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754430 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 17:34:15.754832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754797 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 17:34:15.754832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754829 2577 factory.go:55] Registering systemd factory Sep 17 17:34:15.754972 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.754838 2577 factory.go:223] Registration of the systemd container factory successfully Sep 17 17:34:15.756394 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.756373 2577 factory.go:153] Registering CRI-O factory Sep 17 17:34:15.756477 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.756398 2577 factory.go:223] Registration of the crio container factory successfully Sep 17 17:34:15.756477 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.756422 2577 factory.go:103] Registering Raw factory Sep 17 17:34:15.756477 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.756436 2577 manager.go:1196] Started watching for new ooms in manager Sep 17 17:34:15.756841 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.756823 2577 manager.go:349] Starting recovery of all containers Sep 17 17:34:15.757451 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.757428 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 17:34:15.757529 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.757464 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 17:34:15.758651 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.757598 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-254.ec2.internal.18d62c28cf5bb090 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-254.ec2.internal,UID:ip-10-0-139-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-254.ec2.internal,},FirstTimestamp:2026-09-17 17:34:15.71555752 +0000 UTC m=+2.192567684,LastTimestamp:2026-09-17 17:34:15.71555752 +0000 UTC m=+2.192567684,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-254.ec2.internal,}" Sep 17 17:34:15.766624 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.766606 2577 manager.go:354] Recovery completed Sep 17 17:34:15.771250 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.771236 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:15.773301 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.773284 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:15.773384 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.773317 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:15.773384 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.773332 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:15.773850 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.773837 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 17:34:15.773850 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.773850 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 17:34:15.773923 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.773865 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 17 17:34:15.773923 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.773841 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:15.774716 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.774697 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:15.774820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.774749 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:15.774820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.774766 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:15.774988 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.774969 2577 policy_none.go:49] "None policy: Start" Sep 17 17:34:15.774988 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.774988 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 17:34:15.775082 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.774999 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 17:34:15.775666 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.775588 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-254.ec2.internal.18d62c28d2ccc9c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-254.ec2.internal,UID:ip-10-0-139-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-254.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-254.ec2.internal,},FirstTimestamp:2026-09-17 17:34:15.773301187 +0000 UTC m=+2.250311368,LastTimestamp:2026-09-17 17:34:15.773301187 +0000 UTC m=+2.250311368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-254.ec2.internal,}" Sep 17 17:34:15.776018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.776002 2577 policy_none.go:47] "Start" Sep 17 17:34:15.785658 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.785571 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-254.ec2.internal.18d62c28d2cd2225 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-254.ec2.internal,UID:ip-10-0-139-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-254.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-254.ec2.internal,},FirstTimestamp:2026-09-17 17:34:15.773323813 +0000 UTC m=+2.250333979,LastTimestamp:2026-09-17 17:34:15.773323813 +0000 UTC m=+2.250333979,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-254.ec2.internal,}" Sep 17 17:34:15.792566 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.792546 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n5hfs" Sep 17 17:34:15.797788 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.797701 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-254.ec2.internal.18d62c28d2cd589b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-254.ec2.internal,UID:ip-10-0-139-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-254.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-254.ec2.internal,},FirstTimestamp:2026-09-17 17:34:15.773337755 +0000 UTC m=+2.250347921,LastTimestamp:2026-09-17 17:34:15.773337755 +0000 UTC m=+2.250347921,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-254.ec2.internal,}" Sep 17 17:34:15.800378 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.800362 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n5hfs" Sep 17 17:34:15.808314 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.808298 2577 manager.go:337] "Starting Device Plugin manager" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.808332 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.808342 2577 server.go:87] "Starting device plugin registration server" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.808515 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.808533 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.808646 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.808774 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.808790 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.809090 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 17:34:15.822679 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.809136 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:15.910962 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.910916 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:15.911686 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.911670 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:15.911782 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.911700 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:15.911782 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.911717 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:15.911782 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.911772 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-254.ec2.internal" Sep 17 17:34:15.920308 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.920292 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-254.ec2.internal" Sep 17 17:34:15.920398 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.920315 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-254.ec2.internal\": node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:15.922101 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.922080 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 17:34:15.923364 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.923347 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 17:34:15.923434 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.923390 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 17:34:15.923434 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.923415 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 17:34:15.923507 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.923458 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 17:34:15.925775 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:15.925734 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:15.964097 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:15.964072 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.023647 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.023622 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal"] Sep 17 17:34:16.023739 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.023694 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:16.025061 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.025045 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:16.025135 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.025077 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:16.025135 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.025088 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:16.026119 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026106 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:16.026265 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.026321 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026278 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:16.026800 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026783 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:16.026886 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026809 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:16.026886 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026811 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:16.026886 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026824 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:16.026886 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026832 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:16.026886 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.026842 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:16.027877 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.027862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.027927 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.027887 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 17:34:16.028533 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.028516 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientMemory" Sep 17 17:34:16.028626 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.028541 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 17:34:16.028626 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.028551 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeHasSufficientPID" Sep 17 17:34:16.054355 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.054335 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-254.ec2.internal\" not found" node="ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.056454 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.056431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/295cf0dc2d4b91252e8e2dc590137d25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal\" (UID: \"295cf0dc2d4b91252e8e2dc590137d25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.056541 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.056468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/295cf0dc2d4b91252e8e2dc590137d25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal\" (UID: \"295cf0dc2d4b91252e8e2dc590137d25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.056541 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.056494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccbf594a5a3091ac836b07c85bd703c7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-254.ec2.internal\" (UID: \"ccbf594a5a3091ac836b07c85bd703c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.059057 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.059040 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-254.ec2.internal\" not found" node="ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.065053 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.065038 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.156601 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.156580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccbf594a5a3091ac836b07c85bd703c7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-254.ec2.internal\" (UID: \"ccbf594a5a3091ac836b07c85bd703c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.156692 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.156603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/295cf0dc2d4b91252e8e2dc590137d25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal\" (UID: \"295cf0dc2d4b91252e8e2dc590137d25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.156692 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.156622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/295cf0dc2d4b91252e8e2dc590137d25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal\" (UID: \"295cf0dc2d4b91252e8e2dc590137d25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.156692 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.156655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/295cf0dc2d4b91252e8e2dc590137d25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal\" (UID: \"295cf0dc2d4b91252e8e2dc590137d25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.156832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.156708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/295cf0dc2d4b91252e8e2dc590137d25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal\" (UID: \"295cf0dc2d4b91252e8e2dc590137d25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.156832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.156725 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccbf594a5a3091ac836b07c85bd703c7-config\") pod \"kube-apiserver-proxy-ip-10-0-139-254.ec2.internal\" (UID: \"ccbf594a5a3091ac836b07c85bd703c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.166167 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.166151 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.266309 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.266281 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.358003 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.357979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.362907 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.362803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.366825 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.366807 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.467794 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.467743 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.568344 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.568322 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.669001 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.668980 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.678227 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.678201 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 17:34:16.678343 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.678328 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 17:34:16.769992 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:16.769849 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-254.ec2.internal\" not found" Sep 17 17:34:16.804133 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.804104 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:29:16 +0000 UTC" deadline="2028-06-16 03:18:25.85720763 +0000 UTC" Sep 17 17:34:16.804133 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.804133 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15297h44m9.053078997s" Sep 17 17:34:16.810417 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.810399 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:16.854332 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.854306 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.881747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.881729 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:34:16.883722 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.883706 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" Sep 17 17:34:16.904337 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.904319 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 17:34:16.975380 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:16.975355 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295cf0dc2d4b91252e8e2dc590137d25.slice/crio-b604246b233c3ae4bc07b1ed6b0b6af911eb376bdd726a4b66994d23e6d2ca20 WatchSource:0}: Error finding container b604246b233c3ae4bc07b1ed6b0b6af911eb376bdd726a4b66994d23e6d2ca20: Status 404 returned error can't find the container with id b604246b233c3ae4bc07b1ed6b0b6af911eb376bdd726a4b66994d23e6d2ca20 Sep 17 17:34:16.975714 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:16.975695 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbf594a5a3091ac836b07c85bd703c7.slice/crio-c55c752dfda412dba24ffeb3c72809146bdf07775be984e1c97b757d04b8e633 WatchSource:0}: Error finding container c55c752dfda412dba24ffeb3c72809146bdf07775be984e1c97b757d04b8e633: Status 404 returned error can't find the container with id c55c752dfda412dba24ffeb3c72809146bdf07775be984e1c97b757d04b8e633 Sep 17 17:34:16.982977 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:16.982954 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:34:17.073219 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.073171 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:17.125258 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.125236 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:17.617966 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.617934 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 17:34:17.706739 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.706712 2577 apiserver.go:52] "Watching apiserver" Sep 17 17:34:17.717153 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.717129 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 17:34:17.717595 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.717570 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-rk2qz","openshift-network-operator/iptables-alerter-xhdfp","kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal","openshift-cluster-node-tuning-operator/tuned-s64tj","openshift-multus/multus-h58h8","openshift-multus/network-metrics-daemon-z6vms","openshift-network-diagnostics/network-check-target-kf5j4","openshift-ovn-kubernetes/ovnkube-node-9zjm4","kube-system/global-pull-secret-syncer-9tvnp","kube-system/konnectivity-agent-kxtlt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq","openshift-dns/node-resolver-8htvr","openshift-image-registry/node-ca-r4w4q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal"] Sep 17 17:34:17.720272 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.720249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:17.720385 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.720344 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:17.722879 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.722850 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.727004 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.726979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.727111 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.727042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5cldl\"" Sep 17 17:34:17.727397 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.727382 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 17:34:17.727705 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.727684 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 17:34:17.731065 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.731042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 17:34:17.731203 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.731185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.731572 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.731548 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 17:34:17.732112 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.732091 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 17:34:17.732242 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.732224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.733426 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.733223 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 17:34:17.733699 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.733566 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 17:34:17.734124 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.733871 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d9zv5\"" Sep 17 17:34:17.734124 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.734090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 17:34:17.734413 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.734297 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 17:34:17.734496 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.734435 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:17.734561 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.734496 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:17.736644 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.736617 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:17.737040 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.737014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.737140 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.737090 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:17.737587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.737465 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:17.737846 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.737828 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x75ps\"" Sep 17 17:34:17.738069 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.738052 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 17:34:17.738902 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.738885 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 17:34:17.739155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.739119 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 17:34:17.739155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.739134 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 17:34:17.739282 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.739187 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gv8ch\"" Sep 17 17:34:17.739662 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.739643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.742150 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.742123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.745406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.744680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:17.747536 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.747299 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.750061 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.750042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.751832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.751811 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 17:34:17.752138 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.752115 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 17:34:17.752405 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.752383 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:34:17.752761 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.752727 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-54bsf\"" Sep 17 17:34:17.753301 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.753215 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 17:34:17.753301 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.753215 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 17:34:17.753424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.753300 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lfwbm\"" Sep 17 17:34:17.754289 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.753724 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 17:34:17.754289 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.753852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2zc68\"" Sep 17 17:34:17.754289 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.753744 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 17:34:17.754289 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.753971 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 17:34:17.754289 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.754020 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 17:34:17.754610 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.754448 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xlgpr\"" Sep 17 17:34:17.755137 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.755115 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 17:34:17.755237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.755196 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 17:34:17.755313 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.755239 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gf4j8\"" Sep 17 17:34:17.755725 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.755574 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 17:34:17.755725 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.755650 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 17:34:17.758094 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.758044 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 17:34:17.767349 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-run-ovn-kubernetes\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.767445 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.767445 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-etc-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.767445 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9c20e22-1c65-4c08-8086-ee74eb387729-ovn-node-metrics-cert\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.767607 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysconfig\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.767607 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-kubernetes\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.767607 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-system-cni-dir\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.767607 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767589 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9qb6\" (UniqueName: \"kubernetes.io/projected/3a305003-66aa-4094-a1cb-a7410e805ae2-kube-api-access-g9qb6\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.767843 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-run-netns\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.767843 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-cnibin\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.767843 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767722 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnlk8\" (UniqueName: \"kubernetes.io/projected/c9c20e22-1c65-4c08-8086-ee74eb387729-kube-api-access-qnlk8\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.767843 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-netns\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.767843 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767789 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-conf-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.767843 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-daemon-config\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767913 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-systemd\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.767975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-system-cni-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-cni-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-cnibin\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf98k\" (UniqueName: \"kubernetes.io/projected/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-kube-api-access-hf98k\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-modprobe-d\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.768158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-sys\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768189 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-sys-fs\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-tmp-dir\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-cni-netd\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-cni-bin\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-ovnkube-config\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkbk6\" (UniqueName: \"kubernetes.io/projected/c108c40b-fe8d-4a81-b08b-c926b0c103ed-kube-api-access-fkbk6\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:17.768645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4e48b8b-081f-4b5e-bea8-8c452122ff60-konnectivity-ca\") pod \"konnectivity-agent-kxtlt\" (UID: \"a4e48b8b-081f-4b5e-bea8-8c452122ff60\") " pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-serviceca\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-host\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc099d65-fd63-4640-95b7-068474f5ca91-tmp\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-hosts-file\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnwdz\" (UniqueName: \"kubernetes.io/projected/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-kube-api-access-cnwdz\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-ovn\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-systemd\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-multus-certs\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-socket-dir-parent\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.768989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49msx\" (UniqueName: \"kubernetes.io/projected/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-kube-api-access-49msx\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.769072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-cni-bin\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-run\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-lib-modules\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slfvq\" (UniqueName: \"kubernetes.io/projected/cc099d65-fd63-4640-95b7-068474f5ca91-kube-api-access-slfvq\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-slash\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-var-lib-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-cni-binary-copy\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-kubelet\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-etc-kubernetes\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-iptables-alerter-script\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-socket-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-kubelet\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-node-log\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-k8s-cni-cncf-io\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769482 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-host\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.769651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-var-lib-kubelet\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-host-slash\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769590 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2wwv\" (UniqueName: \"kubernetes.io/projected/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-kube-api-access-p2wwv\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-hostroot\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4e48b8b-081f-4b5e-bea8-8c452122ff60-agent-certs\") pod \"konnectivity-agent-kxtlt\" (UID: \"a4e48b8b-081f-4b5e-bea8-8c452122ff60\") " pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-registration-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-cni-multus\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95abfd80-c3af-45b0-adb6-12c29ecbde88-dbus\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysctl-conf\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-systemd-units\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-log-socket\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-env-overrides\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-ovnkube-script-lib\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.769985 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95abfd80-c3af-45b0-adb6-12c29ecbde88-kubelet-config\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.770535 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.770007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysctl-d\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.771321 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.770029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc099d65-fd63-4640-95b7-068474f5ca91-etc-tuned\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.771321 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.770054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7fpj\" (UniqueName: \"kubernetes.io/projected/6b2dbe03-f597-453c-a050-2636af7d309e-kube-api-access-m7fpj\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.771321 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.770078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-device-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.779938 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.779901 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 17:34:17.812511 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.812487 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xz4v2" Sep 17 17:34:17.841189 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.841153 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xz4v2" Sep 17 17:34:17.870994 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.870937 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-system-cni-dir\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.871094 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.870991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9qb6\" (UniqueName: \"kubernetes.io/projected/3a305003-66aa-4094-a1cb-a7410e805ae2-kube-api-access-g9qb6\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.871094 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-run-netns\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.871094 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-cnibin\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.871094 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnlk8\" (UniqueName: \"kubernetes.io/projected/c9c20e22-1c65-4c08-8086-ee74eb387729-kube-api-access-qnlk8\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-netns\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871100 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-run-netns\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-conf-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871131 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-cnibin\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-daemon-config\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871177 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-netns\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-systemd\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.871258 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-system-cni-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.871320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-cni-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.871348 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:34:18.37131075 +0000 UTC m=+4.848320919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871352 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-conf-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-cnibin\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf98k\" (UniqueName: \"kubernetes.io/projected/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-kube-api-access-hf98k\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-modprobe-d\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-sys\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-sys-fs\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871508 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-cni-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-tmp-dir\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-cni-netd\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-cni-bin\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-ovnkube-config\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkbk6\" (UniqueName: \"kubernetes.io/projected/c108c40b-fe8d-4a81-b08b-c926b0c103ed-kube-api-access-fkbk6\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4e48b8b-081f-4b5e-bea8-8c452122ff60-konnectivity-ca\") pod \"konnectivity-agent-kxtlt\" (UID: \"a4e48b8b-081f-4b5e-bea8-8c452122ff60\") " pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:17.872014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-serviceca\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-host\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc099d65-fd63-4640-95b7-068474f5ca91-tmp\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-hosts-file\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnwdz\" (UniqueName: \"kubernetes.io/projected/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-kube-api-access-cnwdz\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-ovn\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-systemd\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-multus-certs\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-socket-dir-parent\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872043 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-daemon-config\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49msx\" (UniqueName: \"kubernetes.io/projected/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-kube-api-access-49msx\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-cni-bin\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-system-cni-dir\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872161 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-run\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.872893 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.871071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-system-cni-dir\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872207 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-lib-modules\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slfvq\" (UniqueName: \"kubernetes.io/projected/cc099d65-fd63-4640-95b7-068474f5ca91-kube-api-access-slfvq\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-slash\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-var-lib-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872336 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-lib-modules\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-cni-binary-copy\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872392 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-systemd\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-kubelet\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872432 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-kubelet\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-etc-kubernetes\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-iptables-alerter-script\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-socket-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-kubelet\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-node-log\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.873756 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-k8s-cni-cncf-io\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-host\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872623 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-serviceca\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-var-lib-kubelet\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872672 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-host-slash\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872704 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-var-lib-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2wwv\" (UniqueName: \"kubernetes.io/projected/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-kube-api-access-p2wwv\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872727 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a4e48b8b-081f-4b5e-bea8-8c452122ff60-konnectivity-ca\") pod \"konnectivity-agent-kxtlt\" (UID: \"a4e48b8b-081f-4b5e-bea8-8c452122ff60\") " pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-slash\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-hostroot\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4e48b8b-081f-4b5e-bea8-8c452122ff60-agent-certs\") pod \"konnectivity-agent-kxtlt\" (UID: \"a4e48b8b-081f-4b5e-bea8-8c452122ff60\") " pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-hosts-file\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-registration-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872928 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-cni-multus\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95abfd80-c3af-45b0-adb6-12c29ecbde88-dbus\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysctl-conf\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.874486 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-systemd-units\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873059 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-modprobe-d\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-log-socket\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-env-overrides\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873120 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-sys\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873148 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-cnibin\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872706 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-host\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-ovnkube-script-lib\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95abfd80-c3af-45b0-adb6-12c29ecbde88-kubelet-config\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysctl-d\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-cni-binary-copy\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc099d65-fd63-4640-95b7-068474f5ca91-etc-tuned\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7fpj\" (UniqueName: \"kubernetes.io/projected/6b2dbe03-f597-453c-a050-2636af7d309e-kube-api-access-m7fpj\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873329 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-multus-socket-dir-parent\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-device-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-run-ovn-kubernetes\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.875645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-etc-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9c20e22-1c65-4c08-8086-ee74eb387729-ovn-node-metrics-cert\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysconfig\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-kubernetes\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873581 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873606 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-kubernetes\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b2dbe03-f597-453c-a050-2636af7d309e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873653 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-host-slash\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-var-lib-kubelet\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873723 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-cni-bin\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873748 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-sys-fs\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873811 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-cni-bin\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-run\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873864 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-cni-netd\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-hostroot\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873967 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-etc-selinux\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873262 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-multus-certs\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-etc-kubernetes\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.876539 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.874061 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.874119 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret podName:95abfd80-c3af-45b0-adb6-12c29ecbde88 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:18.374103497 +0000 UTC m=+4.851113666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret") pod "global-pull-secret-syncer-9tvnp" (UID: "95abfd80-c3af-45b0-adb6-12c29ecbde88") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-ovnkube-config\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874357 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-kubelet\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874376 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-ovn\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872485 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-systemd\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-registration-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874482 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-socket-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874499 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-run-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.872877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874541 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/95abfd80-c3af-45b0-adb6-12c29ecbde88-dbus\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-var-lib-cni-multus\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-iptables-alerter-script\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874597 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-systemd-units\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874630 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-node-log\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874645 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a305003-66aa-4094-a1cb-a7410e805ae2-device-dir\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874680 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysctl-conf\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.877474 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874682 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-host-run-k8s-cni-cncf-io\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874727 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/95abfd80-c3af-45b0-adb6-12c29ecbde88-kubelet-config\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.873226 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-host\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874835 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-log-socket\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874857 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysctl-d\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874868 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b2dbe03-f597-453c-a050-2636af7d309e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874900 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-etc-openvswitch\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874919 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-ovnkube-script-lib\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874937 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-tmp-dir\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874948 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-run-ovn-kubernetes\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.874988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9c20e22-1c65-4c08-8086-ee74eb387729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.875040 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc099d65-fd63-4640-95b7-068474f5ca91-etc-sysconfig\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.878311 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.875343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9c20e22-1c65-4c08-8086-ee74eb387729-env-overrides\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.879032 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.878753 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc099d65-fd63-4640-95b7-068474f5ca91-etc-tuned\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.879032 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.879009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a4e48b8b-081f-4b5e-bea8-8c452122ff60-agent-certs\") pod \"konnectivity-agent-kxtlt\" (UID: \"a4e48b8b-081f-4b5e-bea8-8c452122ff60\") " pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:17.879205 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.879187 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc099d65-fd63-4640-95b7-068474f5ca91-tmp\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.881222 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.881175 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9c20e22-1c65-4c08-8086-ee74eb387729-ovn-node-metrics-cert\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.903483 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.903369 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnlk8\" (UniqueName: \"kubernetes.io/projected/c9c20e22-1c65-4c08-8086-ee74eb387729-kube-api-access-qnlk8\") pod \"ovnkube-node-9zjm4\" (UID: \"c9c20e22-1c65-4c08-8086-ee74eb387729\") " pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:17.904991 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.904970 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:17.904991 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.904997 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:17.905144 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.905010 2577 projected.go:196] Error preparing data for projected volume kube-api-access-lz9mc for pod openshift-network-diagnostics/network-check-target-kf5j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:17.905144 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:17.905074 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc podName:6d6a660c-06e4-47f7-9f1a-bb758ffaf107 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:18.405057267 +0000 UTC m=+4.882067419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lz9mc" (UniqueName: "kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc") pod "network-check-target-kf5j4" (UID: "6d6a660c-06e4-47f7-9f1a-bb758ffaf107") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:17.907032 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.907007 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf98k\" (UniqueName: \"kubernetes.io/projected/2d8aec86-cd5d-4d5f-9072-208f9b5b3755-kube-api-access-hf98k\") pod \"multus-h58h8\" (UID: \"2d8aec86-cd5d-4d5f-9072-208f9b5b3755\") " pod="openshift-multus/multus-h58h8" Sep 17 17:34:17.908199 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.908176 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkbk6\" (UniqueName: \"kubernetes.io/projected/c108c40b-fe8d-4a81-b08b-c926b0c103ed-kube-api-access-fkbk6\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:17.909467 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.909443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slfvq\" (UniqueName: \"kubernetes.io/projected/cc099d65-fd63-4640-95b7-068474f5ca91-kube-api-access-slfvq\") pod \"tuned-s64tj\" (UID: \"cc099d65-fd63-4640-95b7-068474f5ca91\") " pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:17.909793 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.909754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49msx\" (UniqueName: \"kubernetes.io/projected/167d5f18-0de8-4b9e-83dc-15ba015bbfa2-kube-api-access-49msx\") pod \"node-ca-r4w4q\" (UID: \"167d5f18-0de8-4b9e-83dc-15ba015bbfa2\") " pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:17.910160 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.910133 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7fpj\" (UniqueName: \"kubernetes.io/projected/6b2dbe03-f597-453c-a050-2636af7d309e-kube-api-access-m7fpj\") pod \"multus-additional-cni-plugins-rk2qz\" (UID: \"6b2dbe03-f597-453c-a050-2636af7d309e\") " pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:17.920516 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.920492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2wwv\" (UniqueName: \"kubernetes.io/projected/1065234b-24a2-4bfe-88cb-11c6b6dc1a3c-kube-api-access-p2wwv\") pod \"iptables-alerter-xhdfp\" (UID: \"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c\") " pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:17.921279 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.921262 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9qb6\" (UniqueName: \"kubernetes.io/projected/3a305003-66aa-4094-a1cb-a7410e805ae2-kube-api-access-g9qb6\") pod \"aws-ebs-csi-driver-node-rjctq\" (UID: \"3a305003-66aa-4094-a1cb-a7410e805ae2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:17.927465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.927426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" event={"ID":"ccbf594a5a3091ac836b07c85bd703c7","Type":"ContainerStarted","Data":"c55c752dfda412dba24ffeb3c72809146bdf07775be984e1c97b757d04b8e633"} Sep 17 17:34:17.928634 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.928614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" event={"ID":"295cf0dc2d4b91252e8e2dc590137d25","Type":"ContainerStarted","Data":"b604246b233c3ae4bc07b1ed6b0b6af911eb376bdd726a4b66994d23e6d2ca20"} Sep 17 17:34:17.978776 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:17.978753 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnwdz\" (UniqueName: \"kubernetes.io/projected/efda8b0b-921f-4643-9b36-bdf5f92b8e2e-kube-api-access-cnwdz\") pod \"node-resolver-8htvr\" (UID: \"efda8b0b-921f-4643-9b36-bdf5f92b8e2e\") " pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:18.038911 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.038890 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r4w4q" Sep 17 17:34:18.050261 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.050239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:18.058755 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.058737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" Sep 17 17:34:18.071750 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.071731 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s64tj" Sep 17 17:34:18.078773 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.078753 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h58h8" Sep 17 17:34:18.088662 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.088641 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhdfp" Sep 17 17:34:18.096127 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.096104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:18.103863 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.103842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" Sep 17 17:34:18.109711 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.109687 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8htvr" Sep 17 17:34:18.375985 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.375952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:18.375985 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.375991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:18.376213 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.376121 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:18.376213 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.376126 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:18.376213 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.376182 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret podName:95abfd80-c3af-45b0-adb6-12c29ecbde88 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:19.376164052 +0000 UTC m=+5.853174224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret") pod "global-pull-secret-syncer-9tvnp" (UID: "95abfd80-c3af-45b0-adb6-12c29ecbde88") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:18.376213 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.376206 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:34:19.376193904 +0000 UTC m=+5.853204061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:18.477262 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.477227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:18.477470 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.477407 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:18.477470 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.477426 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:18.477470 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.477436 2577 projected.go:196] Error preparing data for projected volume kube-api-access-lz9mc for pod openshift-network-diagnostics/network-check-target-kf5j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:18.477613 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.477502 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc podName:6d6a660c-06e4-47f7-9f1a-bb758ffaf107 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:19.477482157 +0000 UTC m=+5.954492310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz9mc" (UniqueName: "kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc") pod "network-check-target-kf5j4" (UID: "6d6a660c-06e4-47f7-9f1a-bb758ffaf107") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:18.845297 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.845261 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:17 +0000 UTC" deadline="2028-06-29 21:49:29.2345965 +0000 UTC" Sep 17 17:34:18.845297 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.845290 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15628h15m10.389309887s" Sep 17 17:34:18.924125 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:18.924093 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:18.924281 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:18.924205 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:19.004387 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:19.004366 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e48b8b_081f_4b5e_bea8_8c452122ff60.slice/crio-828c76437d6d319a1f06a18ea1059dad0a566c66b7befc63f26c45fc9e1c6ceb WatchSource:0}: Error finding container 828c76437d6d319a1f06a18ea1059dad0a566c66b7befc63f26c45fc9e1c6ceb: Status 404 returned error can't find the container with id 828c76437d6d319a1f06a18ea1059dad0a566c66b7befc63f26c45fc9e1c6ceb Sep 17 17:34:19.027024 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:19.026994 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefda8b0b_921f_4643_9b36_bdf5f92b8e2e.slice/crio-510f83c0322b7054d50f344cfe089de4fc1da38a67dbc19bb855b9a87196d1ee WatchSource:0}: Error finding container 510f83c0322b7054d50f344cfe089de4fc1da38a67dbc19bb855b9a87196d1ee: Status 404 returned error can't find the container with id 510f83c0322b7054d50f344cfe089de4fc1da38a67dbc19bb855b9a87196d1ee Sep 17 17:34:19.028246 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:19.028217 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a305003_66aa_4094_a1cb_a7410e805ae2.slice/crio-60f31a23b9df7322b6086219cc0359889a9d82cdaf0fc1093b197b17e0f2d40b WatchSource:0}: Error finding container 60f31a23b9df7322b6086219cc0359889a9d82cdaf0fc1093b197b17e0f2d40b: Status 404 returned error can't find the container with id 60f31a23b9df7322b6086219cc0359889a9d82cdaf0fc1093b197b17e0f2d40b Sep 17 17:34:19.030639 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:19.030616 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c20e22_1c65_4c08_8086_ee74eb387729.slice/crio-b4f200413a931225c44d4f2158c357ad94c652e5230f81088610d0a219eb2615 WatchSource:0}: Error finding container b4f200413a931225c44d4f2158c357ad94c652e5230f81088610d0a219eb2615: Status 404 returned error can't find the container with id b4f200413a931225c44d4f2158c357ad94c652e5230f81088610d0a219eb2615 Sep 17 17:34:19.034951 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:19.034925 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2dbe03_f597_453c_a050_2636af7d309e.slice/crio-6fff8aa55c550794ef1ecec646dfd32b7cd246fa7be7e3a8f48298a2c1e12551 WatchSource:0}: Error finding container 6fff8aa55c550794ef1ecec646dfd32b7cd246fa7be7e3a8f48298a2c1e12551: Status 404 returned error can't find the container with id 6fff8aa55c550794ef1ecec646dfd32b7cd246fa7be7e3a8f48298a2c1e12551 Sep 17 17:34:19.035945 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:19.035923 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167d5f18_0de8_4b9e_83dc_15ba015bbfa2.slice/crio-dfb1c8769e559df990b77799e8c822f469ea69256cf1074f2e1c361fa8e5f531 WatchSource:0}: Error finding container dfb1c8769e559df990b77799e8c822f469ea69256cf1074f2e1c361fa8e5f531: Status 404 returned error can't find the container with id dfb1c8769e559df990b77799e8c822f469ea69256cf1074f2e1c361fa8e5f531 Sep 17 17:34:19.384325 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.384242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:19.384325 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.384315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:19.384501 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.384421 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:19.384501 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.384465 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:19.384501 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.384502 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:34:21.384477959 +0000 UTC m=+7.861488114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:19.384670 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.384523 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret podName:95abfd80-c3af-45b0-adb6-12c29ecbde88 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:21.384509136 +0000 UTC m=+7.861519292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret") pod "global-pull-secret-syncer-9tvnp" (UID: "95abfd80-c3af-45b0-adb6-12c29ecbde88") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:19.485476 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.484835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:19.485476 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.485013 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:19.485476 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.485038 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:19.485476 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.485053 2577 projected.go:196] Error preparing data for projected volume kube-api-access-lz9mc for pod openshift-network-diagnostics/network-check-target-kf5j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:19.485476 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.485106 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc podName:6d6a660c-06e4-47f7-9f1a-bb758ffaf107 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:21.485089798 +0000 UTC m=+7.962099951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz9mc" (UniqueName: "kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc") pod "network-check-target-kf5j4" (UID: "6d6a660c-06e4-47f7-9f1a-bb758ffaf107") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:19.846013 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.845952 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:17 +0000 UTC" deadline="2028-04-05 06:04:09.133208019 +0000 UTC" Sep 17 17:34:19.846013 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.845985 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13572h29m49.287227617s" Sep 17 17:34:19.927733 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.927245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:19.927733 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.927382 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:19.927954 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.927771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:19.927954 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:19.927881 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:19.942806 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.942728 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r4w4q" event={"ID":"167d5f18-0de8-4b9e-83dc-15ba015bbfa2","Type":"ContainerStarted","Data":"dfb1c8769e559df990b77799e8c822f469ea69256cf1074f2e1c361fa8e5f531"} Sep 17 17:34:19.954253 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.954184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerStarted","Data":"6fff8aa55c550794ef1ecec646dfd32b7cd246fa7be7e3a8f48298a2c1e12551"} Sep 17 17:34:19.965503 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.965477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" event={"ID":"3a305003-66aa-4094-a1cb-a7410e805ae2","Type":"ContainerStarted","Data":"60f31a23b9df7322b6086219cc0359889a9d82cdaf0fc1093b197b17e0f2d40b"} Sep 17 17:34:19.974754 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.974730 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8htvr" event={"ID":"efda8b0b-921f-4643-9b36-bdf5f92b8e2e","Type":"ContainerStarted","Data":"510f83c0322b7054d50f344cfe089de4fc1da38a67dbc19bb855b9a87196d1ee"} Sep 17 17:34:19.981920 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.981882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxtlt" event={"ID":"a4e48b8b-081f-4b5e-bea8-8c452122ff60","Type":"ContainerStarted","Data":"828c76437d6d319a1f06a18ea1059dad0a566c66b7befc63f26c45fc9e1c6ceb"} Sep 17 17:34:19.999727 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:19.999651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" event={"ID":"ccbf594a5a3091ac836b07c85bd703c7","Type":"ContainerStarted","Data":"9f8f30ebcd05d6d942fca5db427e56083bfbf27fae1337a44f22fc8d039be06c"} Sep 17 17:34:20.004695 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.004670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h58h8" event={"ID":"2d8aec86-cd5d-4d5f-9072-208f9b5b3755","Type":"ContainerStarted","Data":"35c7993ce9a2be54ba0b4c9c9cd7d0cc9ec0853445f2c9b2f6c9acc66dd95d06"} Sep 17 17:34:20.007001 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.006975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"b4f200413a931225c44d4f2158c357ad94c652e5230f81088610d0a219eb2615"} Sep 17 17:34:20.035987 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.035929 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-254.ec2.internal" podStartSLOduration=3.035908675 podStartE2EDuration="3.035908675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:20.020369964 +0000 UTC m=+6.497380135" watchObservedRunningTime="2026-09-17 17:34:20.035908675 +0000 UTC m=+6.512918847" Sep 17 17:34:20.046683 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.045953 2577 generic.go:356] "Generic (PLEG): container finished" podID="295cf0dc2d4b91252e8e2dc590137d25" containerID="79f275ba5582ae743c9d3e0fbc5f3ba6b2a20bb0d545f6a32c29b9ff019cd47b" exitCode=0 Sep 17 17:34:20.046683 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.046032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" event={"ID":"295cf0dc2d4b91252e8e2dc590137d25","Type":"ContainerDied","Data":"79f275ba5582ae743c9d3e0fbc5f3ba6b2a20bb0d545f6a32c29b9ff019cd47b"} Sep 17 17:34:20.055730 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.055702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s64tj" event={"ID":"cc099d65-fd63-4640-95b7-068474f5ca91","Type":"ContainerStarted","Data":"4e5ed1bdd057e2dc5583bf76d5ba0e67da3492a0bcdb4c452bf8168d40e0a9e0"} Sep 17 17:34:20.068282 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.068247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhdfp" event={"ID":"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c","Type":"ContainerStarted","Data":"c2a293be6671e013efcd229114b40e88fdca510cd65acbf82791c4bc093e620a"} Sep 17 17:34:20.923970 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:20.923719 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:20.924408 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:20.924090 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:21.091350 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:21.091263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" event={"ID":"295cf0dc2d4b91252e8e2dc590137d25","Type":"ContainerStarted","Data":"919ad6c5ab9e3da53e88e4f54709287e1304520635ecc1f90ae90728797ce989"} Sep 17 17:34:21.400517 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:21.400430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:21.400710 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:21.400531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:21.400710 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.400648 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:21.400829 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.400723 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:34:25.400703624 +0000 UTC m=+11.877713787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:21.401135 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.401114 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:21.401234 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.401169 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret podName:95abfd80-c3af-45b0-adb6-12c29ecbde88 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:25.401155592 +0000 UTC m=+11.878165754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret") pod "global-pull-secret-syncer-9tvnp" (UID: "95abfd80-c3af-45b0-adb6-12c29ecbde88") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:21.501012 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:21.500980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:21.501171 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.501114 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:21.501171 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.501132 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:21.501171 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.501143 2577 projected.go:196] Error preparing data for projected volume kube-api-access-lz9mc for pod openshift-network-diagnostics/network-check-target-kf5j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:21.501331 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.501195 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc podName:6d6a660c-06e4-47f7-9f1a-bb758ffaf107 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:25.501178385 +0000 UTC m=+11.978188551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz9mc" (UniqueName: "kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc") pod "network-check-target-kf5j4" (UID: "6d6a660c-06e4-47f7-9f1a-bb758ffaf107") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:21.925560 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:21.924769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:21.925560 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.924916 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:21.925560 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:21.925299 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:21.925560 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:21.925393 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:22.924249 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:22.924207 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:22.924422 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:22.924337 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:23.924954 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:23.924436 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:23.924954 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:23.924584 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:23.924954 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:23.924643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:23.924954 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:23.924753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:24.923622 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:24.923583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:24.923799 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:24.923741 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:25.434402 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:25.434368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:25.434828 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:25.434425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:25.434828 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.434548 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:25.434828 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.434598 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret podName:95abfd80-c3af-45b0-adb6-12c29ecbde88 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:33.43458508 +0000 UTC m=+19.911595230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret") pod "global-pull-secret-syncer-9tvnp" (UID: "95abfd80-c3af-45b0-adb6-12c29ecbde88") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:25.434828 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.434653 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:25.434828 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.434719 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:34:33.434704829 +0000 UTC m=+19.911714984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:25.535419 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:25.535372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:25.535582 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.535547 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:25.535582 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.535567 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:25.535582 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.535578 2577 projected.go:196] Error preparing data for projected volume kube-api-access-lz9mc for pod openshift-network-diagnostics/network-check-target-kf5j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:25.535778 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.535635 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc podName:6d6a660c-06e4-47f7-9f1a-bb758ffaf107 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:33.535616566 +0000 UTC m=+20.012626736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz9mc" (UniqueName: "kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc") pod "network-check-target-kf5j4" (UID: "6d6a660c-06e4-47f7-9f1a-bb758ffaf107") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:25.925223 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:25.925142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:25.925387 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.925265 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:25.925614 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:25.925592 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:25.925745 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:25.925713 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:26.924938 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:26.924538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:26.924938 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:26.924678 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:27.924229 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:27.924196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:27.924392 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:27.924234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:27.924392 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:27.924330 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:27.924591 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:27.924566 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:28.924438 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:28.924402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:28.924949 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:28.924542 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:29.923704 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:29.923671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:29.923892 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:29.923671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:29.923892 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:29.923813 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:29.923892 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:29.923840 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:30.924053 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:30.924023 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:30.924471 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:30.924125 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:31.923858 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:31.923823 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:31.924037 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:31.923946 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:31.924037 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:31.924008 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:31.924446 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:31.924111 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:32.924465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:32.924438 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:32.924746 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:32.924532 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:33.498489 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:33.498456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:33.498678 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:33.498507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:33.498678 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.498630 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:33.498811 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.498629 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:33.498811 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.498706 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret podName:95abfd80-c3af-45b0-adb6-12c29ecbde88 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:49.498687415 +0000 UTC m=+35.975697568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret") pod "global-pull-secret-syncer-9tvnp" (UID: "95abfd80-c3af-45b0-adb6-12c29ecbde88") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:33.498811 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.498744 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:34:49.498723765 +0000 UTC m=+35.975733932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:33.599473 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:33.599431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:33.599605 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.599570 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:33.599605 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.599591 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:33.599605 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.599601 2577 projected.go:196] Error preparing data for projected volume kube-api-access-lz9mc for pod openshift-network-diagnostics/network-check-target-kf5j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:33.599760 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.599654 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc podName:6d6a660c-06e4-47f7-9f1a-bb758ffaf107 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:49.599638624 +0000 UTC m=+36.076648779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz9mc" (UniqueName: "kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc") pod "network-check-target-kf5j4" (UID: "6d6a660c-06e4-47f7-9f1a-bb758ffaf107") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:33.924642 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:33.924614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:33.925072 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.924766 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:33.925072 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:33.924805 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:33.925072 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:33.924881 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:34.924015 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:34.923972 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:34.924183 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:34.924107 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:35.924943 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:35.924904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:35.924943 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:35.924938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:35.925417 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:35.925039 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:35.925417 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:35.925174 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:36.923755 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:36.923636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:36.923843 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:36.923831 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:37.130654 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.130632 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:34:37.131406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.130981 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9c20e22-1c65-4c08-8086-ee74eb387729" containerID="9186c5f807867a1bd7cda88ee774378d7bd28d0294c23c9c069bd4fb61b1b9e5" exitCode=1 Sep 17 17:34:37.131406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.131055 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"9d1177a0729954f138855c95475c600ddefeb6259566213560a4e7f1fbedd38a"} Sep 17 17:34:37.131406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.131147 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"61ab059a23e3b2e05d50343a0ac63135ab55412709d13cd6c6d2b752f536aa77"} Sep 17 17:34:37.131406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.131193 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerDied","Data":"9186c5f807867a1bd7cda88ee774378d7bd28d0294c23c9c069bd4fb61b1b9e5"} Sep 17 17:34:37.131406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.131238 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"ba2ad043ec1d49d8cbe35653adeed7ee1e713ace7f34cb45170a6adb67a5a396"} Sep 17 17:34:37.132378 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.132351 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s64tj" event={"ID":"cc099d65-fd63-4640-95b7-068474f5ca91","Type":"ContainerStarted","Data":"257447a78cd587d391b6c247be20cea3b9694509299484fd4d516001c9f4476a"} Sep 17 17:34:37.133692 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.133652 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r4w4q" event={"ID":"167d5f18-0de8-4b9e-83dc-15ba015bbfa2","Type":"ContainerStarted","Data":"cbe2179c0c958d76ffa36d37c39796a9f5c836dcfaf876b04d02003b46ef2301"} Sep 17 17:34:37.134993 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.134970 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b2dbe03-f597-453c-a050-2636af7d309e" containerID="5c84c98221d4df7eab83b6a3642d58b5c2b67c1a0b5ab4a09a353ff9cfe6b6be" exitCode=0 Sep 17 17:34:37.135071 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.135038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerDied","Data":"5c84c98221d4df7eab83b6a3642d58b5c2b67c1a0b5ab4a09a353ff9cfe6b6be"} Sep 17 17:34:37.136518 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.136496 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" event={"ID":"3a305003-66aa-4094-a1cb-a7410e805ae2","Type":"ContainerStarted","Data":"d655a22dcc27e183c7c010dce0657a5fef780733349ddf3c22b611d95e4339b9"} Sep 17 17:34:37.138014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.137993 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8htvr" event={"ID":"efda8b0b-921f-4643-9b36-bdf5f92b8e2e","Type":"ContainerStarted","Data":"5f454739d45b7b1bc01b64fe722e7b068ef6e8772e82ea347edeeb8b64be2a59"} Sep 17 17:34:37.139479 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.139455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kxtlt" event={"ID":"a4e48b8b-081f-4b5e-bea8-8c452122ff60","Type":"ContainerStarted","Data":"238aa581ee13722d76bf053c39c0a1c38dce9570ee00975c62c2143995449085"} Sep 17 17:34:37.141111 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.141091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h58h8" event={"ID":"2d8aec86-cd5d-4d5f-9072-208f9b5b3755","Type":"ContainerStarted","Data":"bca6e57307f55ee16d5fecdd78a75cbdaeaa92bc9e04316c5fcbac51c45b468c"} Sep 17 17:34:37.155863 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.155821 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s64tj" podStartSLOduration=3.814727133 podStartE2EDuration="21.1558091s" totalImagesPullingTime="17.341081967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:37.155567875 +0000 UTC m=+23.632578047" watchObservedRunningTime="2026-09-17 17:34:37.1558091 +0000 UTC m=+23.632819268" Sep 17 17:34:37.156319 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.156295 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-254.ec2.internal" podStartSLOduration=20.156288235 podStartE2EDuration="20.156288235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:21.111876899 +0000 UTC m=+7.588887070" watchObservedRunningTime="2026-09-17 17:34:37.156288235 +0000 UTC m=+23.633298417" Sep 17 17:34:37.197174 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.197126 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kxtlt" podStartSLOduration=3.925792462 podStartE2EDuration="21.197112313s" totalImagesPullingTime="17.271319851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:37.175421667 +0000 UTC m=+23.652431839" watchObservedRunningTime="2026-09-17 17:34:37.197112313 +0000 UTC m=+23.674122491" Sep 17 17:34:37.197314 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.197291 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8htvr" podStartSLOduration=3.838701053 podStartE2EDuration="21.197284584s" totalImagesPullingTime="17.358583531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:37.196134523 +0000 UTC m=+23.673144694" watchObservedRunningTime="2026-09-17 17:34:37.197284584 +0000 UTC m=+23.674294757" Sep 17 17:34:37.223268 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.223217 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r4w4q" podStartSLOduration=3.878929508 podStartE2EDuration="21.223197569s" totalImagesPullingTime="17.344268061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:37.222137091 +0000 UTC m=+23.699147262" watchObservedRunningTime="2026-09-17 17:34:37.223197569 +0000 UTC m=+23.700207741" Sep 17 17:34:37.284206 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.284016 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h58h8" podStartSLOduration=3.941485816 podStartE2EDuration="21.28400138s" totalImagesPullingTime="17.342515564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:37.283817481 +0000 UTC m=+23.760827654" watchObservedRunningTime="2026-09-17 17:34:37.28400138 +0000 UTC m=+23.761011552" Sep 17 17:34:37.670348 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.670308 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 17:34:37.823620 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.823503 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:34:37.670330542Z","UUID":"6f56599e-35a2-4ad8-9d73-e12de5aa79c5","Handler":null,"Name":"","Endpoint":""} Sep 17 17:34:37.825082 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.825057 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 17:34:37.825213 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.825089 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 17:34:37.923968 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.923939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:37.924126 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:37.923939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:37.924126 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:37.924089 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:37.924213 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:37.924164 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:38.145869 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:38.145789 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" event={"ID":"3a305003-66aa-4094-a1cb-a7410e805ae2","Type":"ContainerStarted","Data":"39a502a53456a34a07374315dbaf5e8ad0c1faa7d3833ab8e0c089fc4797925f"} Sep 17 17:34:38.149249 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:38.149220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:34:38.149716 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:38.149691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"73800118f6c5ec79711be35a6f15a9ee3f1b6e8f9a31c94685189927435a0439"} Sep 17 17:34:38.149817 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:38.149776 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"9b77dc2a7090ea3135ccf9d9b57b94465e0b653ee6f11cece3e76c95bee3339c"} Sep 17 17:34:38.151705 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:38.151679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhdfp" event={"ID":"1065234b-24a2-4bfe-88cb-11c6b6dc1a3c","Type":"ContainerStarted","Data":"abdc02712348996f57b6cb77ff4e911d07833f31d6c35a27369c6bc33c106ebe"} Sep 17 17:34:38.177935 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:38.177873 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xhdfp" podStartSLOduration=4.83508408 podStartE2EDuration="22.177854691s" totalImagesPullingTime="17.342770611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:38.177378921 +0000 UTC m=+24.654389118" watchObservedRunningTime="2026-09-17 17:34:38.177854691 +0000 UTC m=+24.654864863" Sep 17 17:34:38.924255 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:38.924234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:38.924391 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:38.924340 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:39.156436 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:39.156399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" event={"ID":"3a305003-66aa-4094-a1cb-a7410e805ae2","Type":"ContainerStarted","Data":"26fa23c31dd3ff7f64bf8930ec79c8f2bbc4f6e7c37dd2840cea950e516c3216"} Sep 17 17:34:39.181960 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:39.181866 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rjctq" podStartSLOduration=3.995007656 podStartE2EDuration="23.181846473s" totalImagesPullingTime="19.186838817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:39.181676245 +0000 UTC m=+25.658686410" watchObservedRunningTime="2026-09-17 17:34:39.181846473 +0000 UTC m=+25.658856646" Sep 17 17:34:39.924541 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:39.924510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:39.924541 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:39.924533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:39.924741 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:39.924670 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:39.924821 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:39.924803 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:40.161687 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:40.161644 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:34:40.162122 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:40.162097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"e764530a40f3b2aea5044a531082991b5b653ad1f1dce92a5f4ab15b251dc1d7"} Sep 17 17:34:40.836678 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:40.836635 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:40.837761 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:40.837741 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:40.923680 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:40.923637 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:40.923814 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:40.923794 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:41.924749 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:41.924567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:41.925417 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:41.924611 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:41.925417 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:41.924836 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:41.925417 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:41.924919 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:42.167855 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.167826 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b2dbe03-f597-453c-a050-2636af7d309e" containerID="170d62d2125ec5f657b388aa8866a1f3fb211ded1aa692c38305d2e6cdde906a" exitCode=0 Sep 17 17:34:42.167987 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.167902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerDied","Data":"170d62d2125ec5f657b388aa8866a1f3fb211ded1aa692c38305d2e6cdde906a"} Sep 17 17:34:42.171620 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.171602 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:34:42.172002 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.171980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"27085c251ae2704c33ed859010158641afd47790a738f16b9d56f57f7de5ef38"} Sep 17 17:34:42.172260 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.172245 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:42.172312 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.172294 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:42.172392 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.172379 2577 scope.go:117] "RemoveContainer" containerID="9186c5f807867a1bd7cda88ee774378d7bd28d0294c23c9c069bd4fb61b1b9e5" Sep 17 17:34:42.188644 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.188625 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:42.925045 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:42.924353 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:42.925045 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:42.924722 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:43.176726 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.176691 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b2dbe03-f597-453c-a050-2636af7d309e" containerID="1d46a8aeba0d120c526b3601bd71b24ce2ad463d3b1e13f68ab15f3b4887babe" exitCode=0 Sep 17 17:34:43.176870 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.176784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerDied","Data":"1d46a8aeba0d120c526b3601bd71b24ce2ad463d3b1e13f68ab15f3b4887babe"} Sep 17 17:34:43.181070 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.181055 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:34:43.181393 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.181372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" event={"ID":"c9c20e22-1c65-4c08-8086-ee74eb387729","Type":"ContainerStarted","Data":"6f3dba7f0a064cdecd052ccd3975bcbe0bdd6cec87419d7c490e7b9ff6073969"} Sep 17 17:34:43.181655 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.181637 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:43.195761 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.195743 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:34:43.256945 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.256903 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" podStartSLOduration=9.636183813 podStartE2EDuration="27.256891193s" totalImagesPullingTime="17.62070738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:43.256260415 +0000 UTC m=+29.733270587" watchObservedRunningTime="2026-09-17 17:34:43.256891193 +0000 UTC m=+29.733901364" Sep 17 17:34:43.611389 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.611087 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9tvnp"] Sep 17 17:34:43.611389 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.611212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:43.611389 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:43.611330 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:43.614617 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.614352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kf5j4"] Sep 17 17:34:43.614617 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.614483 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:43.614617 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:43.614574 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:43.615181 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.615156 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z6vms"] Sep 17 17:34:43.615288 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:43.615262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:43.615388 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:43.615368 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:44.185495 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:44.185466 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b2dbe03-f597-453c-a050-2636af7d309e" containerID="d7faa127600f153133218a1db4f376351311e95d2218d7a266d1e7bb42a8c230" exitCode=0 Sep 17 17:34:44.185918 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:44.185544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerDied","Data":"d7faa127600f153133218a1db4f376351311e95d2218d7a266d1e7bb42a8c230"} Sep 17 17:34:44.923627 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:44.923594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:44.923822 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:44.923645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:44.923822 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:44.923597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:44.923822 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:44.923755 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:44.924042 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:44.923835 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:44.924042 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:44.923927 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:46.746288 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:46.746261 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:46.746834 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:46.746402 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 17:34:46.747247 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:46.747172 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kxtlt" Sep 17 17:34:46.924521 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:46.924489 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:46.924521 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:46.924504 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:46.924758 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:46.924530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:46.924758 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:46.924649 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:46.924758 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:46.924650 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:46.924758 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:46.924743 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:48.924628 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:48.924419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:48.925067 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:48.924480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:48.925067 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:48.924492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:48.925067 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:48.924770 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kf5j4" podUID="6d6a660c-06e4-47f7-9f1a-bb758ffaf107" Sep 17 17:34:48.925067 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:48.924876 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:34:48.925067 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:48.924948 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9tvnp" podUID="95abfd80-c3af-45b0-adb6-12c29ecbde88" Sep 17 17:34:49.146779 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.146752 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-254.ec2.internal" event="NodeReady" Sep 17 17:34:49.146913 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.146875 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 17:34:49.198934 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.198873 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b2dbe03-f597-453c-a050-2636af7d309e" containerID="562ab9af87c566e8de01417204530e35fd72621218360f60b21cf0fb08c911a1" exitCode=0 Sep 17 17:34:49.198934 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.198911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerDied","Data":"562ab9af87c566e8de01417204530e35fd72621218360f60b21cf0fb08c911a1"} Sep 17 17:34:49.210047 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.210027 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5565f8cb57-wr62p"] Sep 17 17:34:49.236033 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.236014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5565f8cb57-wr62p"] Sep 17 17:34:49.236147 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.236110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.247555 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.247538 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 17:34:49.247655 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.247592 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 17:34:49.248831 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.248805 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 17:34:49.249077 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.249061 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mzr6j\"" Sep 17 17:34:49.261782 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.261760 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ljqpn"] Sep 17 17:34:49.263560 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.263540 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 17:34:49.296262 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.296240 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kldhv"] Sep 17 17:34:49.296355 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.296339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.302972 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.302918 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 17:34:49.303189 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.303169 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2tbmw\"" Sep 17 17:34:49.303291 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.303203 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 17:34:49.303291 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.303223 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 17:34:49.314194 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.314176 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kldhv"] Sep 17 17:34:49.314279 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.314204 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ljqpn"] Sep 17 17:34:49.314279 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.314265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.317256 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-trusted-ca\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.317335 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-installation-pull-secrets\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.317335 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-certificates\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.317442 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xck\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-kube-api-access-f2xck\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.317442 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-bound-sa-token\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.317551 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-image-registry-private-configuration\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.318082 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317614 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.318082 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b82e04cb-2d54-4210-b4c4-7edf5a430023-ca-trust-extracted\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.318082 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317822 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 17:34:49.318082 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.317864 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gbrs5\"" Sep 17 17:34:49.318325 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.318114 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 17:34:49.418608 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-image-registry-private-configuration\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.418713 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/986d10f3-a483-409b-a4d0-436721350a4e-config-volume\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.418713 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.418713 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986d10f3-a483-409b-a4d0-436721350a4e-tmp-dir\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.418857 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b82e04cb-2d54-4210-b4c4-7edf5a430023-ca-trust-extracted\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.418857 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-trusted-ca\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.418857 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.418750 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:49.418857 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.418769 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:34:49.418857 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.418820 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:49.918800852 +0000 UTC m=+36.395811018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:34:49.418857 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418754 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgdht\" (UniqueName: \"kubernetes.io/projected/986d10f3-a483-409b-a4d0-436721350a4e-kube-api-access-sgdht\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668zf\" (UniqueName: \"kubernetes.io/projected/0e128c41-0ce4-49a6-96d0-89f1e2586027-kube-api-access-668zf\") pod \"ingress-canary-ljqpn\" (UID: \"0e128c41-0ce4-49a6-96d0-89f1e2586027\") " pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.418932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-installation-pull-secrets\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.419006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-certificates\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.419040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xck\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-kube-api-access-f2xck\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.419074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e128c41-0ce4-49a6-96d0-89f1e2586027-cert\") pod \"ingress-canary-ljqpn\" (UID: \"0e128c41-0ce4-49a6-96d0-89f1e2586027\") " pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.419104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-bound-sa-token\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.419155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.419136 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b82e04cb-2d54-4210-b4c4-7edf5a430023-ca-trust-extracted\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.419497 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.419479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-certificates\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.419725 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.419706 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-trusted-ca\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.422393 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.422377 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-image-registry-private-configuration\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.422446 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.422389 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-installation-pull-secrets\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.430636 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.430619 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-bound-sa-token\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.431234 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.431219 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xck\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-kube-api-access-f2xck\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.520334 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:49.520334 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.520334 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgdht\" (UniqueName: \"kubernetes.io/projected/986d10f3-a483-409b-a4d0-436721350a4e-kube-api-access-sgdht\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.520527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668zf\" (UniqueName: \"kubernetes.io/projected/0e128c41-0ce4-49a6-96d0-89f1e2586027-kube-api-access-668zf\") pod \"ingress-canary-ljqpn\" (UID: \"0e128c41-0ce4-49a6-96d0-89f1e2586027\") " pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.520527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e128c41-0ce4-49a6-96d0-89f1e2586027-cert\") pod \"ingress-canary-ljqpn\" (UID: \"0e128c41-0ce4-49a6-96d0-89f1e2586027\") " pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.520527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/986d10f3-a483-409b-a4d0-436721350a4e-config-volume\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.520527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:49.520527 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.520442 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:49.520527 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.520513 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:49.520790 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.520452 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:49.520790 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986d10f3-a483-409b-a4d0-436721350a4e-tmp-dir\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.520790 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.520515 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.020496883 +0000 UTC m=+36.497507036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:34:49.520790 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.520587 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:35:21.520570738 +0000 UTC m=+67.997580895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 17:34:49.520790 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.520606 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret podName:95abfd80-c3af-45b0-adb6-12c29ecbde88 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:21.520596697 +0000 UTC m=+67.997606847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret") pod "global-pull-secret-syncer-9tvnp" (UID: "95abfd80-c3af-45b0-adb6-12c29ecbde88") : object "kube-system"/"original-pull-secret" not registered Sep 17 17:34:49.520790 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520752 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/986d10f3-a483-409b-a4d0-436721350a4e-tmp-dir\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.520977 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.520938 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/986d10f3-a483-409b-a4d0-436721350a4e-config-volume\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.522454 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.522432 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e128c41-0ce4-49a6-96d0-89f1e2586027-cert\") pod \"ingress-canary-ljqpn\" (UID: \"0e128c41-0ce4-49a6-96d0-89f1e2586027\") " pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.537373 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.537349 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgdht\" (UniqueName: \"kubernetes.io/projected/986d10f3-a483-409b-a4d0-436721350a4e-kube-api-access-sgdht\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:49.538453 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.538435 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668zf\" (UniqueName: \"kubernetes.io/projected/0e128c41-0ce4-49a6-96d0-89f1e2586027-kube-api-access-668zf\") pod \"ingress-canary-ljqpn\" (UID: \"0e128c41-0ce4-49a6-96d0-89f1e2586027\") " pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.569549 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.569516 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:49.603284 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.603260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ljqpn" Sep 17 17:34:49.621560 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.621540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:49.621640 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.621628 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 17:34:49.621699 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.621642 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 17:34:49.621699 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.621651 2577 projected.go:196] Error preparing data for projected volume kube-api-access-lz9mc for pod openshift-network-diagnostics/network-check-target-kf5j4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:49.621768 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.621703 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc podName:6d6a660c-06e4-47f7-9f1a-bb758ffaf107 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:21.621692819 +0000 UTC m=+68.098702982 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lz9mc" (UniqueName: "kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc") pod "network-check-target-kf5j4" (UID: "6d6a660c-06e4-47f7-9f1a-bb758ffaf107") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 17:34:49.690714 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.690680 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:49.924127 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.924100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:49.924273 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.924253 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:49.924324 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.924274 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:34:49.924360 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:49.924326 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:50.924310603 +0000 UTC m=+37.401320751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:34:49.937761 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:49.937739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ljqpn"] Sep 17 17:34:49.940033 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:34:49.940009 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e128c41_0ce4_49a6_96d0_89f1e2586027.slice/crio-c190a8d17a454642fbf339e14272839413a37b76a7443e676ef0766d50c33ad0 WatchSource:0}: Error finding container c190a8d17a454642fbf339e14272839413a37b76a7443e676ef0766d50c33ad0: Status 404 returned error can't find the container with id c190a8d17a454642fbf339e14272839413a37b76a7443e676ef0766d50c33ad0 Sep 17 17:34:50.025042 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.025018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:50.025170 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:50.025154 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:50.025260 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:50.025249 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:34:51.025232711 +0000 UTC m=+37.502242877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:34:50.204489 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.204434 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b2dbe03-f597-453c-a050-2636af7d309e" containerID="e97453fdab96e23f64b8451433c513e814ae0c25bc9a1abfc343535e6bca09ec" exitCode=0 Sep 17 17:34:50.204588 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.204525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerDied","Data":"e97453fdab96e23f64b8451433c513e814ae0c25bc9a1abfc343535e6bca09ec"} Sep 17 17:34:50.205719 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.205696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ljqpn" event={"ID":"0e128c41-0ce4-49a6-96d0-89f1e2586027","Type":"ContainerStarted","Data":"c190a8d17a454642fbf339e14272839413a37b76a7443e676ef0766d50c33ad0"} Sep 17 17:34:50.924247 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.924217 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:34:50.924247 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.924245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:34:50.924466 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.924254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:34:50.927496 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.927472 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xc26q\"" Sep 17 17:34:50.927623 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.927472 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:34:50.928722 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.928683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:34:50.928848 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.928727 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:34:50.928848 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.928790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2vf4\"" Sep 17 17:34:50.929017 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.928939 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:34:50.931093 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:50.931052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:50.931337 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:50.931276 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:50.931337 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:50.931298 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:34:50.931618 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:50.931357 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:52.931338426 +0000 UTC m=+39.408348578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:34:51.031504 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:51.031474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:51.031905 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:51.031650 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:51.031905 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:51.031740 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:34:53.031718844 +0000 UTC m=+39.508729010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:34:51.212780 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:51.212701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" event={"ID":"6b2dbe03-f597-453c-a050-2636af7d309e","Type":"ContainerStarted","Data":"3f457d121e116da33897d1f710748c87a03bf4f1148545af3939e4e0e94ef6e0"} Sep 17 17:34:51.240387 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:51.240332 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rk2qz" podStartSLOduration=8.594734233 podStartE2EDuration="35.240312598s" totalImagesPullingTime="26.645578365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:51.23837898 +0000 UTC m=+37.715389151" watchObservedRunningTime="2026-09-17 17:34:51.240312598 +0000 UTC m=+37.717322770" Sep 17 17:34:51.370155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:51.370124 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:51.441566 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:51.441523 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:51.517143 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:51.517074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:52.946605 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:52.946561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:52.946985 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:52.946727 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:52.946985 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:52.946748 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:34:52.946985 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:52.946815 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:56.946791423 +0000 UTC m=+43.423801573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:34:53.047477 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:53.047454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:53.047575 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:53.047563 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:53.047615 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:53.047608 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:34:57.047596975 +0000 UTC m=+43.524607124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:34:53.218351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:53.218293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ljqpn" event={"ID":"0e128c41-0ce4-49a6-96d0-89f1e2586027","Type":"ContainerStarted","Data":"fe800b9d0baf0758c94f58d07461294af704312429e619a8bf02b121a9be65ef"} Sep 17 17:34:53.241493 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:53.241428 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ljqpn" podStartSLOduration=1.877956299 podStartE2EDuration="4.241412177s" totalImagesPullingTime="2.363455878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:53.240415402 +0000 UTC m=+39.717425573" watchObservedRunningTime="2026-09-17 17:34:53.241412177 +0000 UTC m=+39.718422365" Sep 17 17:34:53.522185 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:53.522112 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:53.618580 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:53.618552 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" limit=1024 Sep 17 17:34:56.973181 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:56.973151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:34:56.973577 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:56.973287 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:34:56.973577 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:56.973303 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:34:56.973577 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:56.973349 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:04.973334604 +0000 UTC m=+51.450344783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:34:57.073634 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:34:57.073609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:34:57.073762 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:57.073742 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:34:57.073801 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:34:57.073792 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:35:05.073779213 +0000 UTC m=+51.550789366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:35:05.030878 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:05.030632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:35:05.031283 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:05.030792 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:35:05.031283 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:05.030959 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:35:05.031283 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:05.031014 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:21.03100097 +0000 UTC m=+67.508011124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:35:05.131868 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:05.131836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:35:05.132021 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:05.131961 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:05.132021 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:05.132009 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:35:21.131996108 +0000 UTC m=+67.609006256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:35:11.918117 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:11.918080 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh"] Sep 17 17:35:11.921611 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:11.921591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:11.928691 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:11.928634 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"open-cluster-management-image-pull-credentials\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" Sep 17 17:35:11.929088 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:11.929059 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 17 17:35:11.929205 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:11.929188 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"managed-serviceaccount-dockercfg-qkght\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qkght\"" type="*v1.Secret" Sep 17 17:35:11.929518 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:11.929498 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"managed-serviceaccount-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" type="*v1.Secret" Sep 17 17:35:11.929581 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:11.929518 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" podUID="30142390-f0d1-4d84-8bd1-ce349e52eca8" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:11.929727 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:11.929710 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 17 17:35:11.955281 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:11.955253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh"] Sep 17 17:35:12.079231 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:12.079193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30142390-f0d1-4d84-8bd1-ce349e52eca8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" (UID: \"30142390-f0d1-4d84-8bd1-ce349e52eca8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:12.079231 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:12.079233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ctlk\" (UniqueName: \"kubernetes.io/projected/30142390-f0d1-4d84-8bd1-ce349e52eca8-kube-api-access-2ctlk\") pod \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" (UID: \"30142390-f0d1-4d84-8bd1-ce349e52eca8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:12.180209 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:12.180134 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30142390-f0d1-4d84-8bd1-ce349e52eca8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" (UID: \"30142390-f0d1-4d84-8bd1-ce349e52eca8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:12.180209 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:12.180168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ctlk\" (UniqueName: \"kubernetes.io/projected/30142390-f0d1-4d84-8bd1-ce349e52eca8-kube-api-access-2ctlk\") pod \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" (UID: \"30142390-f0d1-4d84-8bd1-ce349e52eca8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:13.037024 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.036990 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 17:35:13.082464 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.082439 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qkght\"" Sep 17 17:35:13.119778 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.119751 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 17 17:35:13.125451 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.125429 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30142390-f0d1-4d84-8bd1-ce349e52eca8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" (UID: \"30142390-f0d1-4d84-8bd1-ce349e52eca8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:13.133161 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.133140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 17:35:13.189212 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:13.189183 2577 projected.go:291] Couldn't get configMap open-cluster-management-agent-addon/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Sep 17 17:35:13.189314 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:13.189224 2577 projected.go:196] Error preparing data for projected volume kube-api-access-2ctlk for pod open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh: failed to sync configmap cache: timed out waiting for the condition Sep 17 17:35:13.189360 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:13.189314 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30142390-f0d1-4d84-8bd1-ce349e52eca8-kube-api-access-2ctlk podName:30142390-f0d1-4d84-8bd1-ce349e52eca8 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:13.689292914 +0000 UTC m=+60.166303069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2ctlk" (UniqueName: "kubernetes.io/projected/30142390-f0d1-4d84-8bd1-ce349e52eca8-kube-api-access-2ctlk") pod "managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" (UID: "30142390-f0d1-4d84-8bd1-ce349e52eca8") : failed to sync configmap cache: timed out waiting for the condition Sep 17 17:35:13.198568 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.198539 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 17:35:13.692532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.692500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ctlk\" (UniqueName: \"kubernetes.io/projected/30142390-f0d1-4d84-8bd1-ce349e52eca8-kube-api-access-2ctlk\") pod \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" (UID: \"30142390-f0d1-4d84-8bd1-ce349e52eca8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:13.694817 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.694798 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ctlk\" (UniqueName: \"kubernetes.io/projected/30142390-f0d1-4d84-8bd1-ce349e52eca8-kube-api-access-2ctlk\") pod \"managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh\" (UID: \"30142390-f0d1-4d84-8bd1-ce349e52eca8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:13.738811 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:13.738786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" Sep 17 17:35:14.009112 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:14.009021 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh"] Sep 17 17:35:14.012093 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:35:14.012069 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30142390_f0d1_4d84_8bd1_ce349e52eca8.slice/crio-ebd90566ecb633494b647c5c2779fa3b4d29da0257ce52a8ffe8db12df6e5033 WatchSource:0}: Error finding container ebd90566ecb633494b647c5c2779fa3b4d29da0257ce52a8ffe8db12df6e5033: Status 404 returned error can't find the container with id ebd90566ecb633494b647c5c2779fa3b4d29da0257ce52a8ffe8db12df6e5033 Sep 17 17:35:14.269128 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:14.269022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" event={"ID":"30142390-f0d1-4d84-8bd1-ce349e52eca8","Type":"ContainerStarted","Data":"ebd90566ecb633494b647c5c2779fa3b4d29da0257ce52a8ffe8db12df6e5033"} Sep 17 17:35:15.199768 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:15.199740 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9zjm4" Sep 17 17:35:18.281517 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:18.281477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" event={"ID":"30142390-f0d1-4d84-8bd1-ce349e52eca8","Type":"ContainerStarted","Data":"38a8d8354ac7b8690f6f2101435ce9c86a0812bf31ef24c4beafa8f80db64920"} Sep 17 17:35:18.300078 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:18.300007 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" podStartSLOduration=3.8039567720000003 podStartE2EDuration="7.299987258s" totalImagesPullingTime="3.496030486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:18.299423899 +0000 UTC m=+64.776434070" watchObservedRunningTime="2026-09-17 17:35:18.299987258 +0000 UTC m=+64.776997431" Sep 17 17:35:21.045954 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.045915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:35:21.046338 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:21.046060 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:35:21.046338 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:21.046080 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:35:21.046338 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:21.046140 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:53.046122686 +0000 UTC m=+99.523132834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:35:21.146369 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.146337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:35:21.146518 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:21.146434 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:21.146518 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:21.146484 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:35:53.146471683 +0000 UTC m=+99.623481832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:35:21.549860 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.549823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:35:21.550026 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.549899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:35:21.554106 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.554080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 17:35:21.554106 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.554094 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 17:35:21.560197 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:21.560172 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 17:35:21.560280 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:21.560246 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:36:25.560226928 +0000 UTC m=+132.037237136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : secret "metrics-daemon-secret" not found Sep 17 17:35:21.562565 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.562545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/95abfd80-c3af-45b0-adb6-12c29ecbde88-original-pull-secret\") pod \"global-pull-secret-syncer-9tvnp\" (UID: \"95abfd80-c3af-45b0-adb6-12c29ecbde88\") " pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:35:21.651002 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.650971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:35:21.653926 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.653906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 17:35:21.663780 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.663759 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 17:35:21.674454 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.674427 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz9mc\" (UniqueName: \"kubernetes.io/projected/6d6a660c-06e4-47f7-9f1a-bb758ffaf107-kube-api-access-lz9mc\") pod \"network-check-target-kf5j4\" (UID: \"6d6a660c-06e4-47f7-9f1a-bb758ffaf107\") " pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:35:21.841808 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.841749 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2vf4\"" Sep 17 17:35:21.848049 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.848029 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9tvnp" Sep 17 17:35:21.849135 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:21.849117 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:35:22.131168 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:22.131103 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9tvnp"] Sep 17 17:35:22.134503 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:35:22.134474 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95abfd80_c3af_45b0_adb6_12c29ecbde88.slice/crio-97de2d091d89ddda11715b3644240a4d4615511e195c5bd321739d374f114d2f WatchSource:0}: Error finding container 97de2d091d89ddda11715b3644240a4d4615511e195c5bd321739d374f114d2f: Status 404 returned error can't find the container with id 97de2d091d89ddda11715b3644240a4d4615511e195c5bd321739d374f114d2f Sep 17 17:35:22.134637 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:22.134614 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kf5j4"] Sep 17 17:35:22.137507 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:35:22.137487 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6a660c_06e4_47f7_9f1a_bb758ffaf107.slice/crio-01024115b15f39d1c7bea3735d0bcf9c20c0d416abe30491e04b17938dc4cfbb WatchSource:0}: Error finding container 01024115b15f39d1c7bea3735d0bcf9c20c0d416abe30491e04b17938dc4cfbb: Status 404 returned error can't find the container with id 01024115b15f39d1c7bea3735d0bcf9c20c0d416abe30491e04b17938dc4cfbb Sep 17 17:35:22.292144 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:22.292111 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kf5j4" event={"ID":"6d6a660c-06e4-47f7-9f1a-bb758ffaf107","Type":"ContainerStarted","Data":"01024115b15f39d1c7bea3735d0bcf9c20c0d416abe30491e04b17938dc4cfbb"} Sep 17 17:35:22.293220 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:22.293194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9tvnp" event={"ID":"95abfd80-c3af-45b0-adb6-12c29ecbde88","Type":"ContainerStarted","Data":"97de2d091d89ddda11715b3644240a4d4615511e195c5bd321739d374f114d2f"} Sep 17 17:35:27.309581 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:27.309414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kf5j4" event={"ID":"6d6a660c-06e4-47f7-9f1a-bb758ffaf107","Type":"ContainerStarted","Data":"f13d623a6882322a6cfa2aadc2bca68bb923f7318ef19e9699603b43409d2c81"} Sep 17 17:35:27.309581 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:27.309503 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:35:27.311373 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:27.311342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9tvnp" event={"ID":"95abfd80-c3af-45b0-adb6-12c29ecbde88","Type":"ContainerStarted","Data":"29780e6fa20ca285bba20533f6d45d61c5b413ecedf56ccd46073231e2085418"} Sep 17 17:35:27.331202 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:27.331134 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kf5j4" podStartSLOduration=67.093606016 podStartE2EDuration="1m11.331114583s" totalImagesPullingTime="4.237508567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:27.330109431 +0000 UTC m=+73.807119603" watchObservedRunningTime="2026-09-17 17:35:27.331114583 +0000 UTC m=+73.808124758" Sep 17 17:35:53.064651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:53.064619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:35:53.064999 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:53.064773 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 17:35:53.064999 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:53.064795 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5565f8cb57-wr62p: secret "image-registry-tls" not found Sep 17 17:35:53.064999 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:53.064869 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls podName:b82e04cb-2d54-4210-b4c4-7edf5a430023 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:57.064851346 +0000 UTC m=+163.541861495 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls") pod "image-registry-5565f8cb57-wr62p" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023") : secret "image-registry-tls" not found Sep 17 17:35:53.165749 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:53.165715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:35:53.165894 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:53.165861 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 17:35:53.165959 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:35:53.165945 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls podName:986d10f3-a483-409b-a4d0-436721350a4e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:57.165928995 +0000 UTC m=+163.642939187 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls") pod "dns-default-kldhv" (UID: "986d10f3-a483-409b-a4d0-436721350a4e") : secret "dns-default-metrics-tls" not found Sep 17 17:35:58.316055 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:58.316028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kf5j4" Sep 17 17:35:58.337431 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:35:58.337347 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9tvnp" podStartSLOduration=98.090231093 podStartE2EDuration="1m42.337333607s" totalImagesPullingTime="4.247102514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:35:27.355382563 +0000 UTC m=+73.832392736" watchObservedRunningTime="2026-09-17 17:35:58.337333607 +0000 UTC m=+104.814343825" Sep 17 17:36:12.489322 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.489274 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct"] Sep 17 17:36:12.492282 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.492262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.496266 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.496241 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 17:36:12.496544 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.496515 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6g5zc\"" Sep 17 17:36:12.497519 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.497498 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:36:12.497573 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.497498 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 17:36:12.498288 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.498268 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 17:36:12.530167 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.530136 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct"] Sep 17 17:36:12.595810 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.595786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hlbc\" (UniqueName: \"kubernetes.io/projected/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-kube-api-access-7hlbc\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.595922 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.595857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.595965 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.595912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.626375 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.626350 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-ldhm4"] Sep 17 17:36:12.628032 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.628014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.633953 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.633933 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 17 17:36:12.634974 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.634959 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wf6x6\"" Sep 17 17:36:12.635760 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.635742 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 17 17:36:12.635898 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.635881 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 17 17:36:12.639973 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.639956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 17 17:36:12.650482 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.650459 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 17 17:36:12.696746 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.696723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c76jn\" (UniqueName: \"kubernetes.io/projected/e6f99fb0-c136-483a-87c2-7dd429102383-kube-api-access-c76jn\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.696842 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.696751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.696842 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.696769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6f99fb0-c136-483a-87c2-7dd429102383-config\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.696842 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.696786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hlbc\" (UniqueName: \"kubernetes.io/projected/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-kube-api-access-7hlbc\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.696842 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.696801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6f99fb0-c136-483a-87c2-7dd429102383-serving-cert\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.696972 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.696918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.696972 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.696942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6f99fb0-c136-483a-87c2-7dd429102383-trusted-ca\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.697384 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.697367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.698857 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.698839 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.712853 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.712833 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl"] Sep 17 17:36:12.713312 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.713294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hlbc\" (UniqueName: \"kubernetes.io/projected/5b5059fa-e6b0-4123-ac5e-4f135f51dd06-kube-api-access-7hlbc\") pod \"kube-storage-version-migrator-operator-55889f7b47-2bmct\" (UID: \"5b5059fa-e6b0-4123-ac5e-4f135f51dd06\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.715084 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.715067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" Sep 17 17:36:12.718527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.718510 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2hlph\"" Sep 17 17:36:12.722081 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.722055 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-ldhm4"] Sep 17 17:36:12.728144 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.728125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl"] Sep 17 17:36:12.797315 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.797273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6f99fb0-c136-483a-87c2-7dd429102383-trusted-ca\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.797315 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.797299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xngbk\" (UniqueName: \"kubernetes.io/projected/143f27ad-569e-44c7-ba51-0e879f3723b1-kube-api-access-xngbk\") pod \"network-check-source-7cbc45fddc-mpldl\" (UID: \"143f27ad-569e-44c7-ba51-0e879f3723b1\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" Sep 17 17:36:12.797440 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.797321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c76jn\" (UniqueName: \"kubernetes.io/projected/e6f99fb0-c136-483a-87c2-7dd429102383-kube-api-access-c76jn\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.797440 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.797340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6f99fb0-c136-483a-87c2-7dd429102383-config\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.797440 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.797361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6f99fb0-c136-483a-87c2-7dd429102383-serving-cert\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.797977 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.797955 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6f99fb0-c136-483a-87c2-7dd429102383-config\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.798058 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.797992 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6f99fb0-c136-483a-87c2-7dd429102383-trusted-ca\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.799354 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.799330 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6f99fb0-c136-483a-87c2-7dd429102383-serving-cert\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.802315 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.802298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" Sep 17 17:36:12.807275 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.807256 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c76jn\" (UniqueName: \"kubernetes.io/projected/e6f99fb0-c136-483a-87c2-7dd429102383-kube-api-access-c76jn\") pod \"console-operator-fd4bb46c-ldhm4\" (UID: \"e6f99fb0-c136-483a-87c2-7dd429102383\") " pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:12.898463 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.898436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xngbk\" (UniqueName: \"kubernetes.io/projected/143f27ad-569e-44c7-ba51-0e879f3723b1-kube-api-access-xngbk\") pod \"network-check-source-7cbc45fddc-mpldl\" (UID: \"143f27ad-569e-44c7-ba51-0e879f3723b1\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" Sep 17 17:36:12.911134 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.911107 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xngbk\" (UniqueName: \"kubernetes.io/projected/143f27ad-569e-44c7-ba51-0e879f3723b1-kube-api-access-xngbk\") pod \"network-check-source-7cbc45fddc-mpldl\" (UID: \"143f27ad-569e-44c7-ba51-0e879f3723b1\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" Sep 17 17:36:12.936038 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:12.936014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:13.025199 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.025166 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" Sep 17 17:36:13.074386 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.074218 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct"] Sep 17 17:36:13.079256 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:13.079225 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5059fa_e6b0_4123_ac5e_4f135f51dd06.slice/crio-cd20fa9fb5f6abff516f6db3308ce889593dbef4886ae47ec3897fbfdcb07104 WatchSource:0}: Error finding container cd20fa9fb5f6abff516f6db3308ce889593dbef4886ae47ec3897fbfdcb07104: Status 404 returned error can't find the container with id cd20fa9fb5f6abff516f6db3308ce889593dbef4886ae47ec3897fbfdcb07104 Sep 17 17:36:13.205677 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.205633 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-ldhm4"] Sep 17 17:36:13.208121 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:13.208092 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f99fb0_c136_483a_87c2_7dd429102383.slice/crio-57538e427641f6b2a97ff9f3ff356685e9501f01e26b0922c1187d492a6825f3 WatchSource:0}: Error finding container 57538e427641f6b2a97ff9f3ff356685e9501f01e26b0922c1187d492a6825f3: Status 404 returned error can't find the container with id 57538e427641f6b2a97ff9f3ff356685e9501f01e26b0922c1187d492a6825f3 Sep 17 17:36:13.298742 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.298714 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl"] Sep 17 17:36:13.301808 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:13.301787 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143f27ad_569e_44c7_ba51_0e879f3723b1.slice/crio-5ebca46240f78ca25647d6044f60178353372e6e64d1a544e8bbbd132cea2123 WatchSource:0}: Error finding container 5ebca46240f78ca25647d6044f60178353372e6e64d1a544e8bbbd132cea2123: Status 404 returned error can't find the container with id 5ebca46240f78ca25647d6044f60178353372e6e64d1a544e8bbbd132cea2123 Sep 17 17:36:13.422672 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.422620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" event={"ID":"143f27ad-569e-44c7-ba51-0e879f3723b1","Type":"ContainerStarted","Data":"f70f2ac59136127775768ed58fc3cefd8c0953987ab3c823ae5d763912c87861"} Sep 17 17:36:13.422823 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.422703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" event={"ID":"143f27ad-569e-44c7-ba51-0e879f3723b1","Type":"ContainerStarted","Data":"5ebca46240f78ca25647d6044f60178353372e6e64d1a544e8bbbd132cea2123"} Sep 17 17:36:13.423787 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.423763 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" event={"ID":"5b5059fa-e6b0-4123-ac5e-4f135f51dd06","Type":"ContainerStarted","Data":"cd20fa9fb5f6abff516f6db3308ce889593dbef4886ae47ec3897fbfdcb07104"} Sep 17 17:36:13.424828 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.424805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" event={"ID":"e6f99fb0-c136-483a-87c2-7dd429102383","Type":"ContainerStarted","Data":"57538e427641f6b2a97ff9f3ff356685e9501f01e26b0922c1187d492a6825f3"} Sep 17 17:36:13.448431 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:13.448391 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-mpldl" podStartSLOduration=1.448379084 podStartE2EDuration="1.448379084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:13.447249899 +0000 UTC m=+119.924260071" watchObservedRunningTime="2026-09-17 17:36:13.448379084 +0000 UTC m=+119.925389281" Sep 17 17:36:15.610963 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.610933 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h8xww"] Sep 17 17:36:15.613211 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.613188 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.616616 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.616591 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 17:36:15.616753 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.616624 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 17:36:15.616959 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.616937 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 17:36:15.617953 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.617939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 17:36:15.618024 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.617952 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtzf6\"" Sep 17 17:36:15.628775 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.628712 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8xww"] Sep 17 17:36:15.719698 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.719674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.719813 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.719744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25add384-5378-4300-be2c-220c3e7c587e-crio-socket\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.719880 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.719809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25add384-5378-4300-be2c-220c3e7c587e-data-volume\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.719880 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.719853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.720005 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.719969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x4gr\" (UniqueName: \"kubernetes.io/projected/25add384-5378-4300-be2c-220c3e7c587e-kube-api-access-5x4gr\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.820982 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.820960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25add384-5378-4300-be2c-220c3e7c587e-data-volume\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.821089 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.820989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.821157 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.821137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x4gr\" (UniqueName: \"kubernetes.io/projected/25add384-5378-4300-be2c-220c3e7c587e-kube-api-access-5x4gr\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.821227 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.821180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.821227 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.821208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25add384-5378-4300-be2c-220c3e7c587e-crio-socket\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.821327 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.821288 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25add384-5378-4300-be2c-220c3e7c587e-crio-socket\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.821327 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.821303 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25add384-5378-4300-be2c-220c3e7c587e-data-volume\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:15.823884 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.823869 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 17:36:15.823934 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.823888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 17:36:15.831226 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.830901 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 17:36:15.831226 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:15.831147 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:36:15.831226 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:15.831225 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:16.331205106 +0000 UTC m=+122.808215271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : configmap "kube-rbac-proxy" not found Sep 17 17:36:15.831444 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:15.831362 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:36:15.831444 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:15.831421 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:16.331403788 +0000 UTC m=+122.808413951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : secret "insights-runtime-extractor-tls" not found Sep 17 17:36:15.841797 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.841774 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 17:36:15.852263 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:15.852237 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x4gr\" (UniqueName: \"kubernetes.io/projected/25add384-5378-4300-be2c-220c3e7c587e-kube-api-access-5x4gr\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:16.423883 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.423855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:16.424000 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.423912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:16.424000 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:16.423982 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:36:16.424000 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:16.423995 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:36:16.424099 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:16.424049 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:17.424031608 +0000 UTC m=+123.901041771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : configmap "kube-rbac-proxy" not found Sep 17 17:36:16.424099 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:16.424068 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:17.424058166 +0000 UTC m=+123.901068318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : secret "insights-runtime-extractor-tls" not found Sep 17 17:36:16.436186 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.436158 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" event={"ID":"5b5059fa-e6b0-4123-ac5e-4f135f51dd06","Type":"ContainerStarted","Data":"6191c2b6597c76974a49004b66197d3b098f5024b177278803a985d56a5ffedb"} Sep 17 17:36:16.437544 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.437527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/0.log" Sep 17 17:36:16.437630 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.437560 2577 generic.go:356] "Generic (PLEG): container finished" podID="e6f99fb0-c136-483a-87c2-7dd429102383" containerID="df98ee6badc70b25fa0e5eacc2e86741d622d6d0234778892c0111cfc0e87314" exitCode=255 Sep 17 17:36:16.437630 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.437588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" event={"ID":"e6f99fb0-c136-483a-87c2-7dd429102383","Type":"ContainerDied","Data":"df98ee6badc70b25fa0e5eacc2e86741d622d6d0234778892c0111cfc0e87314"} Sep 17 17:36:16.437788 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.437774 2577 scope.go:117] "RemoveContainer" containerID="df98ee6badc70b25fa0e5eacc2e86741d622d6d0234778892c0111cfc0e87314" Sep 17 17:36:16.456206 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:16.456168 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" podStartSLOduration=1.90746053 podStartE2EDuration="4.456155606s" totalImagesPullingTime="2.548695076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:16.455372987 +0000 UTC m=+122.932383156" watchObservedRunningTime="2026-09-17 17:36:16.456155606 +0000 UTC m=+122.933165776" Sep 17 17:36:17.119405 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.119376 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj"] Sep 17 17:36:17.121217 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.121201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" Sep 17 17:36:17.123795 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.123777 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 17:36:17.124035 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.124022 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 17:36:17.125219 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.125202 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tg8cr\"" Sep 17 17:36:17.184602 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.184579 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj"] Sep 17 17:36:17.230038 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.230016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9m2s\" (UniqueName: \"kubernetes.io/projected/5c60d7c3-1973-49e8-866e-a14ccbe0b6e1-kube-api-access-n9m2s\") pod \"migrator-76794cbd6c-s9gfj\" (UID: \"5c60d7c3-1973-49e8-866e-a14ccbe0b6e1\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" Sep 17 17:36:17.331308 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.331286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9m2s\" (UniqueName: \"kubernetes.io/projected/5c60d7c3-1973-49e8-866e-a14ccbe0b6e1-kube-api-access-n9m2s\") pod \"migrator-76794cbd6c-s9gfj\" (UID: \"5c60d7c3-1973-49e8-866e-a14ccbe0b6e1\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" Sep 17 17:36:17.340240 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.340217 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8htvr_efda8b0b-921f-4643-9b36-bdf5f92b8e2e/dns-node-resolver/0.log" Sep 17 17:36:17.345020 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.344997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9m2s\" (UniqueName: \"kubernetes.io/projected/5c60d7c3-1973-49e8-866e-a14ccbe0b6e1-kube-api-access-n9m2s\") pod \"migrator-76794cbd6c-s9gfj\" (UID: \"5c60d7c3-1973-49e8-866e-a14ccbe0b6e1\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" Sep 17 17:36:17.430160 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.430139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" Sep 17 17:36:17.431796 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.431774 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:17.431891 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.431832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:17.432242 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:17.431913 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:36:17.432242 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:17.431915 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:36:17.432242 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:17.431971 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:19.431954971 +0000 UTC m=+125.908965133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : secret "insights-runtime-extractor-tls" not found Sep 17 17:36:17.432242 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:17.431986 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:19.431979202 +0000 UTC m=+125.908989350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : configmap "kube-rbac-proxy" not found Sep 17 17:36:17.442859 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.442816 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/1.log" Sep 17 17:36:17.443423 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.443399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/0.log" Sep 17 17:36:17.443503 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.443460 2577 generic.go:356] "Generic (PLEG): container finished" podID="e6f99fb0-c136-483a-87c2-7dd429102383" containerID="fddc56fdbbdb28f34ee967ac9a8250d24270dabdee632d478c2c9638c1c4a205" exitCode=255 Sep 17 17:36:17.443568 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.443544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" event={"ID":"e6f99fb0-c136-483a-87c2-7dd429102383","Type":"ContainerDied","Data":"fddc56fdbbdb28f34ee967ac9a8250d24270dabdee632d478c2c9638c1c4a205"} Sep 17 17:36:17.443631 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.443616 2577 scope.go:117] "RemoveContainer" containerID="df98ee6badc70b25fa0e5eacc2e86741d622d6d0234778892c0111cfc0e87314" Sep 17 17:36:17.443967 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.443857 2577 scope.go:117] "RemoveContainer" containerID="fddc56fdbbdb28f34ee967ac9a8250d24270dabdee632d478c2c9638c1c4a205" Sep 17 17:36:17.444065 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:17.444044 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-ldhm4_openshift-console-operator(e6f99fb0-c136-483a-87c2-7dd429102383)\"" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" podUID="e6f99fb0-c136-483a-87c2-7dd429102383" Sep 17 17:36:17.700353 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:17.700295 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj"] Sep 17 17:36:17.703323 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:17.703298 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c60d7c3_1973_49e8_866e_a14ccbe0b6e1.slice/crio-c28c8e9960b9ca75d1a4790ae7b255613d61ab288a7f393d33294e7c7ba0218c WatchSource:0}: Error finding container c28c8e9960b9ca75d1a4790ae7b255613d61ab288a7f393d33294e7c7ba0218c: Status 404 returned error can't find the container with id c28c8e9960b9ca75d1a4790ae7b255613d61ab288a7f393d33294e7c7ba0218c Sep 17 17:36:18.448263 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:18.448236 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/1.log" Sep 17 17:36:18.448642 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:18.448591 2577 scope.go:117] "RemoveContainer" containerID="fddc56fdbbdb28f34ee967ac9a8250d24270dabdee632d478c2c9638c1c4a205" Sep 17 17:36:18.448804 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:18.448779 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-ldhm4_openshift-console-operator(e6f99fb0-c136-483a-87c2-7dd429102383)\"" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" podUID="e6f99fb0-c136-483a-87c2-7dd429102383" Sep 17 17:36:18.449503 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:18.449481 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" event={"ID":"5c60d7c3-1973-49e8-866e-a14ccbe0b6e1","Type":"ContainerStarted","Data":"c28c8e9960b9ca75d1a4790ae7b255613d61ab288a7f393d33294e7c7ba0218c"} Sep 17 17:36:18.736355 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:18.736291 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r4w4q_167d5f18-0de8-4b9e-83dc-15ba015bbfa2/node-ca/0.log" Sep 17 17:36:19.446619 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:19.446569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:19.446833 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:19.446755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:19.446833 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:19.446792 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:36:19.446934 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:19.446856 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:36:19.446934 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:19.446866 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:23.44684896 +0000 UTC m=+129.923859109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : secret "insights-runtime-extractor-tls" not found Sep 17 17:36:19.446934 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:19.446911 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:23.446896874 +0000 UTC m=+129.923907126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : configmap "kube-rbac-proxy" not found Sep 17 17:36:19.454557 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:19.454527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" event={"ID":"5c60d7c3-1973-49e8-866e-a14ccbe0b6e1","Type":"ContainerStarted","Data":"dd7d40fc5c18e4052ff4ea466df3c906269a7cc20f29dbb7028995e9634534e2"} Sep 17 17:36:19.454954 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:19.454614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" event={"ID":"5c60d7c3-1973-49e8-866e-a14ccbe0b6e1","Type":"ContainerStarted","Data":"f9c517561feb8e3f43b52a9abbd76a8ea9c4c3fcf5e96f4206d23c08876dc1fe"} Sep 17 17:36:19.474475 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:19.474426 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-s9gfj" podStartSLOduration=1.4388425950000001 podStartE2EDuration="2.474411593s" totalImagesPullingTime="1.035568998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:19.473361523 +0000 UTC m=+125.950371694" watchObservedRunningTime="2026-09-17 17:36:19.474411593 +0000 UTC m=+125.951421764" Sep 17 17:36:19.536546 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:19.536518 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ljqpn_0e128c41-0ce4-49a6-96d0-89f1e2586027/serve-healthcheck-canary/0.log" Sep 17 17:36:20.012783 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.012748 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-5hs5d"] Sep 17 17:36:20.014777 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.014756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.017675 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.017638 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gf74w\"" Sep 17 17:36:20.018950 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.018918 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 17:36:20.018950 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.018937 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 17:36:20.019103 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.019023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 17:36:20.019103 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.019033 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 17:36:20.025160 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.025132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-5hs5d"] Sep 17 17:36:20.151343 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.151306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f09ee15a-ac1d-4e00-b466-ece16e649a17-signing-cabundle\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.151460 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.151374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rspwz\" (UniqueName: \"kubernetes.io/projected/f09ee15a-ac1d-4e00-b466-ece16e649a17-kube-api-access-rspwz\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.151506 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.151451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f09ee15a-ac1d-4e00-b466-ece16e649a17-signing-key\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.252527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.252484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f09ee15a-ac1d-4e00-b466-ece16e649a17-signing-key\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.252630 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.252562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f09ee15a-ac1d-4e00-b466-ece16e649a17-signing-cabundle\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.252630 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.252599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rspwz\" (UniqueName: \"kubernetes.io/projected/f09ee15a-ac1d-4e00-b466-ece16e649a17-kube-api-access-rspwz\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.253219 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.253194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f09ee15a-ac1d-4e00-b466-ece16e649a17-signing-cabundle\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.255280 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.255249 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f09ee15a-ac1d-4e00-b466-ece16e649a17-signing-key\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.263124 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.263066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rspwz\" (UniqueName: \"kubernetes.io/projected/f09ee15a-ac1d-4e00-b466-ece16e649a17-kube-api-access-rspwz\") pod \"service-ca-55f6fc7b86-5hs5d\" (UID: \"f09ee15a-ac1d-4e00-b466-ece16e649a17\") " pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.324018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.323992 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" Sep 17 17:36:20.602616 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:20.602556 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-5hs5d"] Sep 17 17:36:20.607102 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:20.607074 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09ee15a_ac1d_4e00_b466_ece16e649a17.slice/crio-5e8a43deb7ad2ce8552e4136137cebaa46b88140eceb1c0290d379f73077026e WatchSource:0}: Error finding container 5e8a43deb7ad2ce8552e4136137cebaa46b88140eceb1c0290d379f73077026e: Status 404 returned error can't find the container with id 5e8a43deb7ad2ce8552e4136137cebaa46b88140eceb1c0290d379f73077026e Sep 17 17:36:21.463159 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:21.463119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" event={"ID":"f09ee15a-ac1d-4e00-b466-ece16e649a17","Type":"ContainerStarted","Data":"5e8a43deb7ad2ce8552e4136137cebaa46b88140eceb1c0290d379f73077026e"} Sep 17 17:36:22.471399 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:22.471367 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" event={"ID":"f09ee15a-ac1d-4e00-b466-ece16e649a17","Type":"ContainerStarted","Data":"73a22807e6a6ae0fb4c0374ba02b09eac3f183dcdea254cf670cba3255089f3f"} Sep 17 17:36:22.499274 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:22.499232 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-5hs5d" podStartSLOduration=2.028798301 podStartE2EDuration="3.499217984s" totalImagesPullingTime="1.470419683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:22.498460423 +0000 UTC m=+128.975470595" watchObservedRunningTime="2026-09-17 17:36:22.499217984 +0000 UTC m=+128.976228211" Sep 17 17:36:22.936703 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:22.936676 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:22.936825 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:22.936723 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:22.936991 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:22.936979 2577 scope.go:117] "RemoveContainer" containerID="fddc56fdbbdb28f34ee967ac9a8250d24270dabdee632d478c2c9638c1c4a205" Sep 17 17:36:22.937127 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:22.937110 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-ldhm4_openshift-console-operator(e6f99fb0-c136-483a-87c2-7dd429102383)\"" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" podUID="e6f99fb0-c136-483a-87c2-7dd429102383" Sep 17 17:36:23.478150 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:23.478115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:23.478619 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:23.478220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:23.478619 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:23.478237 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 17:36:23.478619 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:23.478314 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:31.478294566 +0000 UTC m=+137.955304718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : configmap "kube-rbac-proxy" not found Sep 17 17:36:23.478619 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:23.478336 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:36:23.478619 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:23.478396 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:31.478372389 +0000 UTC m=+137.955382552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : secret "insights-runtime-extractor-tls" not found Sep 17 17:36:25.593549 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:25.593511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:36:25.593999 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:25.593646 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 17:36:25.593999 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:25.593720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs podName:c108c40b-fe8d-4a81-b08b-c926b0c103ed nodeName:}" failed. No retries permitted until 2026-09-17 17:38:27.593703332 +0000 UTC m=+254.070713494 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs") pod "network-metrics-daemon-z6vms" (UID: "c108c40b-fe8d-4a81-b08b-c926b0c103ed") : secret "metrics-daemon-secret" not found Sep 17 17:36:31.541393 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:31.541350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:31.541860 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:31.541481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:31.541860 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:31.541648 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 17:36:31.541860 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:31.541741 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls podName:25add384-5378-4300-be2c-220c3e7c587e nodeName:}" failed. No retries permitted until 2026-09-17 17:36:47.541723606 +0000 UTC m=+154.018733771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8xww" (UID: "25add384-5378-4300-be2c-220c3e7c587e") : secret "insights-runtime-extractor-tls" not found Sep 17 17:36:31.542026 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:31.541942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25add384-5378-4300-be2c-220c3e7c587e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:37.924975 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:37.924942 2577 scope.go:117] "RemoveContainer" containerID="fddc56fdbbdb28f34ee967ac9a8250d24270dabdee632d478c2c9638c1c4a205" Sep 17 17:36:38.523721 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:38.523692 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:36:38.524187 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:38.524170 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/1.log" Sep 17 17:36:38.524242 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:38.524205 2577 generic.go:356] "Generic (PLEG): container finished" podID="e6f99fb0-c136-483a-87c2-7dd429102383" containerID="d03b20cfd98eadc9012582727f5303ecba1ee9fb436a99264d2c877e940e007c" exitCode=255 Sep 17 17:36:38.524302 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:38.524285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" event={"ID":"e6f99fb0-c136-483a-87c2-7dd429102383","Type":"ContainerDied","Data":"d03b20cfd98eadc9012582727f5303ecba1ee9fb436a99264d2c877e940e007c"} Sep 17 17:36:38.524354 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:38.524342 2577 scope.go:117] "RemoveContainer" containerID="fddc56fdbbdb28f34ee967ac9a8250d24270dabdee632d478c2c9638c1c4a205" Sep 17 17:36:38.524654 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:38.524633 2577 scope.go:117] "RemoveContainer" containerID="d03b20cfd98eadc9012582727f5303ecba1ee9fb436a99264d2c877e940e007c" Sep 17 17:36:38.524864 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:38.524841 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-ldhm4_openshift-console-operator(e6f99fb0-c136-483a-87c2-7dd429102383)\"" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" podUID="e6f99fb0-c136-483a-87c2-7dd429102383" Sep 17 17:36:39.529490 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:39.529459 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:36:42.936883 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:42.936848 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:42.937298 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:42.936906 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:36:42.937298 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:42.937181 2577 scope.go:117] "RemoveContainer" containerID="d03b20cfd98eadc9012582727f5303ecba1ee9fb436a99264d2c877e940e007c" Sep 17 17:36:42.937378 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:42.937336 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-ldhm4_openshift-console-operator(e6f99fb0-c136-483a-87c2-7dd429102383)\"" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" podUID="e6f99fb0-c136-483a-87c2-7dd429102383" Sep 17 17:36:47.280439 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.280401 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc"] Sep 17 17:36:47.283773 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.283752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" Sep 17 17:36:47.287017 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.286999 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cc27h\"" Sep 17 17:36:47.287164 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.287138 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 17:36:47.331692 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.331669 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc"] Sep 17 17:36:47.456782 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.456759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a7570ba-853a-45e0-adce-332fddd548b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-h7rtc\" (UID: \"2a7570ba-853a-45e0-adce-332fddd548b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" Sep 17 17:36:47.557636 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.557583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a7570ba-853a-45e0-adce-332fddd548b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-h7rtc\" (UID: \"2a7570ba-853a-45e0-adce-332fddd548b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" Sep 17 17:36:47.557730 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.557676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:47.559835 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.559811 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25add384-5378-4300-be2c-220c3e7c587e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8xww\" (UID: \"25add384-5378-4300-be2c-220c3e7c587e\") " pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:47.559960 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.559942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a7570ba-853a-45e0-adce-332fddd548b0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-h7rtc\" (UID: \"2a7570ba-853a-45e0-adce-332fddd548b0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" Sep 17 17:36:47.592904 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.592882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" Sep 17 17:36:47.725330 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.725301 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtzf6\"" Sep 17 17:36:47.733126 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.733103 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8xww" Sep 17 17:36:47.861244 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:47.861188 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc"] Sep 17 17:36:47.863836 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:47.863812 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7570ba_853a_45e0_adce_332fddd548b0.slice/crio-281058af8218cca055fd243965f9be5597242e5440f7d3f0aa572600ca2e3dd4 WatchSource:0}: Error finding container 281058af8218cca055fd243965f9be5597242e5440f7d3f0aa572600ca2e3dd4: Status 404 returned error can't find the container with id 281058af8218cca055fd243965f9be5597242e5440f7d3f0aa572600ca2e3dd4 Sep 17 17:36:48.007768 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:48.007744 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8xww"] Sep 17 17:36:48.011347 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:48.011327 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25add384_5378_4300_be2c_220c3e7c587e.slice/crio-5e49411759b4084efe2f8ebb8661ad7fda3698cc46ee3f324092dd5a1cd00dda WatchSource:0}: Error finding container 5e49411759b4084efe2f8ebb8661ad7fda3698cc46ee3f324092dd5a1cd00dda: Status 404 returned error can't find the container with id 5e49411759b4084efe2f8ebb8661ad7fda3698cc46ee3f324092dd5a1cd00dda Sep 17 17:36:48.558979 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:48.558936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8xww" event={"ID":"25add384-5378-4300-be2c-220c3e7c587e","Type":"ContainerStarted","Data":"f1cd61b70fcfacce8e518ceda5ec10d2319166137a7b4814896601750696ba44"} Sep 17 17:36:48.559413 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:48.559016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8xww" event={"ID":"25add384-5378-4300-be2c-220c3e7c587e","Type":"ContainerStarted","Data":"5e49411759b4084efe2f8ebb8661ad7fda3698cc46ee3f324092dd5a1cd00dda"} Sep 17 17:36:48.560984 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:48.560956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" event={"ID":"2a7570ba-853a-45e0-adce-332fddd548b0","Type":"ContainerStarted","Data":"281058af8218cca055fd243965f9be5597242e5440f7d3f0aa572600ca2e3dd4"} Sep 17 17:36:49.566470 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:49.566435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" event={"ID":"2a7570ba-853a-45e0-adce-332fddd548b0","Type":"ContainerStarted","Data":"624b1275a8e7a1b17608da4f23a81dae24400ae1d6369621adeba904edf4e690"} Sep 17 17:36:49.566921 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:49.566528 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" Sep 17 17:36:49.568353 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:49.568324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8xww" event={"ID":"25add384-5378-4300-be2c-220c3e7c587e","Type":"ContainerStarted","Data":"2a04ddbb1079bc51ede65f3f99c0675a8fc5e0ab8fc71ad69db087b5ca92bce6"} Sep 17 17:36:49.571315 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:49.571295 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" Sep 17 17:36:49.585624 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:49.585571 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-h7rtc" podStartSLOduration=1.460241954 podStartE2EDuration="2.585554445s" totalImagesPullingTime="1.125312491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:49.58552271 +0000 UTC m=+156.062532882" watchObservedRunningTime="2026-09-17 17:36:49.585554445 +0000 UTC m=+156.062564618" Sep 17 17:36:50.573796 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:50.573757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8xww" event={"ID":"25add384-5378-4300-be2c-220c3e7c587e","Type":"ContainerStarted","Data":"1153eeab0f23fa96eca98b1badd1a8f28e5e8d75e11b8bd767e52e41f58c6090"} Sep 17 17:36:50.597057 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:50.597013 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h8xww" podStartSLOduration=33.610307766 podStartE2EDuration="35.596998849s" totalImagesPullingTime="1.986691083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:36:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:50.595314034 +0000 UTC m=+157.072324207" watchObservedRunningTime="2026-09-17 17:36:50.596998849 +0000 UTC m=+157.074009019" Sep 17 17:36:52.250125 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:52.250080 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" podUID="b82e04cb-2d54-4210-b4c4-7edf5a430023" Sep 17 17:36:52.322570 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:52.322529 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kldhv" podUID="986d10f3-a483-409b-a4d0-436721350a4e" Sep 17 17:36:53.953298 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:53.953250 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z6vms" podUID="c108c40b-fe8d-4a81-b08b-c926b0c103ed" Sep 17 17:36:54.731648 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.728476 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-sfsg4"] Sep 17 17:36:54.733317 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.733193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:54.736963 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.736941 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 17:36:54.736963 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.736970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 17:36:54.737316 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.737296 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7448d\"" Sep 17 17:36:54.737437 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.737318 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 17:36:54.737437 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.737356 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 17:36:54.737437 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.737303 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 17:36:54.737597 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.737465 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 17:36:54.740070 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.739871 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-95nrb"] Sep 17 17:36:54.741923 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.741894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.744438 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.744413 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 17:36:54.744542 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.744418 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 17:36:54.744649 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.744629 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4zqpp\"" Sep 17 17:36:54.745061 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.745044 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 17:36:54.746001 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.745979 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-sfsg4"] Sep 17 17:36:54.910712 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.910691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-root\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.910895 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.910868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:54.910993 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.910903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2k8\" (UniqueName: \"kubernetes.io/projected/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-api-access-hh2k8\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:54.910993 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.910927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-sys\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.910993 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.910950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.910993 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.910979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9pqt\" (UniqueName: \"kubernetes.io/projected/d7927077-3a58-4b08-b77d-7be9d56371fa-kube-api-access-p9pqt\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.911191 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-tls\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.911191 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7927077-3a58-4b08-b77d-7be9d56371fa-metrics-client-ca\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.911191 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-textfile\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.911191 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.911354 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:54.911354 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:54.911354 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-wtmp\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:54.911501 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:54.911501 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.911433 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:54.924204 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:54.924186 2577 scope.go:117] "RemoveContainer" containerID="d03b20cfd98eadc9012582727f5303ecba1ee9fb436a99264d2c877e940e007c" Sep 17 17:36:54.924373 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:36:54.924352 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-ldhm4_openshift-console-operator(e6f99fb0-c136-483a-87c2-7dd429102383)\"" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" podUID="e6f99fb0-c136-483a-87c2-7dd429102383" Sep 17 17:36:55.011941 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.011883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.011941 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.011926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.011951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-wtmp\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012088 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-wtmp\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-root\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2k8\" (UniqueName: \"kubernetes.io/projected/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-api-access-hh2k8\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-sys\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012235 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-root\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9pqt\" (UniqueName: \"kubernetes.io/projected/d7927077-3a58-4b08-b77d-7be9d56371fa-kube-api-access-p9pqt\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-tls\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7927077-3a58-4b08-b77d-7be9d56371fa-metrics-client-ca\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-textfile\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.012425 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.013204 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012645 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.013204 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.013204 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012945 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.013204 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.012980 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7927077-3a58-4b08-b77d-7be9d56371fa-sys\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.013204 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.013024 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-accelerators-collector-config\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.013204 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.013193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-textfile\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.013495 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.013262 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7927077-3a58-4b08-b77d-7be9d56371fa-metrics-client-ca\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.014530 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.014501 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.014834 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.014806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.015208 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.015185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7927077-3a58-4b08-b77d-7be9d56371fa-node-exporter-tls\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.016099 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.016076 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.023155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.023130 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9pqt\" (UniqueName: \"kubernetes.io/projected/d7927077-3a58-4b08-b77d-7be9d56371fa-kube-api-access-p9pqt\") pod \"node-exporter-95nrb\" (UID: \"d7927077-3a58-4b08-b77d-7be9d56371fa\") " pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.023737 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.023713 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2k8\" (UniqueName: \"kubernetes.io/projected/f93ebcf9-9f90-43de-afd0-58d71bf3fcff-kube-api-access-hh2k8\") pod \"kube-state-metrics-84c885658c-sfsg4\" (UID: \"f93ebcf9-9f90-43de-afd0-58d71bf3fcff\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.042524 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.042507 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" Sep 17 17:36:55.051338 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.051311 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-95nrb" Sep 17 17:36:55.061410 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:55.061385 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7927077_3a58_4b08_b77d_7be9d56371fa.slice/crio-c24de3cff93eed0ef7fd88034f77d6405ab8f362fee8b31ef4f5c89db8dedfd9 WatchSource:0}: Error finding container c24de3cff93eed0ef7fd88034f77d6405ab8f362fee8b31ef4f5c89db8dedfd9: Status 404 returned error can't find the container with id c24de3cff93eed0ef7fd88034f77d6405ab8f362fee8b31ef4f5c89db8dedfd9 Sep 17 17:36:55.319457 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.319393 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-sfsg4"] Sep 17 17:36:55.322077 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:55.322048 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93ebcf9_9f90_43de_afd0_58d71bf3fcff.slice/crio-ba72b09b1a6692815f8eaec2e71cc8d439c8738d84686e33fd056be01b158d4d WatchSource:0}: Error finding container ba72b09b1a6692815f8eaec2e71cc8d439c8738d84686e33fd056be01b158d4d: Status 404 returned error can't find the container with id ba72b09b1a6692815f8eaec2e71cc8d439c8738d84686e33fd056be01b158d4d Sep 17 17:36:55.592515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.592449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" event={"ID":"f93ebcf9-9f90-43de-afd0-58d71bf3fcff","Type":"ContainerStarted","Data":"ba72b09b1a6692815f8eaec2e71cc8d439c8738d84686e33fd056be01b158d4d"} Sep 17 17:36:55.593763 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:55.593736 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nrb" event={"ID":"d7927077-3a58-4b08-b77d-7be9d56371fa","Type":"ContainerStarted","Data":"c24de3cff93eed0ef7fd88034f77d6405ab8f362fee8b31ef4f5c89db8dedfd9"} Sep 17 17:36:56.600209 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.600175 2577 generic.go:356] "Generic (PLEG): container finished" podID="d7927077-3a58-4b08-b77d-7be9d56371fa" containerID="e30e464a6576c41040a329baa6ad320a5ac8a42592f9fa7cd71a8ea1fb0be9c8" exitCode=0 Sep 17 17:36:56.600652 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.600263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nrb" event={"ID":"d7927077-3a58-4b08-b77d-7be9d56371fa","Type":"ContainerDied","Data":"e30e464a6576c41040a329baa6ad320a5ac8a42592f9fa7cd71a8ea1fb0be9c8"} Sep 17 17:36:56.873601 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.873501 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7488fb469c-dcvrl"] Sep 17 17:36:56.878832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.878805 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.881810 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.881781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 17:36:56.881929 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.881838 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 17:36:56.881929 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.881890 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d8vrx\"" Sep 17 17:36:56.882061 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.881983 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dlt1e53lk9b77\"" Sep 17 17:36:56.882169 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.882146 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 17:36:56.882292 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.882274 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 17:36:56.882734 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.882716 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 17:36:56.896621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.896596 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7488fb469c-dcvrl"] Sep 17 17:36:56.928392 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.928496 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.928496 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.928623 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-grpc-tls\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.928623 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-tls\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.928758 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.928758 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr5sl\" (UniqueName: \"kubernetes.io/projected/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-kube-api-access-vr5sl\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:56.928758 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:56.928720 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-metrics-client-ca\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.029551 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-grpc-tls\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.029551 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029531 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-tls\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.029788 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029577 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.029788 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr5sl\" (UniqueName: \"kubernetes.io/projected/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-kube-api-access-vr5sl\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.029788 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-metrics-client-ca\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.029788 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.029788 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.030042 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.029794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.030637 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.030564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-metrics-client-ca\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.032769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.032741 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.032769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.032760 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-tls\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.032913 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.032860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.033010 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.032990 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.033076 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.033048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-grpc-tls\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.033738 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.033719 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.041380 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.041343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr5sl\" (UniqueName: \"kubernetes.io/projected/5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd-kube-api-access-vr5sl\") pod \"thanos-querier-7488fb469c-dcvrl\" (UID: \"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd\") " pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.130446 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.130424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:36:57.132527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.132498 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"image-registry-5565f8cb57-wr62p\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:36:57.189303 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.189267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:36:57.231591 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.231159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:36:57.236101 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.236071 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/986d10f3-a483-409b-a4d0-436721350a4e-metrics-tls\") pod \"dns-default-kldhv\" (UID: \"986d10f3-a483-409b-a4d0-436721350a4e\") " pod="openshift-dns/dns-default-kldhv" Sep 17 17:36:57.483234 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.483203 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7488fb469c-dcvrl"] Sep 17 17:36:57.486867 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:57.486841 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3d6e93_68b2_4e48_911d_2c2eaa6b12cd.slice/crio-ca26309e8eaa762e3ef82ec6ec29fcbd847acddf356db79cdb81e712bef7399c WatchSource:0}: Error finding container ca26309e8eaa762e3ef82ec6ec29fcbd847acddf356db79cdb81e712bef7399c: Status 404 returned error can't find the container with id ca26309e8eaa762e3ef82ec6ec29fcbd847acddf356db79cdb81e712bef7399c Sep 17 17:36:57.606076 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.606033 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" event={"ID":"f93ebcf9-9f90-43de-afd0-58d71bf3fcff","Type":"ContainerStarted","Data":"f8add1342163d450c824b54388f4d57c89b2a08c9b5e7f8d227e6f35af5afa06"} Sep 17 17:36:57.606504 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.606090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" event={"ID":"f93ebcf9-9f90-43de-afd0-58d71bf3fcff","Type":"ContainerStarted","Data":"6a8733444a3b785aab0be67d26120cc962d780fb5cc4d4e0036f59d249966684"} Sep 17 17:36:57.606504 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.606116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" event={"ID":"f93ebcf9-9f90-43de-afd0-58d71bf3fcff","Type":"ContainerStarted","Data":"73fc9ab03416ae9d3e5d95538c982674bc7ccdfbc6eeebfb6daab59d814e5098"} Sep 17 17:36:57.607279 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.607251 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" event={"ID":"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd","Type":"ContainerStarted","Data":"ca26309e8eaa762e3ef82ec6ec29fcbd847acddf356db79cdb81e712bef7399c"} Sep 17 17:36:57.609324 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.609303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nrb" event={"ID":"d7927077-3a58-4b08-b77d-7be9d56371fa","Type":"ContainerStarted","Data":"f23d65456a8231611ab46bdc0ea8fe72ec64c5b78ec7e06d136c50de477bc92d"} Sep 17 17:36:57.609440 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.609339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-95nrb" event={"ID":"d7927077-3a58-4b08-b77d-7be9d56371fa","Type":"ContainerStarted","Data":"253416268e245cca6f722a8c632ab9a0364eea39898b22231f19a56834416682"} Sep 17 17:36:57.691560 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.691513 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-95nrb" podStartSLOduration=2.652110523 podStartE2EDuration="3.691496356s" totalImagesPullingTime="979.347779ms" totalInitContainerRuntime="60.038054ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:57.690883168 +0000 UTC m=+164.167893339" watchObservedRunningTime="2026-09-17 17:36:57.691496356 +0000 UTC m=+164.168506526" Sep 17 17:36:57.691891 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:57.691864 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-sfsg4" podStartSLOduration=1.914109892 podStartE2EDuration="3.691857657s" totalImagesPullingTime="1.777747765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:57.64786944 +0000 UTC m=+164.124879611" watchObservedRunningTime="2026-09-17 17:36:57.691857657 +0000 UTC m=+164.168867838" Sep 17 17:36:59.016074 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.016041 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5986d59d8c-dslb6"] Sep 17 17:36:59.019390 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.019365 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.023579 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.023387 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 17:36:59.023579 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.023414 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 17:36:59.023579 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.023436 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 17:36:59.023579 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.023387 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 17:36:59.023876 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.023729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-glskb\"" Sep 17 17:36:59.023929 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.023895 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6mpph73r33bf4\"" Sep 17 17:36:59.030787 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.030758 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5986d59d8c-dslb6"] Sep 17 17:36:59.043294 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.043270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aba535e9-5098-4537-bd01-16591260b5e8-metrics-server-audit-profiles\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.043418 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.043309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba535e9-5098-4537-bd01-16591260b5e8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.043418 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.043330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aba535e9-5098-4537-bd01-16591260b5e8-audit-log\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.043418 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.043405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-client-ca-bundle\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.043591 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.043449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-secret-metrics-server-tls\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.043591 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.043476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-secret-metrics-server-client-certs\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.043591 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.043541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlcnk\" (UniqueName: \"kubernetes.io/projected/aba535e9-5098-4537-bd01-16591260b5e8-kube-api-access-jlcnk\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.144280 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144243 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-secret-metrics-server-client-certs\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.144465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlcnk\" (UniqueName: \"kubernetes.io/projected/aba535e9-5098-4537-bd01-16591260b5e8-kube-api-access-jlcnk\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.144465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aba535e9-5098-4537-bd01-16591260b5e8-metrics-server-audit-profiles\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.144465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144402 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba535e9-5098-4537-bd01-16591260b5e8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.144465 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aba535e9-5098-4537-bd01-16591260b5e8-audit-log\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.144724 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-client-ca-bundle\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.144724 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-secret-metrics-server-tls\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.145352 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.144902 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aba535e9-5098-4537-bd01-16591260b5e8-audit-log\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.145352 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.145344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba535e9-5098-4537-bd01-16591260b5e8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.145607 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.145558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aba535e9-5098-4537-bd01-16591260b5e8-metrics-server-audit-profiles\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.147203 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.147181 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-secret-metrics-server-tls\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.147320 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.147195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-secret-metrics-server-client-certs\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.147811 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.147791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aba535e9-5098-4537-bd01-16591260b5e8-client-ca-bundle\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.154917 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.154889 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlcnk\" (UniqueName: \"kubernetes.io/projected/aba535e9-5098-4537-bd01-16591260b5e8-kube-api-access-jlcnk\") pod \"metrics-server-5986d59d8c-dslb6\" (UID: \"aba535e9-5098-4537-bd01-16591260b5e8\") " pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.330772 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.330691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:36:59.618967 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.618923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" event={"ID":"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd","Type":"ContainerStarted","Data":"9bc4f7210142fa2256fe2b0b64306d9e8cdd5168c89c476edf1485a103430b06"} Sep 17 17:36:59.717876 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:36:59.717851 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5986d59d8c-dslb6"] Sep 17 17:36:59.720061 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:36:59.720034 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba535e9_5098_4537_bd01_16591260b5e8.slice/crio-b47fe9ddee303f03a123d9da09c05869adeeda76b8b5c721434a01978627f9de WatchSource:0}: Error finding container b47fe9ddee303f03a123d9da09c05869adeeda76b8b5c721434a01978627f9de: Status 404 returned error can't find the container with id b47fe9ddee303f03a123d9da09c05869adeeda76b8b5c721434a01978627f9de Sep 17 17:37:00.626054 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:00.626008 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" event={"ID":"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd","Type":"ContainerStarted","Data":"0649d48ca71ecca848af3043de2552bf301c6cc3f1e3cbbab69f2b1efd55c857"} Sep 17 17:37:00.626610 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:00.626082 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" event={"ID":"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd","Type":"ContainerStarted","Data":"16870e6262e09d6683db6e6e6965f71d29300634691c69218faa998e361f6c76"} Sep 17 17:37:00.627677 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:00.627637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" event={"ID":"aba535e9-5098-4537-bd01-16591260b5e8","Type":"ContainerStarted","Data":"b47fe9ddee303f03a123d9da09c05869adeeda76b8b5c721434a01978627f9de"} Sep 17 17:37:01.070862 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.070829 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:37:01.075287 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.075258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.079035 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.079008 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f8hg34b6g6ch3\"" Sep 17 17:37:01.079170 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.079063 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 17:37:01.080115 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.079954 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 17:37:01.080115 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.080110 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 17:37:01.080297 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.080167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 17:37:01.080297 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.080189 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 17:37:01.080297 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.080281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 17:37:01.080434 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.080348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 17:37:01.080631 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.080607 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 17:37:01.081819 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.081542 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 17:37:01.081819 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.081640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8j7tf\"" Sep 17 17:37:01.081819 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.081655 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 17:37:01.081819 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.081711 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 17:37:01.081819 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.081813 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 17:37:01.082146 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.081877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 17:37:01.083025 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.082881 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 17:37:01.100143 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.100123 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:37:01.160145 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160246 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160246 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160246 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160414 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160414 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160414 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160414 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160414 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160522 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kwjn\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-kube-api-access-6kwjn\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160970 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160970 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.160970 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.160798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262025 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.261993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262025 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262236 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262236 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262236 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262236 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262236 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262236 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262532 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kwjn\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-kube-api-access-6kwjn\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262901 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262901 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262901 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262901 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.262901 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.263081 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.262916 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.263245 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.263222 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.263308 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.263258 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.263600 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.263574 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.264761 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.264731 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.265562 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.265308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.265562 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.265388 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.266745 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.266264 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.266745 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.266652 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.266745 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.266703 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.267765 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.267715 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.267952 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.267903 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.268271 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.268235 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.268389 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.268363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.268732 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.268711 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.269608 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.269589 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.269841 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.269819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.270078 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.270062 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.270249 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.270231 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.273918 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.273898 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kwjn\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-kube-api-access-6kwjn\") pod \"prometheus-k8s-0\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.388125 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.388074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:01.635022 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.634985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" event={"ID":"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd","Type":"ContainerStarted","Data":"0e123d4a1e75de2703d1c14470d7d97b1490a8131880914f9ed12256e6e8acc5"} Sep 17 17:37:01.635450 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.635086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" event={"ID":"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd","Type":"ContainerStarted","Data":"dbbfc37c3d5f28b9a5c985c97ed55d4aa439474b51d1c386d48cec4c0deba57d"} Sep 17 17:37:01.635450 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.635116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" event={"ID":"5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd","Type":"ContainerStarted","Data":"12e68ce853237dd85e4de80130ae9d892855818b4861fc6555ad63c7f30c1044"} Sep 17 17:37:01.635450 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.635156 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:37:01.636559 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.636527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" event={"ID":"aba535e9-5098-4537-bd01-16591260b5e8","Type":"ContainerStarted","Data":"ba67db6a2bfe6e92735aaf8621709a8ee45cfee8404e82821811bdfc728f9830"} Sep 17 17:37:01.662419 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.662339 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" podStartSLOduration=2.628826488 podStartE2EDuration="5.66232344s" totalImagesPullingTime="3.033496952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:01.660618485 +0000 UTC m=+168.137628674" watchObservedRunningTime="2026-09-17 17:37:01.66232344 +0000 UTC m=+168.139333612" Sep 17 17:37:01.677304 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.677281 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:37:01.680407 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:37:01.680378 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae49653_34e9_417b_b7b3_c8f71142f3ad.slice/crio-058d31338ac9fd821c08b7ef30fc5c8191c66d2223415a60b478352534219b28 WatchSource:0}: Error finding container 058d31338ac9fd821c08b7ef30fc5c8191c66d2223415a60b478352534219b28: Status 404 returned error can't find the container with id 058d31338ac9fd821c08b7ef30fc5c8191c66d2223415a60b478352534219b28 Sep 17 17:37:01.681934 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:01.681898 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" podStartSLOduration=2.251925339 podStartE2EDuration="3.681884116s" totalImagesPullingTime="1.429958777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:01.6802223 +0000 UTC m=+168.157232472" watchObservedRunningTime="2026-09-17 17:37:01.681884116 +0000 UTC m=+168.158894333" Sep 17 17:37:02.642054 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:02.642017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerStarted","Data":"058d31338ac9fd821c08b7ef30fc5c8191c66d2223415a60b478352534219b28"} Sep 17 17:37:03.647432 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:03.647397 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" exitCode=0 Sep 17 17:37:03.647975 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:03.647488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b"} Sep 17 17:37:03.924569 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:03.924532 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kldhv" Sep 17 17:37:03.927577 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:03.927557 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gbrs5\"" Sep 17 17:37:03.935784 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:03.935766 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kldhv" Sep 17 17:37:04.213725 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:04.213296 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kldhv"] Sep 17 17:37:04.216129 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:37:04.216096 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986d10f3_a483_409b_a4d0_436721350a4e.slice/crio-434593fbc7262d133557999ac0a02dde68ec6086ab25ecdbd918ca7a9cbf3905 WatchSource:0}: Error finding container 434593fbc7262d133557999ac0a02dde68ec6086ab25ecdbd918ca7a9cbf3905: Status 404 returned error can't find the container with id 434593fbc7262d133557999ac0a02dde68ec6086ab25ecdbd918ca7a9cbf3905 Sep 17 17:37:04.652371 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:04.652298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kldhv" event={"ID":"986d10f3-a483-409b-a4d0-436721350a4e","Type":"ContainerStarted","Data":"434593fbc7262d133557999ac0a02dde68ec6086ab25ecdbd918ca7a9cbf3905"} Sep 17 17:37:07.650133 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.650111 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7488fb469c-dcvrl" Sep 17 17:37:07.668521 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.668497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerStarted","Data":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} Sep 17 17:37:07.668619 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.668572 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerStarted","Data":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} Sep 17 17:37:07.668619 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.668611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerStarted","Data":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} Sep 17 17:37:07.668804 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.668651 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerStarted","Data":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} Sep 17 17:37:07.670400 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.670377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kldhv" event={"ID":"986d10f3-a483-409b-a4d0-436721350a4e","Type":"ContainerStarted","Data":"e0be0e906e5ffea5a894d16ce1ca0b9bdb7a9bd9e8ddadf1a64204755e11294b"} Sep 17 17:37:07.670508 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.670421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kldhv" event={"ID":"986d10f3-a483-409b-a4d0-436721350a4e","Type":"ContainerStarted","Data":"c47b6ec5c55dfafaaeadac8cb6d375e4e7d4cf508452afbdd2aaea51c4fe76fd"} Sep 17 17:37:07.670508 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.670497 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kldhv" Sep 17 17:37:07.716627 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.716505 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kldhv" podStartSLOduration=135.631410604 podStartE2EDuration="2m18.716489607s" totalImagesPullingTime="3.085079003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:07.71418701 +0000 UTC m=+174.191197182" watchObservedRunningTime="2026-09-17 17:37:07.716489607 +0000 UTC m=+174.193499794" Sep 17 17:37:07.924409 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.924376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:37:07.924824 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.924807 2577 scope.go:117] "RemoveContainer" containerID="d03b20cfd98eadc9012582727f5303ecba1ee9fb436a99264d2c877e940e007c" Sep 17 17:37:07.927763 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.927488 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mzr6j\"" Sep 17 17:37:07.935050 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:07.935029 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:37:08.231618 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.231534 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5565f8cb57-wr62p"] Sep 17 17:37:08.234158 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:37:08.234129 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82e04cb_2d54_4210_b4c4_7edf5a430023.slice/crio-382059d0ac938928c5926e082dd3f89ddbc30324c933ee2b0663c950f6b5b006 WatchSource:0}: Error finding container 382059d0ac938928c5926e082dd3f89ddbc30324c933ee2b0663c950f6b5b006: Status 404 returned error can't find the container with id 382059d0ac938928c5926e082dd3f89ddbc30324c933ee2b0663c950f6b5b006 Sep 17 17:37:08.676915 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.676890 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:37:08.677278 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.676995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" event={"ID":"e6f99fb0-c136-483a-87c2-7dd429102383","Type":"ContainerStarted","Data":"63e43cd43f9624720257abe4d030c5216932d99d819921c91a8b675f9c231594"} Sep 17 17:37:08.682572 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.677881 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:37:08.686490 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.686466 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" Sep 17 17:37:08.686712 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.686683 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerStarted","Data":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} Sep 17 17:37:08.686833 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.686748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerStarted","Data":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} Sep 17 17:37:08.688183 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.688160 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" event={"ID":"b82e04cb-2d54-4210-b4c4-7edf5a430023","Type":"ContainerStarted","Data":"90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46"} Sep 17 17:37:08.688272 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.688195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" event={"ID":"b82e04cb-2d54-4210-b4c4-7edf5a430023","Type":"ContainerStarted","Data":"382059d0ac938928c5926e082dd3f89ddbc30324c933ee2b0663c950f6b5b006"} Sep 17 17:37:08.688348 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.688271 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:37:08.701334 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.701275 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-ldhm4" podStartSLOduration=54.280310133 podStartE2EDuration="56.701262183s" totalImagesPullingTime="2.42095205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:08.69928834 +0000 UTC m=+175.176298511" watchObservedRunningTime="2026-09-17 17:37:08.701262183 +0000 UTC m=+175.178272368" Sep 17 17:37:08.792654 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.792602 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7437913099999998 podStartE2EDuration="7.79258567s" totalImagesPullingTime="5.029910068s" totalInitContainerRuntime="18.884292ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:08.759297606 +0000 UTC m=+175.236307776" watchObservedRunningTime="2026-09-17 17:37:08.79258567 +0000 UTC m=+175.269595843" Sep 17 17:37:08.792954 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.792931 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" podStartSLOduration=172.792923739 podStartE2EDuration="2m52.792923739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:08.792354715 +0000 UTC m=+175.269364885" watchObservedRunningTime="2026-09-17 17:37:08.792923739 +0000 UTC m=+175.269933910" Sep 17 17:37:08.924138 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:08.924104 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:37:11.389068 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:11.389030 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:37:17.691003 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:17.690972 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kldhv" Sep 17 17:37:17.726086 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:17.726052 2577 generic.go:356] "Generic (PLEG): container finished" podID="30142390-f0d1-4d84-8bd1-ce349e52eca8" containerID="38a8d8354ac7b8690f6f2101435ce9c86a0812bf31ef24c4beafa8f80db64920" exitCode=255 Sep 17 17:37:17.726260 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:17.726101 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" event={"ID":"30142390-f0d1-4d84-8bd1-ce349e52eca8","Type":"ContainerDied","Data":"38a8d8354ac7b8690f6f2101435ce9c86a0812bf31ef24c4beafa8f80db64920"} Sep 17 17:37:17.733946 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:17.733926 2577 scope.go:117] "RemoveContainer" containerID="38a8d8354ac7b8690f6f2101435ce9c86a0812bf31ef24c4beafa8f80db64920" Sep 17 17:37:18.731860 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:18.731829 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f56d8bcdb-jjrvh" event={"ID":"30142390-f0d1-4d84-8bd1-ce349e52eca8","Type":"ContainerStarted","Data":"28f10a2fe35b60db06a7c5b7aca47f942288c608c268c925179093429a0e7e83"} Sep 17 17:37:19.330904 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:19.330869 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:37:19.331075 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:19.330959 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:37:29.697726 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:29.697699 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:37:31.784594 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:31.784547 2577 generic.go:356] "Generic (PLEG): container finished" podID="5b5059fa-e6b0-4123-ac5e-4f135f51dd06" containerID="6191c2b6597c76974a49004b66197d3b098f5024b177278803a985d56a5ffedb" exitCode=0 Sep 17 17:37:31.784594 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:31.784600 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" event={"ID":"5b5059fa-e6b0-4123-ac5e-4f135f51dd06","Type":"ContainerDied","Data":"6191c2b6597c76974a49004b66197d3b098f5024b177278803a985d56a5ffedb"} Sep 17 17:37:31.785080 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:31.784948 2577 scope.go:117] "RemoveContainer" containerID="6191c2b6597c76974a49004b66197d3b098f5024b177278803a985d56a5ffedb" Sep 17 17:37:32.790956 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:32.790926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-2bmct" event={"ID":"5b5059fa-e6b0-4123-ac5e-4f135f51dd06","Type":"ContainerStarted","Data":"3e42d8ecaf31fe67017ad7387bf50a1bf15aad996268b41197df30dae31c80be"} Sep 17 17:37:34.894858 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:34.894826 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5565f8cb57-wr62p"] Sep 17 17:37:39.337188 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:39.337158 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:37:39.340934 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:39.340911 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5986d59d8c-dslb6" Sep 17 17:37:59.913897 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:37:59.913862 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" podUID="b82e04cb-2d54-4210-b4c4-7edf5a430023" containerName="registry" containerID="cri-o://90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46" gracePeriod=30 Sep 17 17:38:00.156395 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.156369 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:38:00.266304 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266238 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-image-registry-private-configuration\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.266304 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266276 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-certificates\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.266511 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266313 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b82e04cb-2d54-4210-b4c4-7edf5a430023-ca-trust-extracted\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.266511 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266335 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.266511 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266358 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2xck\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-kube-api-access-f2xck\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.266511 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266383 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-installation-pull-secrets\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.266511 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266421 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-bound-sa-token\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.266796 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.266636 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-trusted-ca\") pod \"b82e04cb-2d54-4210-b4c4-7edf5a430023\" (UID: \"b82e04cb-2d54-4210-b4c4-7edf5a430023\") " Sep 17 17:38:00.267215 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.267069 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:00.267364 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.267338 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:00.268917 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.268890 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:38:00.269053 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.269029 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:38:00.269140 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.269123 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:00.269218 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.269189 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-kube-api-access-f2xck" (OuterVolumeSpecName: "kube-api-access-f2xck") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "kube-api-access-f2xck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:38:00.269266 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.269211 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:00.275132 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.275110 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82e04cb-2d54-4210-b4c4-7edf5a430023-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b82e04cb-2d54-4210-b4c4-7edf5a430023" (UID: "b82e04cb-2d54-4210-b4c4-7edf5a430023"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:38:00.367612 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367591 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-bound-sa-token\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.367612 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367611 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-trusted-ca\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.367759 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367621 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-image-registry-private-configuration\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.367759 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367630 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-certificates\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.367759 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367639 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b82e04cb-2d54-4210-b4c4-7edf5a430023-ca-trust-extracted\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.367759 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367649 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-registry-tls\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.367759 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367675 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2xck\" (UniqueName: \"kubernetes.io/projected/b82e04cb-2d54-4210-b4c4-7edf5a430023-kube-api-access-f2xck\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.367759 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.367683 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b82e04cb-2d54-4210-b4c4-7edf5a430023-installation-pull-secrets\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:00.908549 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.908515 2577 generic.go:356] "Generic (PLEG): container finished" podID="b82e04cb-2d54-4210-b4c4-7edf5a430023" containerID="90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46" exitCode=0 Sep 17 17:38:00.908735 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.908555 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" Sep 17 17:38:00.908735 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.908561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" event={"ID":"b82e04cb-2d54-4210-b4c4-7edf5a430023","Type":"ContainerDied","Data":"90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46"} Sep 17 17:38:00.908735 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.908612 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5565f8cb57-wr62p" event={"ID":"b82e04cb-2d54-4210-b4c4-7edf5a430023","Type":"ContainerDied","Data":"382059d0ac938928c5926e082dd3f89ddbc30324c933ee2b0663c950f6b5b006"} Sep 17 17:38:00.908735 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.908633 2577 scope.go:117] "RemoveContainer" containerID="90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46" Sep 17 17:38:00.917913 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.917695 2577 scope.go:117] "RemoveContainer" containerID="90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46" Sep 17 17:38:00.918142 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:00.918034 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46\": container with ID starting with 90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46 not found: ID does not exist" containerID="90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46" Sep 17 17:38:00.918142 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.918060 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46"} err="failed to get container status \"90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46\": rpc error: code = NotFound desc = could not find container \"90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46\": container with ID starting with 90983535e6e364675cf3ad55d5b85ec82359e39065a06d091b12fcca8db9be46 not found: ID does not exist" Sep 17 17:38:00.933155 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.933131 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5565f8cb57-wr62p"] Sep 17 17:38:00.939438 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:00.939415 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5565f8cb57-wr62p"] Sep 17 17:38:01.388968 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:01.388934 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:01.408232 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:01.408208 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:01.929623 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:01.929594 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82e04cb-2d54-4210-b4c4-7edf5a430023" path="/var/lib/kubelet/pods/b82e04cb-2d54-4210-b4c4-7edf5a430023/volumes" Sep 17 17:38:01.929992 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:01.929917 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:19.596979 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.596940 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:38:19.597411 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.597293 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="prometheus" containerID="cri-o://baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" gracePeriod=600 Sep 17 17:38:19.597411 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.597330 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="thanos-sidecar" containerID="cri-o://dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" gracePeriod=600 Sep 17 17:38:19.597411 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.597358 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="config-reloader" containerID="cri-o://512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" gracePeriod=600 Sep 17 17:38:19.597411 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.597362 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-thanos" containerID="cri-o://41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" gracePeriod=600 Sep 17 17:38:19.597689 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.597325 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-web" containerID="cri-o://2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" gracePeriod=600 Sep 17 17:38:19.597689 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.597312 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy" containerID="cri-o://d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" gracePeriod=600 Sep 17 17:38:19.836706 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.836685 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:19.918533 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918508 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-thanos-prometheus-http-client-file\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918655 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918543 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-metrics-client-ca\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918655 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918566 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config-out\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918655 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918600 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-2\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918655 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918628 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kwjn\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-kube-api-access-6kwjn\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918655 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918671 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-kube-rbac-proxy\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918700 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-1\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918731 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-metrics-client-certs\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918759 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-trusted-ca-bundle\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918799 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-0\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918825 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918850 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-tls\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918894 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.918937 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918920 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-kubelet-serving-ca-bundle\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918948 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-web-config\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918961 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.918994 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-db\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919004 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919040 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-serving-certs-ca-bundle\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919063 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-grpc-tls\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919087 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-tls-assets\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.919351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919116 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config\") pod \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\" (UID: \"1ae49653-34e9-417b-b7b3-c8f71142f3ad\") " Sep 17 17:38:19.919775 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919394 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-metrics-client-ca\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:19.919775 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919411 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:19.919775 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919688 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:19.919936 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.919835 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:19.921583 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.920477 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:19.921583 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.920621 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:19.921583 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.920984 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:38:19.921873 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.921690 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.922164 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.922119 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config-out" (OuterVolumeSpecName: "config-out") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:38:19.922522 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.922415 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:38:19.922522 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.922493 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.922803 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.922776 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.923352 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.923300 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.924316 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.923960 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.924316 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.923982 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-kube-api-access-6kwjn" (OuterVolumeSpecName: "kube-api-access-6kwjn") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "kube-api-access-6kwjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:38:19.924316 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.924275 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config" (OuterVolumeSpecName: "config") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.924527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.924383 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.924527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.924405 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:38:19.924645 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.924574 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.935777 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.935756 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-web-config" (OuterVolumeSpecName: "web-config") pod "1ae49653-34e9-417b-b7b3-c8f71142f3ad" (UID: "1ae49653-34e9-417b-b7b3-c8f71142f3ad"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:38:19.983384 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983352 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" exitCode=0 Sep 17 17:38:19.983384 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983376 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" exitCode=0 Sep 17 17:38:19.983384 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983382 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" exitCode=0 Sep 17 17:38:19.983384 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983388 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" exitCode=0 Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983394 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" exitCode=0 Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983399 2577 generic.go:356] "Generic (PLEG): container finished" podID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" exitCode=0 Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983430 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983573 2577 scope.go:117] "RemoveContainer" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:19.983621 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} Sep 17 17:38:19.984065 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983647 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} Sep 17 17:38:19.984065 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.983708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ae49653-34e9-417b-b7b3-c8f71142f3ad","Type":"ContainerDied","Data":"058d31338ac9fd821c08b7ef30fc5c8191c66d2223415a60b478352534219b28"} Sep 17 17:38:19.991057 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.991004 2577 scope.go:117] "RemoveContainer" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:19.997562 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:19.997546 2577 scope.go:117] "RemoveContainer" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.004028 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.004012 2577 scope.go:117] "RemoveContainer" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.010485 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.010462 2577 scope.go:117] "RemoveContainer" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.012336 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.012317 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:38:20.017004 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.016989 2577 scope.go:117] "RemoveContainer" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.020078 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020056 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:38:20.020378 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020360 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020469 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020383 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020469 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020398 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-web-config\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020469 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020412 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-db\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020469 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020424 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020469 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020438 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-grpc-tls\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020469 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020451 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-tls-assets\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020469 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020463 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020475 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020488 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ae49653-34e9-417b-b7b3-c8f71142f3ad-config-out\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020501 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kwjn\" (UniqueName: \"kubernetes.io/projected/1ae49653-34e9-417b-b7b3-c8f71142f3ad-kube-api-access-6kwjn\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020515 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-kube-rbac-proxy\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020528 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020544 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-metrics-client-certs\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020559 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020572 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ae49653-34e9-417b-b7b3-c8f71142f3ad-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020602 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.020769 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.020633 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ae49653-34e9-417b-b7b3-c8f71142f3ad-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:38:20.023906 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.023890 2577 scope.go:117] "RemoveContainer" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.030031 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.030014 2577 scope.go:117] "RemoveContainer" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:20.030289 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:20.030271 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": container with ID starting with 41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52 not found: ID does not exist" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:20.030336 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.030299 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} err="failed to get container status \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": rpc error: code = NotFound desc = could not find container \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": container with ID starting with 41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52 not found: ID does not exist" Sep 17 17:38:20.030336 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.030315 2577 scope.go:117] "RemoveContainer" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:20.030554 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:20.030537 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": container with ID starting with d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b not found: ID does not exist" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:20.030610 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.030563 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} err="failed to get container status \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": rpc error: code = NotFound desc = could not find container \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": container with ID starting with d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b not found: ID does not exist" Sep 17 17:38:20.030610 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.030586 2577 scope.go:117] "RemoveContainer" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.030842 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:20.030824 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": container with ID starting with 2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2 not found: ID does not exist" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.030888 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.030846 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} err="failed to get container status \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": rpc error: code = NotFound desc = could not find container \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": container with ID starting with 2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2 not found: ID does not exist" Sep 17 17:38:20.030888 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.030859 2577 scope.go:117] "RemoveContainer" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.031079 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:20.031063 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": container with ID starting with dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236 not found: ID does not exist" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.031140 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031085 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} err="failed to get container status \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": rpc error: code = NotFound desc = could not find container \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": container with ID starting with dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236 not found: ID does not exist" Sep 17 17:38:20.031140 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031106 2577 scope.go:117] "RemoveContainer" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.031332 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:20.031315 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": container with ID starting with 512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f not found: ID does not exist" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.031374 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031337 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} err="failed to get container status \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": rpc error: code = NotFound desc = could not find container \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": container with ID starting with 512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f not found: ID does not exist" Sep 17 17:38:20.031374 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031350 2577 scope.go:117] "RemoveContainer" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.031541 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:20.031523 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": container with ID starting with baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86 not found: ID does not exist" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.031574 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031547 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} err="failed to get container status \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": rpc error: code = NotFound desc = could not find container \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": container with ID starting with baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86 not found: ID does not exist" Sep 17 17:38:20.031574 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031559 2577 scope.go:117] "RemoveContainer" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.031783 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:38:20.031763 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": container with ID starting with 98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b not found: ID does not exist" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.031861 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031784 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b"} err="failed to get container status \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": rpc error: code = NotFound desc = could not find container \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": container with ID starting with 98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b not found: ID does not exist" Sep 17 17:38:20.031861 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.031807 2577 scope.go:117] "RemoveContainer" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:20.032070 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032047 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} err="failed to get container status \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": rpc error: code = NotFound desc = could not find container \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": container with ID starting with 41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52 not found: ID does not exist" Sep 17 17:38:20.032110 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032071 2577 scope.go:117] "RemoveContainer" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:20.032315 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032297 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} err="failed to get container status \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": rpc error: code = NotFound desc = could not find container \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": container with ID starting with d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b not found: ID does not exist" Sep 17 17:38:20.032315 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032315 2577 scope.go:117] "RemoveContainer" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.032502 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032487 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} err="failed to get container status \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": rpc error: code = NotFound desc = could not find container \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": container with ID starting with 2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2 not found: ID does not exist" Sep 17 17:38:20.032546 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032502 2577 scope.go:117] "RemoveContainer" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.032747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032730 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} err="failed to get container status \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": rpc error: code = NotFound desc = could not find container \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": container with ID starting with dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236 not found: ID does not exist" Sep 17 17:38:20.032747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032746 2577 scope.go:117] "RemoveContainer" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.032961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032945 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} err="failed to get container status \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": rpc error: code = NotFound desc = could not find container \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": container with ID starting with 512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f not found: ID does not exist" Sep 17 17:38:20.032961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.032961 2577 scope.go:117] "RemoveContainer" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.033158 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033142 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} err="failed to get container status \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": rpc error: code = NotFound desc = could not find container \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": container with ID starting with baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86 not found: ID does not exist" Sep 17 17:38:20.033199 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033158 2577 scope.go:117] "RemoveContainer" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.033356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033342 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b"} err="failed to get container status \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": rpc error: code = NotFound desc = could not find container \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": container with ID starting with 98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b not found: ID does not exist" Sep 17 17:38:20.033356 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033355 2577 scope.go:117] "RemoveContainer" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:20.033572 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033554 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} err="failed to get container status \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": rpc error: code = NotFound desc = could not find container \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": container with ID starting with 41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52 not found: ID does not exist" Sep 17 17:38:20.033624 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033573 2577 scope.go:117] "RemoveContainer" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:20.033843 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033827 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} err="failed to get container status \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": rpc error: code = NotFound desc = could not find container \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": container with ID starting with d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b not found: ID does not exist" Sep 17 17:38:20.033881 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.033842 2577 scope.go:117] "RemoveContainer" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.034063 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034046 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} err="failed to get container status \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": rpc error: code = NotFound desc = could not find container \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": container with ID starting with 2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2 not found: ID does not exist" Sep 17 17:38:20.034107 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034063 2577 scope.go:117] "RemoveContainer" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.034283 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034264 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} err="failed to get container status \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": rpc error: code = NotFound desc = could not find container \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": container with ID starting with dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236 not found: ID does not exist" Sep 17 17:38:20.034283 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034282 2577 scope.go:117] "RemoveContainer" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.034517 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034500 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} err="failed to get container status \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": rpc error: code = NotFound desc = could not find container \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": container with ID starting with 512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f not found: ID does not exist" Sep 17 17:38:20.034567 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034518 2577 scope.go:117] "RemoveContainer" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.034763 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034745 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} err="failed to get container status \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": rpc error: code = NotFound desc = could not find container \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": container with ID starting with baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86 not found: ID does not exist" Sep 17 17:38:20.034819 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034764 2577 scope.go:117] "RemoveContainer" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.034981 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034966 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b"} err="failed to get container status \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": rpc error: code = NotFound desc = could not find container \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": container with ID starting with 98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b not found: ID does not exist" Sep 17 17:38:20.035020 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.034981 2577 scope.go:117] "RemoveContainer" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:20.035194 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035177 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} err="failed to get container status \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": rpc error: code = NotFound desc = could not find container \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": container with ID starting with 41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52 not found: ID does not exist" Sep 17 17:38:20.035236 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035195 2577 scope.go:117] "RemoveContainer" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:20.035406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035390 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} err="failed to get container status \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": rpc error: code = NotFound desc = could not find container \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": container with ID starting with d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b not found: ID does not exist" Sep 17 17:38:20.035445 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035407 2577 scope.go:117] "RemoveContainer" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.035616 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035599 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} err="failed to get container status \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": rpc error: code = NotFound desc = could not find container \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": container with ID starting with 2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2 not found: ID does not exist" Sep 17 17:38:20.035674 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035618 2577 scope.go:117] "RemoveContainer" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.035851 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035835 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} err="failed to get container status \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": rpc error: code = NotFound desc = could not find container \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": container with ID starting with dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236 not found: ID does not exist" Sep 17 17:38:20.035890 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.035853 2577 scope.go:117] "RemoveContainer" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.036060 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036043 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} err="failed to get container status \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": rpc error: code = NotFound desc = could not find container \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": container with ID starting with 512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f not found: ID does not exist" Sep 17 17:38:20.036101 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036060 2577 scope.go:117] "RemoveContainer" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.036252 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036238 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} err="failed to get container status \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": rpc error: code = NotFound desc = could not find container \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": container with ID starting with baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86 not found: ID does not exist" Sep 17 17:38:20.036287 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036252 2577 scope.go:117] "RemoveContainer" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.036445 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036429 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b"} err="failed to get container status \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": rpc error: code = NotFound desc = could not find container \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": container with ID starting with 98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b not found: ID does not exist" Sep 17 17:38:20.036491 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036445 2577 scope.go:117] "RemoveContainer" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:20.036647 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036631 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} err="failed to get container status \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": rpc error: code = NotFound desc = could not find container \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": container with ID starting with 41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52 not found: ID does not exist" Sep 17 17:38:20.036709 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036647 2577 scope.go:117] "RemoveContainer" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:20.036881 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036865 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} err="failed to get container status \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": rpc error: code = NotFound desc = could not find container \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": container with ID starting with d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b not found: ID does not exist" Sep 17 17:38:20.036933 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.036880 2577 scope.go:117] "RemoveContainer" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.037061 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037043 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} err="failed to get container status \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": rpc error: code = NotFound desc = could not find container \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": container with ID starting with 2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2 not found: ID does not exist" Sep 17 17:38:20.037101 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037062 2577 scope.go:117] "RemoveContainer" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.037260 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037245 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} err="failed to get container status \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": rpc error: code = NotFound desc = could not find container \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": container with ID starting with dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236 not found: ID does not exist" Sep 17 17:38:20.037301 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037259 2577 scope.go:117] "RemoveContainer" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.037461 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037446 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} err="failed to get container status \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": rpc error: code = NotFound desc = could not find container \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": container with ID starting with 512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f not found: ID does not exist" Sep 17 17:38:20.037501 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037460 2577 scope.go:117] "RemoveContainer" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.037687 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037643 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} err="failed to get container status \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": rpc error: code = NotFound desc = could not find container \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": container with ID starting with baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86 not found: ID does not exist" Sep 17 17:38:20.037687 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037679 2577 scope.go:117] "RemoveContainer" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.037907 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037889 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b"} err="failed to get container status \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": rpc error: code = NotFound desc = could not find container \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": container with ID starting with 98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b not found: ID does not exist" Sep 17 17:38:20.037973 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.037908 2577 scope.go:117] "RemoveContainer" containerID="41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52" Sep 17 17:38:20.038125 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038105 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52"} err="failed to get container status \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": rpc error: code = NotFound desc = could not find container \"41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52\": container with ID starting with 41eae5edd868a479882e78ca4c205cd73200a64248a4f8478f4153dc0685bb52 not found: ID does not exist" Sep 17 17:38:20.038167 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038126 2577 scope.go:117] "RemoveContainer" containerID="d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b" Sep 17 17:38:20.038326 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038308 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b"} err="failed to get container status \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": rpc error: code = NotFound desc = could not find container \"d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b\": container with ID starting with d63b8615dbf3a07a3f408c91a89c86c71c93b9b6ef162981168490cece09b90b not found: ID does not exist" Sep 17 17:38:20.038326 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038326 2577 scope.go:117] "RemoveContainer" containerID="2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2" Sep 17 17:38:20.038572 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038556 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2"} err="failed to get container status \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": rpc error: code = NotFound desc = could not find container \"2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2\": container with ID starting with 2dd53741837adbc088bfc7b3a44ee0d45c76f98f2d1fb75da80d9c0f624d3fc2 not found: ID does not exist" Sep 17 17:38:20.038625 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038572 2577 scope.go:117] "RemoveContainer" containerID="dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236" Sep 17 17:38:20.038788 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038773 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236"} err="failed to get container status \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": rpc error: code = NotFound desc = could not find container \"dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236\": container with ID starting with dfa1a425bdcc9ded4b69d8df24b2acc0e86a58dc321746cb315649942087a236 not found: ID does not exist" Sep 17 17:38:20.038836 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.038788 2577 scope.go:117] "RemoveContainer" containerID="512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f" Sep 17 17:38:20.039018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.039003 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f"} err="failed to get container status \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": rpc error: code = NotFound desc = could not find container \"512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f\": container with ID starting with 512a9a0aeeb3ba6c01b110f0d047dea50947c8fbd41be62bbf10c707010eda9f not found: ID does not exist" Sep 17 17:38:20.039018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.039017 2577 scope.go:117] "RemoveContainer" containerID="baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86" Sep 17 17:38:20.039241 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.039221 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86"} err="failed to get container status \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": rpc error: code = NotFound desc = could not find container \"baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86\": container with ID starting with baa998e101fc4bf1a589c41911a1c8910be79298f6bd05ff5837c18517574e86 not found: ID does not exist" Sep 17 17:38:20.039281 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.039242 2577 scope.go:117] "RemoveContainer" containerID="98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b" Sep 17 17:38:20.039451 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.039436 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b"} err="failed to get container status \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": rpc error: code = NotFound desc = could not find container \"98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b\": container with ID starting with 98c26bfca885deb9edcd009582e052efe830958cb0f48727d376f5fb8eb42a3b not found: ID does not exist" Sep 17 17:38:20.056821 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.056796 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:38:20.057050 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057039 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-web" Sep 17 17:38:20.057086 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057052 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-web" Sep 17 17:38:20.057086 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057067 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82e04cb-2d54-4210-b4c4-7edf5a430023" containerName="registry" Sep 17 17:38:20.057086 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057072 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82e04cb-2d54-4210-b4c4-7edf5a430023" containerName="registry" Sep 17 17:38:20.057086 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057080 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy" Sep 17 17:38:20.057086 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057086 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057095 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="init-config-reloader" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057100 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="init-config-reloader" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057106 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="config-reloader" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057111 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="config-reloader" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057119 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="prometheus" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057124 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="prometheus" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057130 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-thanos" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057135 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-thanos" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057145 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="thanos-sidecar" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057149 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="thanos-sidecar" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057191 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-web" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057198 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="prometheus" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057203 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057210 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="thanos-sidecar" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057215 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="kube-rbac-proxy-thanos" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057219 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82e04cb-2d54-4210-b4c4-7edf5a430023" containerName="registry" Sep 17 17:38:20.057237 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.057225 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" containerName="config-reloader" Sep 17 17:38:20.062227 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.062212 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.065160 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 17:38:20.065257 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065158 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8j7tf\"" Sep 17 17:38:20.065257 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065175 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 17:38:20.065257 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f8hg34b6g6ch3\"" Sep 17 17:38:20.065398 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 17:38:20.065519 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065502 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 17:38:20.065573 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065543 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 17:38:20.065573 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065562 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 17:38:20.065687 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065570 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 17:38:20.065939 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065925 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 17:38:20.066003 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065962 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 17:38:20.066003 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.065931 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 17:38:20.066109 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.066016 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 17:38:20.066369 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.066354 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 17:38:20.069581 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.069563 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 17:38:20.072345 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.072325 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 17:38:20.082351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.082334 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:38:20.121162 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121241 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121241 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89899882-f68c-4d53-ab53-577d7b86eaf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121241 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121340 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121340 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121340 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121303 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121340 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121458 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121458 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121458 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-config\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121458 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121569 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121569 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121569 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121569 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89899882-f68c-4d53-ab53-577d7b86eaf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121752 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121752 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqfz\" (UniqueName: \"kubernetes.io/projected/89899882-f68c-4d53-ab53-577d7b86eaf1-kube-api-access-2bqfz\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121752 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.121752 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.121633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222400 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222400 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222400 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-config\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222491 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89899882-f68c-4d53-ab53-577d7b86eaf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqfz\" (UniqueName: \"kubernetes.io/projected/89899882-f68c-4d53-ab53-577d7b86eaf1-kube-api-access-2bqfz\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222782 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89899882-f68c-4d53-ab53-577d7b86eaf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222854 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.222961 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.222915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.223479 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.223078 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.223935 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.223700 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.223935 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.223826 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.224367 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.224341 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.225605 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.225578 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.225733 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.225601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-config\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.225733 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.225604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.225733 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.225632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.225911 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.225812 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.226515 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.226179 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.226616 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.226588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.226709 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.226644 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89899882-f68c-4d53-ab53-577d7b86eaf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.226709 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.226648 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.227346 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.227309 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89899882-f68c-4d53-ab53-577d7b86eaf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.227439 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.227315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89899882-f68c-4d53-ab53-577d7b86eaf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.228151 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.228124 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.228243 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.228163 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.228307 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.228290 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.228570 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.228552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/89899882-f68c-4d53-ab53-577d7b86eaf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.235934 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.235914 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqfz\" (UniqueName: \"kubernetes.io/projected/89899882-f68c-4d53-ab53-577d7b86eaf1-kube-api-access-2bqfz\") pod \"prometheus-k8s-0\" (UID: \"89899882-f68c-4d53-ab53-577d7b86eaf1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.371585 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.371559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:20.663904 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.663868 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 17:38:20.665901 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:38:20.665870 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89899882_f68c_4d53_ab53_577d7b86eaf1.slice/crio-2767f810075f254cf344136edd91d03ad2fcd484bc221a3eefda9db730a41ad5 WatchSource:0}: Error finding container 2767f810075f254cf344136edd91d03ad2fcd484bc221a3eefda9db730a41ad5: Status 404 returned error can't find the container with id 2767f810075f254cf344136edd91d03ad2fcd484bc221a3eefda9db730a41ad5 Sep 17 17:38:20.989210 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.989184 2577 generic.go:356] "Generic (PLEG): container finished" podID="89899882-f68c-4d53-ab53-577d7b86eaf1" containerID="81a687a5a4037ec9003c7a95f2c9698fd7ff902d187590f15f4baa77f8432ac2" exitCode=0 Sep 17 17:38:20.989353 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.989276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerDied","Data":"81a687a5a4037ec9003c7a95f2c9698fd7ff902d187590f15f4baa77f8432ac2"} Sep 17 17:38:20.989415 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:20.989353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerStarted","Data":"2767f810075f254cf344136edd91d03ad2fcd484bc221a3eefda9db730a41ad5"} Sep 17 17:38:21.929993 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:21.929967 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ae49653-34e9-417b-b7b3-c8f71142f3ad" path="/var/lib/kubelet/pods/1ae49653-34e9-417b-b7b3-c8f71142f3ad/volumes" Sep 17 17:38:21.998874 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:21.997843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerStarted","Data":"867b18c2c4a21484f361f8d46e079f6a664935a2ebc925b26d980c1cf7b74fb9"} Sep 17 17:38:21.998874 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:21.997925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerStarted","Data":"cf8d966ba7912e2faee7a117a036a1876a5f65d9c2389a45bee7ecab6627b858"} Sep 17 17:38:21.998874 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:21.997962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerStarted","Data":"357e016773ac604899a2d6102cfeed4067124b9edfbfd5741e0659d245e1aa41"} Sep 17 17:38:21.998874 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:21.997998 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerStarted","Data":"4fe2ea8b4e4160f9fb24ce75568ba79ad538356e532b56c4e6dc40ec8541daee"} Sep 17 17:38:21.998874 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:21.998036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerStarted","Data":"ce19deca745c326480520109a10696d14b92a5e13892b51b0d2d6d607b40c5ab"} Sep 17 17:38:21.998874 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:21.998072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"89899882-f68c-4d53-ab53-577d7b86eaf1","Type":"ContainerStarted","Data":"68762674c4bb8c116b9e5bbf29bb487fd140949e64b99754232b00cdc34c3682"} Sep 17 17:38:22.044063 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:22.044010 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.022848433 podStartE2EDuration="2.043989875s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.141442ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:22.040105235 +0000 UTC m=+248.517115405" watchObservedRunningTime="2026-09-17 17:38:22.043989875 +0000 UTC m=+248.521000046" Sep 17 17:38:25.372426 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:25.372385 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:38:27.683649 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:27.683568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:38:27.685967 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:27.685943 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c108c40b-fe8d-4a81-b08b-c926b0c103ed-metrics-certs\") pod \"network-metrics-daemon-z6vms\" (UID: \"c108c40b-fe8d-4a81-b08b-c926b0c103ed\") " pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:38:27.827869 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:27.827840 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xc26q\"" Sep 17 17:38:27.835150 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:27.835131 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z6vms" Sep 17 17:38:28.111208 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:28.111140 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z6vms"] Sep 17 17:38:28.114758 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:38:28.114724 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc108c40b_fe8d_4a81_b08b_c926b0c103ed.slice/crio-f86645f205037eee8ffadb7eb342e5de3536629307c5eb68d4cf5172638a0d42 WatchSource:0}: Error finding container f86645f205037eee8ffadb7eb342e5de3536629307c5eb68d4cf5172638a0d42: Status 404 returned error can't find the container with id f86645f205037eee8ffadb7eb342e5de3536629307c5eb68d4cf5172638a0d42 Sep 17 17:38:29.029835 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:29.029804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z6vms" event={"ID":"c108c40b-fe8d-4a81-b08b-c926b0c103ed","Type":"ContainerStarted","Data":"f86645f205037eee8ffadb7eb342e5de3536629307c5eb68d4cf5172638a0d42"} Sep 17 17:38:30.036264 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:30.036230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z6vms" event={"ID":"c108c40b-fe8d-4a81-b08b-c926b0c103ed","Type":"ContainerStarted","Data":"6812805e31bb2987dbea64c71a0b154c63d463a93ef63f26cfa7d054342aa85f"} Sep 17 17:38:30.036701 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:30.036285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z6vms" event={"ID":"c108c40b-fe8d-4a81-b08b-c926b0c103ed","Type":"ContainerStarted","Data":"4a46c0ce745baf12cc7dc2954fbd35ce340d8e64b119674f257b2e091dc8202d"} Sep 17 17:38:30.056694 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:38:30.056621 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z6vms" podStartSLOduration=253.131916601 podStartE2EDuration="4m14.056595802s" totalImagesPullingTime="924.679201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:30.054990155 +0000 UTC m=+256.532000345" watchObservedRunningTime="2026-09-17 17:38:30.056595802 +0000 UTC m=+256.533605972" Sep 17 17:39:15.770781 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:15.770745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:39:15.775814 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:15.775788 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:39:15.779874 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:15.779852 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:39:15.784123 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:15.784105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:39:15.784704 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:15.784684 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 17:39:20.372081 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:20.372042 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:39:20.388872 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:20.388845 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:39:21.263083 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:39:21.263035 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 17:44:15.805991 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:44:15.805966 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:44:15.806559 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:44:15.806543 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:44:15.813192 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:44:15.813173 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:44:15.813819 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:44:15.813801 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:45:14.435111 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.435080 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-mbnb4"] Sep 17 17:45:14.438285 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.438267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mbnb4" Sep 17 17:45:14.444012 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.443992 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 17 17:45:14.444143 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.444077 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 17:45:14.445642 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.445625 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 17 17:45:14.445763 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.445745 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-rrjxg\"" Sep 17 17:45:14.445903 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.445886 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 17 17:45:14.450129 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.450112 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-mbnb4"] Sep 17 17:45:14.528866 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.528846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphs4\" (UniqueName: \"kubernetes.io/projected/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-kube-api-access-hphs4\") pod \"s3-init-mbnb4\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " pod="kserve/s3-init-mbnb4" Sep 17 17:45:14.528999 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.528873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-model-cache\") pod \"s3-init-mbnb4\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " pod="kserve/s3-init-mbnb4" Sep 17 17:45:14.629675 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.629629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphs4\" (UniqueName: \"kubernetes.io/projected/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-kube-api-access-hphs4\") pod \"s3-init-mbnb4\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " pod="kserve/s3-init-mbnb4" Sep 17 17:45:14.629675 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.629657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-model-cache\") pod \"s3-init-mbnb4\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " pod="kserve/s3-init-mbnb4" Sep 17 17:45:14.629991 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.629977 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-model-cache\") pod \"s3-init-mbnb4\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " pod="kserve/s3-init-mbnb4" Sep 17 17:45:14.640809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.640792 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphs4\" (UniqueName: \"kubernetes.io/projected/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-kube-api-access-hphs4\") pod \"s3-init-mbnb4\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " pod="kserve/s3-init-mbnb4" Sep 17 17:45:14.747212 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:14.747167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mbnb4" Sep 17 17:45:15.018013 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:15.017946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-mbnb4"] Sep 17 17:45:15.021572 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:45:15.021541 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8d6df53_1df9_4152_95a2_d0c8fe1acd69.slice/crio-7d3288486406c08259fe90f99ac1e71c64e9288da1346e849a30e612167667d5 WatchSource:0}: Error finding container 7d3288486406c08259fe90f99ac1e71c64e9288da1346e849a30e612167667d5: Status 404 returned error can't find the container with id 7d3288486406c08259fe90f99ac1e71c64e9288da1346e849a30e612167667d5 Sep 17 17:45:15.023795 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:15.023774 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:45:15.657195 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:15.657155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mbnb4" event={"ID":"f8d6df53-1df9-4152-95a2-d0c8fe1acd69","Type":"ContainerStarted","Data":"7d3288486406c08259fe90f99ac1e71c64e9288da1346e849a30e612167667d5"} Sep 17 17:45:18.189834 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:18.189811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 17 17:45:18.673559 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:18.673526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mbnb4" event={"ID":"f8d6df53-1df9-4152-95a2-d0c8fe1acd69","Type":"ContainerStarted","Data":"2d076f461ea135fa11bd8b1673651b427c6d7c8daca9969aae5257f69dd8c216"} Sep 17 17:45:20.683254 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:20.683222 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8d6df53-1df9-4152-95a2-d0c8fe1acd69" containerID="2d076f461ea135fa11bd8b1673651b427c6d7c8daca9969aae5257f69dd8c216" exitCode=0 Sep 17 17:45:20.683716 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:20.683260 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mbnb4" event={"ID":"f8d6df53-1df9-4152-95a2-d0c8fe1acd69","Type":"ContainerDied","Data":"2d076f461ea135fa11bd8b1673651b427c6d7c8daca9969aae5257f69dd8c216"} Sep 17 17:45:24.987942 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:24.987919 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 17:45:25.709991 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:25.709959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mbnb4" event={"ID":"f8d6df53-1df9-4152-95a2-d0c8fe1acd69","Type":"ContainerStarted","Data":"476f853ed4edf942f2c02de2a691e2b5268f46ceff5ad1ca3d1282aab5a5f4ab"} Sep 17 17:45:25.735388 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:45:25.735335 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-mbnb4" podStartSLOduration=2.485105122 podStartE2EDuration="11.735318809s" totalImagesPullingTime="7.460619092s" totalInitContainerRuntime="1.789594595s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:45:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:25.734536711 +0000 UTC m=+672.211546881" watchObservedRunningTime="2026-09-17 17:45:25.735318809 +0000 UTC m=+672.212328983" Sep 17 17:46:29.973085 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:29.973054 2577 generic.go:356] "Generic (PLEG): container finished" podID="f8d6df53-1df9-4152-95a2-d0c8fe1acd69" containerID="476f853ed4edf942f2c02de2a691e2b5268f46ceff5ad1ca3d1282aab5a5f4ab" exitCode=0 Sep 17 17:46:29.973432 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:29.973125 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mbnb4" event={"ID":"f8d6df53-1df9-4152-95a2-d0c8fe1acd69","Type":"ContainerDied","Data":"476f853ed4edf942f2c02de2a691e2b5268f46ceff5ad1ca3d1282aab5a5f4ab"} Sep 17 17:46:31.094587 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.094558 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mbnb4" Sep 17 17:46:31.201528 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.201503 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hphs4\" (UniqueName: \"kubernetes.io/projected/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-kube-api-access-hphs4\") pod \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " Sep 17 17:46:31.201651 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.201536 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-model-cache\") pod \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\" (UID: \"f8d6df53-1df9-4152-95a2-d0c8fe1acd69\") " Sep 17 17:46:31.203569 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.203545 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-kube-api-access-hphs4" (OuterVolumeSpecName: "kube-api-access-hphs4") pod "f8d6df53-1df9-4152-95a2-d0c8fe1acd69" (UID: "f8d6df53-1df9-4152-95a2-d0c8fe1acd69"). InnerVolumeSpecName "kube-api-access-hphs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:46:31.223582 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.223558 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-model-cache" (OuterVolumeSpecName: "model-cache") pod "f8d6df53-1df9-4152-95a2-d0c8fe1acd69" (UID: "f8d6df53-1df9-4152-95a2-d0c8fe1acd69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:46:31.302815 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.302765 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hphs4\" (UniqueName: \"kubernetes.io/projected/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-kube-api-access-hphs4\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:46:31.302815 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.302786 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8d6df53-1df9-4152-95a2-d0c8fe1acd69-model-cache\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:46:31.982091 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.982068 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-mbnb4" Sep 17 17:46:31.982199 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.982090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-mbnb4" event={"ID":"f8d6df53-1df9-4152-95a2-d0c8fe1acd69","Type":"ContainerDied","Data":"7d3288486406c08259fe90f99ac1e71c64e9288da1346e849a30e612167667d5"} Sep 17 17:46:31.982199 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:31.982116 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d3288486406c08259fe90f99ac1e71c64e9288da1346e849a30e612167667d5" Sep 17 17:46:45.079268 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.079238 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d"] Sep 17 17:46:45.079747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.079535 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d6df53-1df9-4152-95a2-d0c8fe1acd69" containerName="download-hf-model" Sep 17 17:46:45.079747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.079547 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d6df53-1df9-4152-95a2-d0c8fe1acd69" containerName="download-hf-model" Sep 17 17:46:45.079747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.079561 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d6df53-1df9-4152-95a2-d0c8fe1acd69" containerName="s3-init" Sep 17 17:46:45.079747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.079566 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d6df53-1df9-4152-95a2-d0c8fe1acd69" containerName="s3-init" Sep 17 17:46:45.079747 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.079624 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d6df53-1df9-4152-95a2-d0c8fe1acd69" containerName="s3-init" Sep 17 17:46:45.082932 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.082915 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.087005 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.086976 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 17 17:46:45.087005 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.086989 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Sep 17 17:46:45.087283 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.087261 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-r96lh\"" Sep 17 17:46:45.088272 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.088253 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 17 17:46:45.088380 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.088269 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 17 17:46:45.088380 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.088269 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 17 17:46:45.088380 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.088314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Sep 17 17:46:45.099723 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.099699 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d"] Sep 17 17:46:45.198478 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.198449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm6bv\" (UniqueName: \"kubernetes.io/projected/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-api-access-gm6bv\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.198580 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.198497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86d75845-ca2d-42c4-8c18-426d10aa3a6d-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.198628 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.198583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.198628 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.198608 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.198735 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.198673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.299496 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.299470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm6bv\" (UniqueName: \"kubernetes.io/projected/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-api-access-gm6bv\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.299496 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.299497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86d75845-ca2d-42c4-8c18-426d10aa3a6d-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.299615 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.299529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.299615 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.299550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.299615 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.299605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.300045 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.300027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.300332 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.300307 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.300406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.300307 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.301879 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.301859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86d75845-ca2d-42c4-8c18-426d10aa3a6d-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.313447 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.313421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm6bv\" (UniqueName: \"kubernetes.io/projected/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-api-access-gm6bv\") pod \"isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.394396 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.394330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:46:45.621885 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.621851 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s"] Sep 17 17:46:45.625954 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.625933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.629398 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.629368 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Sep 17 17:46:45.629856 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.629838 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Sep 17 17:46:45.651175 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.651120 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s"] Sep 17 17:46:45.680103 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.680078 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d"] Sep 17 17:46:45.684306 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:46:45.684284 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d75845_ca2d_42c4_8c18_426d10aa3a6d.slice/crio-3b194be55c043260917f6c15fc5fc866637e7f77592abfc051a367523be75aa6 WatchSource:0}: Error finding container 3b194be55c043260917f6c15fc5fc866637e7f77592abfc051a367523be75aa6: Status 404 returned error can't find the container with id 3b194be55c043260917f6c15fc5fc866637e7f77592abfc051a367523be75aa6 Sep 17 17:46:45.704916 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.704896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e2c904e-062a-49b9-8602-16cd2543955b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.705000 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.704931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.705000 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.704962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e2c904e-062a-49b9-8602-16cd2543955b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.705071 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.705022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.705071 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.705048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/1e2c904e-062a-49b9-8602-16cd2543955b-kube-api-access-hwvzr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.805640 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.805603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/1e2c904e-062a-49b9-8602-16cd2543955b-kube-api-access-hwvzr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.805785 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.805646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e2c904e-062a-49b9-8602-16cd2543955b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.805785 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.805691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.805785 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.805720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e2c904e-062a-49b9-8602-16cd2543955b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.805785 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.805753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.806108 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.806086 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e2c904e-062a-49b9-8602-16cd2543955b-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.806550 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.806533 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.806692 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.806639 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.808064 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.808045 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e2c904e-062a-49b9-8602-16cd2543955b-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.817716 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.817692 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/1e2c904e-062a-49b9-8602-16cd2543955b-kube-api-access-hwvzr\") pod \"isvc-xgboost-graph-predictor-555fc69d56-xkt8s\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.939112 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.939087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:46:45.990278 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.990026 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx"] Sep 17 17:46:45.995691 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:45.995138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.001446 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.001363 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 17 17:46:46.003010 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.001954 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 17 17:46:46.014966 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.014891 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx"] Sep 17 17:46:46.039523 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.039490 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerStarted","Data":"bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c"} Sep 17 17:46:46.039620 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.039554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerStarted","Data":"3b194be55c043260917f6c15fc5fc866637e7f77592abfc051a367523be75aa6"} Sep 17 17:46:46.108066 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.108037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnp7\" (UniqueName: \"kubernetes.io/projected/37923647-8dda-442f-8ac8-4f92515839fd-kube-api-access-9cnp7\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.108419 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.108088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37923647-8dda-442f-8ac8-4f92515839fd-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.108419 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.108118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.108419 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.108151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.108419 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.108179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.209680 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.209609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnp7\" (UniqueName: \"kubernetes.io/projected/37923647-8dda-442f-8ac8-4f92515839fd-kube-api-access-9cnp7\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.209680 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.209653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37923647-8dda-442f-8ac8-4f92515839fd-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.209849 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.209702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.209849 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.209729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.209849 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.209753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.210000 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:46:46.209851 2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-serving-cert: secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Sep 17 17:46:46.210000 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:46:46.209918 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls podName:37923647-8dda-442f-8ac8-4f92515839fd nodeName:}" failed. No retries permitted until 2026-09-17 17:46:46.709899121 +0000 UTC m=+753.186909285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls") pod "isvc-sklearn-graph-2-predictor-ffc456649-z8txx" (UID: "37923647-8dda-442f-8ac8-4f92515839fd") : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Sep 17 17:46:46.210162 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.210141 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37923647-8dda-442f-8ac8-4f92515839fd-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.210441 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.210418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.210441 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.210433 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.222197 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.222173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnp7\" (UniqueName: \"kubernetes.io/projected/37923647-8dda-442f-8ac8-4f92515839fd-kube-api-access-9cnp7\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.229428 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.229409 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s"] Sep 17 17:46:46.232446 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:46:46.232425 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2c904e_062a_49b9_8602_16cd2543955b.slice/crio-955b4769243d89111ad32e91c3d8606eb9acea0b91dce4afc3ae19e41429b934 WatchSource:0}: Error finding container 955b4769243d89111ad32e91c3d8606eb9acea0b91dce4afc3ae19e41429b934: Status 404 returned error can't find the container with id 955b4769243d89111ad32e91c3d8606eb9acea0b91dce4afc3ae19e41429b934 Sep 17 17:46:46.714176 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.714142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.716418 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.716388 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-ffc456649-z8txx\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:46.913555 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:46.913511 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:46:47.044798 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:47.044765 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerStarted","Data":"eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91"} Sep 17 17:46:47.044923 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:47.044867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerStarted","Data":"955b4769243d89111ad32e91c3d8606eb9acea0b91dce4afc3ae19e41429b934"} Sep 17 17:46:47.205688 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:47.205638 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx"] Sep 17 17:46:47.208168 ip-10-0-139-254 kubenswrapper[2577]: W0917 17:46:47.208142 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37923647_8dda_442f_8ac8_4f92515839fd.slice/crio-b2f0092358da57da92bfa4a5813cdcd05482e5c80c459fb81a30f3da6c12a590 WatchSource:0}: Error finding container b2f0092358da57da92bfa4a5813cdcd05482e5c80c459fb81a30f3da6c12a590: Status 404 returned error can't find the container with id b2f0092358da57da92bfa4a5813cdcd05482e5c80c459fb81a30f3da6c12a590 Sep 17 17:46:48.050930 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:48.050896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerStarted","Data":"c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6"} Sep 17 17:46:48.051128 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:48.050952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerStarted","Data":"b2f0092358da57da92bfa4a5813cdcd05482e5c80c459fb81a30f3da6c12a590"} Sep 17 17:46:50.061318 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:50.061240 2577 generic.go:356] "Generic (PLEG): container finished" podID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerID="bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c" exitCode=0 Sep 17 17:46:50.061318 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:50.061304 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerDied","Data":"bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c"} Sep 17 17:46:51.074431 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:51.074393 2577 generic.go:356] "Generic (PLEG): container finished" podID="37923647-8dda-442f-8ac8-4f92515839fd" containerID="c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6" exitCode=0 Sep 17 17:46:51.074960 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:51.074503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerDied","Data":"c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6"} Sep 17 17:46:51.078947 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:51.078923 2577 generic.go:356] "Generic (PLEG): container finished" podID="1e2c904e-062a-49b9-8602-16cd2543955b" containerID="eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91" exitCode=0 Sep 17 17:46:51.079049 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:46:51.078965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerDied","Data":"eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91"} Sep 17 17:47:19.258409 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:19.258378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerStarted","Data":"d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed"} Sep 17 17:47:20.280025 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:20.279985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerStarted","Data":"e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b"} Sep 17 17:47:20.283089 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:20.283061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerStarted","Data":"d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081"} Sep 17 17:47:22.293699 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.293641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerStarted","Data":"522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780"} Sep 17 17:47:22.294147 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.293866 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:47:22.294147 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.293912 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:47:22.295496 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.295464 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:47:22.296243 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.296222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerStarted","Data":"9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e"} Sep 17 17:47:22.296424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.296409 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:47:22.296490 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.296462 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:47:22.297573 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.297549 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:47:22.298516 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.298497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerStarted","Data":"8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a"} Sep 17 17:47:22.298639 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.298625 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:47:22.323014 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.322969 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podStartSLOduration=2.723788616 podStartE2EDuration="37.322956677s" totalImagesPullingTime="30.667032224s" totalInitContainerRuntime="3.932135837s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:22.321463728 +0000 UTC m=+788.798473919" watchObservedRunningTime="2026-09-17 17:47:22.322956677 +0000 UTC m=+788.799966846" Sep 17 17:47:22.355673 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:22.355617 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podStartSLOduration=3.115657625 podStartE2EDuration="37.355603692s" totalImagesPullingTime="30.66149665s" totalInitContainerRuntime="3.578449417s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:22.354090538 +0000 UTC m=+788.831100711" watchObservedRunningTime="2026-09-17 17:47:22.355603692 +0000 UTC m=+788.832613862" Sep 17 17:47:23.303063 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:23.303025 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:47:23.303500 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:23.303124 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:47:23.303500 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:23.303268 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:47:23.304336 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:23.304315 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:47:24.307214 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:24.307174 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:47:28.307477 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:28.307405 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:47:28.307847 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:28.307498 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:47:28.307920 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:28.307895 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:47:28.308018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:28.307990 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:47:28.344946 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:28.344898 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podStartSLOduration=7.7361689380000005 podStartE2EDuration="43.344882857s" totalImagesPullingTime="31.665815488s" totalInitContainerRuntime="3.942898431s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:22.390828986 +0000 UTC m=+788.867839168" watchObservedRunningTime="2026-09-17 17:47:28.344882857 +0000 UTC m=+794.821893028" Sep 17 17:47:29.311426 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:29.311399 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:47:29.311875 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:29.311849 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:47:38.308007 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:38.307949 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:47:38.308538 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:38.307957 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:47:39.312815 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:39.312776 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:47:48.308230 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:48.308194 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:47:48.308683 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:48.308208 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:47:49.312832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:49.312791 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:47:58.308241 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:58.308203 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:47:58.308690 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:58.308195 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:47:59.312502 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:47:59.312457 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:48:08.308003 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:08.307961 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:48:08.308453 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:08.307978 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:48:09.312187 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:09.312146 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:48:18.307902 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:18.307862 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:48:18.308323 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:18.307862 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:48:19.312729 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:19.312686 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:48:28.308809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:28.308770 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:48:28.309424 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:28.309404 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:48:29.312707 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:29.312648 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:48:38.308591 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:38.308556 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:48:39.313458 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:48:39.313424 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:49:15.814478 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.814448 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx"] Sep 17 17:49:15.814918 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.814697 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" containerID="cri-o://d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed" gracePeriod=30 Sep 17 17:49:15.814918 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.814752 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kube-rbac-proxy" containerID="cri-o://9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e" gracePeriod=30 Sep 17 17:49:15.846614 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.846587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:49:15.847856 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.847832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:49:15.855997 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.855976 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:49:15.857252 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.857232 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:49:15.891792 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.891768 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d"] Sep 17 17:49:15.892032 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.891990 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" containerID="cri-o://e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b" gracePeriod=30 Sep 17 17:49:15.892144 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.892047 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kube-rbac-proxy" containerID="cri-o://8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a" gracePeriod=30 Sep 17 17:49:15.960577 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.960547 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s"] Sep 17 17:49:15.960840 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.960815 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" containerID="cri-o://d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081" gracePeriod=30 Sep 17 17:49:15.960947 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:15.960854 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kube-rbac-proxy" containerID="cri-o://522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780" gracePeriod=30 Sep 17 17:49:16.804169 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:16.804135 2577 generic.go:356] "Generic (PLEG): container finished" podID="37923647-8dda-442f-8ac8-4f92515839fd" containerID="9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e" exitCode=2 Sep 17 17:49:16.804350 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:16.804211 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerDied","Data":"9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e"} Sep 17 17:49:16.806409 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:16.806386 2577 generic.go:356] "Generic (PLEG): container finished" podID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerID="8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a" exitCode=2 Sep 17 17:49:16.806527 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:16.806459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerDied","Data":"8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a"} Sep 17 17:49:16.808337 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:16.808316 2577 generic.go:356] "Generic (PLEG): container finished" podID="1e2c904e-062a-49b9-8602-16cd2543955b" containerID="522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780" exitCode=2 Sep 17 17:49:16.808412 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:16.808377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerDied","Data":"522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780"} Sep 17 17:49:18.303787 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:18.303750 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused" Sep 17 17:49:18.304163 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:18.303752 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused" Sep 17 17:49:18.308588 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:18.308562 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Sep 17 17:49:18.308722 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:18.308617 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Sep 17 17:49:19.307695 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:19.307629 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.23:8643/healthz\": dial tcp 10.132.0.23:8643: connect: connection refused" Sep 17 17:49:19.312028 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:19.312000 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Sep 17 17:49:20.124374 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.124351 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:49:20.252820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.252755 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kserve-provision-location\") pod \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " Sep 17 17:49:20.252820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.252810 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm6bv\" (UniqueName: \"kubernetes.io/projected/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-api-access-gm6bv\") pod \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " Sep 17 17:49:20.253018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.252859 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86d75845-ca2d-42c4-8c18-426d10aa3a6d-proxy-tls\") pod \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " Sep 17 17:49:20.253018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.252906 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-rbac-proxy-sar-config\") pod \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " Sep 17 17:49:20.253018 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.252923 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-cabundle-cert\") pod \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\" (UID: \"86d75845-ca2d-42c4-8c18-426d10aa3a6d\") " Sep 17 17:49:20.253177 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.253072 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "86d75845-ca2d-42c4-8c18-426d10aa3a6d" (UID: "86d75845-ca2d-42c4-8c18-426d10aa3a6d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:49:20.253276 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.253244 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "86d75845-ca2d-42c4-8c18-426d10aa3a6d" (UID: "86d75845-ca2d-42c4-8c18-426d10aa3a6d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:20.253344 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.253268 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "86d75845-ca2d-42c4-8c18-426d10aa3a6d" (UID: "86d75845-ca2d-42c4-8c18-426d10aa3a6d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:20.254966 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.254945 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-api-access-gm6bv" (OuterVolumeSpecName: "kube-api-access-gm6bv") pod "86d75845-ca2d-42c4-8c18-426d10aa3a6d" (UID: "86d75845-ca2d-42c4-8c18-426d10aa3a6d"). InnerVolumeSpecName "kube-api-access-gm6bv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:49:20.255124 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.255108 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86d75845-ca2d-42c4-8c18-426d10aa3a6d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "86d75845-ca2d-42c4-8c18-426d10aa3a6d" (UID: "86d75845-ca2d-42c4-8c18-426d10aa3a6d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:49:20.354408 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.354374 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm6bv\" (UniqueName: \"kubernetes.io/projected/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-api-access-gm6bv\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.354408 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.354406 2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/86d75845-ca2d-42c4-8c18-426d10aa3a6d-proxy-tls\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.354820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.354422 2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.354820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.354438 2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/86d75845-ca2d-42c4-8c18-426d10aa3a6d-cabundle-cert\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.354820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.354452 2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86d75845-ca2d-42c4-8c18-426d10aa3a6d-kserve-provision-location\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.498524 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.498501 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:49:20.656647 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.656623 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e2c904e-062a-49b9-8602-16cd2543955b-proxy-tls\") pod \"1e2c904e-062a-49b9-8602-16cd2543955b\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " Sep 17 17:49:20.656816 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.656671 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/1e2c904e-062a-49b9-8602-16cd2543955b-kube-api-access-hwvzr\") pod \"1e2c904e-062a-49b9-8602-16cd2543955b\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " Sep 17 17:49:20.656816 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.656712 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e2c904e-062a-49b9-8602-16cd2543955b-kserve-provision-location\") pod \"1e2c904e-062a-49b9-8602-16cd2543955b\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " Sep 17 17:49:20.656816 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.656744 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-kube-rbac-proxy-sar-config\") pod \"1e2c904e-062a-49b9-8602-16cd2543955b\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " Sep 17 17:49:20.656816 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.656776 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-cabundle-cert\") pod \"1e2c904e-062a-49b9-8602-16cd2543955b\" (UID: \"1e2c904e-062a-49b9-8602-16cd2543955b\") " Sep 17 17:49:20.657075 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.657034 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2c904e-062a-49b9-8602-16cd2543955b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "1e2c904e-062a-49b9-8602-16cd2543955b" (UID: "1e2c904e-062a-49b9-8602-16cd2543955b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:49:20.657164 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.657107 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1e2c904e-062a-49b9-8602-16cd2543955b" (UID: "1e2c904e-062a-49b9-8602-16cd2543955b"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:20.657209 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.657160 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "1e2c904e-062a-49b9-8602-16cd2543955b" (UID: "1e2c904e-062a-49b9-8602-16cd2543955b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:20.658721 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.658695 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2c904e-062a-49b9-8602-16cd2543955b-kube-api-access-hwvzr" (OuterVolumeSpecName: "kube-api-access-hwvzr") pod "1e2c904e-062a-49b9-8602-16cd2543955b" (UID: "1e2c904e-062a-49b9-8602-16cd2543955b"). InnerVolumeSpecName "kube-api-access-hwvzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:49:20.658721 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.658713 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2c904e-062a-49b9-8602-16cd2543955b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1e2c904e-062a-49b9-8602-16cd2543955b" (UID: "1e2c904e-062a-49b9-8602-16cd2543955b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:49:20.734093 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.734069 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:49:20.758213 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.758189 2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1e2c904e-062a-49b9-8602-16cd2543955b-proxy-tls\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.758213 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.758211 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwvzr\" (UniqueName: \"kubernetes.io/projected/1e2c904e-062a-49b9-8602-16cd2543955b-kube-api-access-hwvzr\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.758333 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.758221 2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e2c904e-062a-49b9-8602-16cd2543955b-kserve-provision-location\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.758333 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.758230 2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.758333 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.758238 2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c904e-062a-49b9-8602-16cd2543955b-cabundle-cert\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.827912 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.827857 2577 generic.go:356] "Generic (PLEG): container finished" podID="1e2c904e-062a-49b9-8602-16cd2543955b" containerID="d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081" exitCode=0 Sep 17 17:49:20.828012 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.827916 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" Sep 17 17:49:20.828012 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.827935 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerDied","Data":"d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081"} Sep 17 17:49:20.828012 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.827989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s" event={"ID":"1e2c904e-062a-49b9-8602-16cd2543955b","Type":"ContainerDied","Data":"955b4769243d89111ad32e91c3d8606eb9acea0b91dce4afc3ae19e41429b934"} Sep 17 17:49:20.828166 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.828017 2577 scope.go:117] "RemoveContainer" containerID="522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780" Sep 17 17:49:20.830087 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.830067 2577 generic.go:356] "Generic (PLEG): container finished" podID="37923647-8dda-442f-8ac8-4f92515839fd" containerID="d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed" exitCode=0 Sep 17 17:49:20.830196 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.830109 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerDied","Data":"d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed"} Sep 17 17:49:20.830196 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.830126 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" Sep 17 17:49:20.830196 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.830177 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx" event={"ID":"37923647-8dda-442f-8ac8-4f92515839fd","Type":"ContainerDied","Data":"b2f0092358da57da92bfa4a5813cdcd05482e5c80c459fb81a30f3da6c12a590"} Sep 17 17:49:20.832269 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.832230 2577 generic.go:356] "Generic (PLEG): container finished" podID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerID="e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b" exitCode=0 Sep 17 17:49:20.832351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.832283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerDied","Data":"e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b"} Sep 17 17:49:20.832351 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.832338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" event={"ID":"86d75845-ca2d-42c4-8c18-426d10aa3a6d","Type":"ContainerDied","Data":"3b194be55c043260917f6c15fc5fc866637e7f77592abfc051a367523be75aa6"} Sep 17 17:49:20.832470 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.832288 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d" Sep 17 17:49:20.837701 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.837678 2577 scope.go:117] "RemoveContainer" containerID="d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081" Sep 17 17:49:20.845860 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.845843 2577 scope.go:117] "RemoveContainer" containerID="eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91" Sep 17 17:49:20.852820 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.852802 2577 scope.go:117] "RemoveContainer" containerID="522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780" Sep 17 17:49:20.853092 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.853075 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780\": container with ID starting with 522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780 not found: ID does not exist" containerID="522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780" Sep 17 17:49:20.853138 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.853099 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780"} err="failed to get container status \"522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780\": rpc error: code = NotFound desc = could not find container \"522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780\": container with ID starting with 522b038e300f3d2b752e5b31cf6d8eb9dad1f7c3938f4a44054662b8b360d780 not found: ID does not exist" Sep 17 17:49:20.853138 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.853116 2577 scope.go:117] "RemoveContainer" containerID="d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081" Sep 17 17:49:20.853407 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.853390 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081\": container with ID starting with d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081 not found: ID does not exist" containerID="d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081" Sep 17 17:49:20.853454 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.853413 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081"} err="failed to get container status \"d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081\": rpc error: code = NotFound desc = could not find container \"d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081\": container with ID starting with d1d1f0caa7e2d3f722809dd29ec141644ee1c63a4e52343f02d3d37a26466081 not found: ID does not exist" Sep 17 17:49:20.853454 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.853430 2577 scope.go:117] "RemoveContainer" containerID="eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91" Sep 17 17:49:20.853688 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.853655 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91\": container with ID starting with eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91 not found: ID does not exist" containerID="eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91" Sep 17 17:49:20.853728 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.853699 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91"} err="failed to get container status \"eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91\": rpc error: code = NotFound desc = could not find container \"eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91\": container with ID starting with eb9ffa15edc2bd836642bf484ef79183befffd926c0b20e3436ff35bf93eae91 not found: ID does not exist" Sep 17 17:49:20.853728 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.853722 2577 scope.go:117] "RemoveContainer" containerID="9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e" Sep 17 17:49:20.858809 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.858790 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls\") pod \"37923647-8dda-442f-8ac8-4f92515839fd\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " Sep 17 17:49:20.858907 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.858818 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-kube-rbac-proxy-sar-config\") pod \"37923647-8dda-442f-8ac8-4f92515839fd\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " Sep 17 17:49:20.858907 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.858846 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-cabundle-cert\") pod \"37923647-8dda-442f-8ac8-4f92515839fd\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " Sep 17 17:49:20.858907 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.858866 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37923647-8dda-442f-8ac8-4f92515839fd-kserve-provision-location\") pod \"37923647-8dda-442f-8ac8-4f92515839fd\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " Sep 17 17:49:20.858907 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.858902 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cnp7\" (UniqueName: \"kubernetes.io/projected/37923647-8dda-442f-8ac8-4f92515839fd-kube-api-access-9cnp7\") pod \"37923647-8dda-442f-8ac8-4f92515839fd\" (UID: \"37923647-8dda-442f-8ac8-4f92515839fd\") " Sep 17 17:49:20.859216 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.859191 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37923647-8dda-442f-8ac8-4f92515839fd-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "37923647-8dda-442f-8ac8-4f92515839fd" (UID: "37923647-8dda-442f-8ac8-4f92515839fd"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:49:20.859287 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.859228 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "37923647-8dda-442f-8ac8-4f92515839fd" (UID: "37923647-8dda-442f-8ac8-4f92515839fd"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:20.859287 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.859238 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "37923647-8dda-442f-8ac8-4f92515839fd" (UID: "37923647-8dda-442f-8ac8-4f92515839fd"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 17:49:20.860761 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.860738 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "37923647-8dda-442f-8ac8-4f92515839fd" (UID: "37923647-8dda-442f-8ac8-4f92515839fd"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 17:49:20.860832 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.860783 2577 scope.go:117] "RemoveContainer" containerID="d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed" Sep 17 17:49:20.860930 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.860915 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37923647-8dda-442f-8ac8-4f92515839fd-kube-api-access-9cnp7" (OuterVolumeSpecName: "kube-api-access-9cnp7") pod "37923647-8dda-442f-8ac8-4f92515839fd" (UID: "37923647-8dda-442f-8ac8-4f92515839fd"). InnerVolumeSpecName "kube-api-access-9cnp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:49:20.867502 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.867477 2577 scope.go:117] "RemoveContainer" containerID="c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6" Sep 17 17:49:20.870616 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.870593 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s"] Sep 17 17:49:20.874406 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.874386 2577 scope.go:117] "RemoveContainer" containerID="9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e" Sep 17 17:49:20.874643 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.874627 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e\": container with ID starting with 9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e not found: ID does not exist" containerID="9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e" Sep 17 17:49:20.874752 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.874647 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e"} err="failed to get container status \"9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e\": rpc error: code = NotFound desc = could not find container \"9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e\": container with ID starting with 9d6d4ed11f44c7acf8e0e38773ec889d7af2fbc51fb318b1bda9ac0ced50518e not found: ID does not exist" Sep 17 17:49:20.874752 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.874675 2577 scope.go:117] "RemoveContainer" containerID="d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed" Sep 17 17:49:20.874922 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.874906 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed\": container with ID starting with d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed not found: ID does not exist" containerID="d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed" Sep 17 17:49:20.874959 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.874927 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed"} err="failed to get container status \"d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed\": rpc error: code = NotFound desc = could not find container \"d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed\": container with ID starting with d8a94fa999559a48aae37b791b0db089294703842ac0e4110e14a3aad00320ed not found: ID does not exist" Sep 17 17:49:20.874959 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.874939 2577 scope.go:117] "RemoveContainer" containerID="c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6" Sep 17 17:49:20.875186 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.875171 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6\": container with ID starting with c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6 not found: ID does not exist" containerID="c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6" Sep 17 17:49:20.875233 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.875187 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6"} err="failed to get container status \"c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6\": rpc error: code = NotFound desc = could not find container \"c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6\": container with ID starting with c6ff9b9776b7a9d332e7572c168afee0b45dbdede9d718c42c7ae9c070007fd6 not found: ID does not exist" Sep 17 17:49:20.875233 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.875199 2577 scope.go:117] "RemoveContainer" containerID="8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a" Sep 17 17:49:20.882781 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.882731 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xkt8s"] Sep 17 17:49:20.884736 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.884653 2577 scope.go:117] "RemoveContainer" containerID="e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b" Sep 17 17:49:20.891610 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.891582 2577 scope.go:117] "RemoveContainer" containerID="bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c" Sep 17 17:49:20.898395 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.898373 2577 scope.go:117] "RemoveContainer" containerID="8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a" Sep 17 17:49:20.898756 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.898703 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a\": container with ID starting with 8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a not found: ID does not exist" containerID="8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a" Sep 17 17:49:20.898864 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.898763 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a"} err="failed to get container status \"8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a\": rpc error: code = NotFound desc = could not find container \"8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a\": container with ID starting with 8d7877897d251efd4bd9ab0361a72efb0a9f32937c86f33167f5bec6e4c2643a not found: ID does not exist" Sep 17 17:49:20.898864 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.898786 2577 scope.go:117] "RemoveContainer" containerID="e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b" Sep 17 17:49:20.899152 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.899130 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b\": container with ID starting with e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b not found: ID does not exist" containerID="e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b" Sep 17 17:49:20.899485 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.899160 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b"} err="failed to get container status \"e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b\": rpc error: code = NotFound desc = could not find container \"e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b\": container with ID starting with e5287acced4e47b9dfbbf64f4482f43a13a9f445236a1fab93c138647022cd7b not found: ID does not exist" Sep 17 17:49:20.899485 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.899180 2577 scope.go:117] "RemoveContainer" containerID="bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c" Sep 17 17:49:20.899900 ip-10-0-139-254 kubenswrapper[2577]: E0917 17:49:20.899875 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c\": container with ID starting with bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c not found: ID does not exist" containerID="bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c" Sep 17 17:49:20.899982 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.899904 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c"} err="failed to get container status \"bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c\": rpc error: code = NotFound desc = could not find container \"bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c\": container with ID starting with bc7ae9cf62bda69ce68a403328613133de56d2b94969ce1c7d8f9130fdeee33c not found: ID does not exist" Sep 17 17:49:20.901013 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.900994 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d"] Sep 17 17:49:20.909005 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.908986 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6f7b8d4cb-9t97d"] Sep 17 17:49:20.960200 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.960176 2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/37923647-8dda-442f-8ac8-4f92515839fd-proxy-tls\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.960295 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.960220 2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.960295 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.960236 2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/37923647-8dda-442f-8ac8-4f92515839fd-cabundle-cert\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.960295 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.960249 2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37923647-8dda-442f-8ac8-4f92515839fd-kserve-provision-location\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:20.960295 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:20.960262 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cnp7\" (UniqueName: \"kubernetes.io/projected/37923647-8dda-442f-8ac8-4f92515839fd-kube-api-access-9cnp7\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 17:49:21.163251 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:21.163223 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx"] Sep 17 17:49:21.166267 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:21.166246 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-ffc456649-z8txx"] Sep 17 17:49:21.929040 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:21.929003 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" path="/var/lib/kubelet/pods/1e2c904e-062a-49b9-8602-16cd2543955b/volumes" Sep 17 17:49:21.929507 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:21.929491 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37923647-8dda-442f-8ac8-4f92515839fd" path="/var/lib/kubelet/pods/37923647-8dda-442f-8ac8-4f92515839fd/volumes" Sep 17 17:49:21.930324 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:49:21.930303 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" path="/var/lib/kubelet/pods/86d75845-ca2d-42c4-8c18-426d10aa3a6d/volumes" Sep 17 17:54:15.881377 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:54:15.881342 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:54:15.885796 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:54:15.885773 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:54:15.889594 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:54:15.889573 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:54:15.893557 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:54:15.893540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:59:15.911831 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:59:15.911804 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:59:15.916145 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:59:15.916121 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 17:59:15.919712 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:59:15.919689 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 17:59:15.923746 ip-10-0-139-254 kubenswrapper[2577]: I0917 17:59:15.923723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:04:15.947834 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:04:15.947809 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:04:15.951099 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:04:15.951074 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:04:15.955628 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:04:15.955607 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:04:15.959207 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:04:15.959191 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:09:15.975681 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:09:15.975634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:09:15.980640 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:09:15.980610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:09:15.984231 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:09:15.984211 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:09:15.988996 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:09:15.988978 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:14:16.010676 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:14:16.010634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:14:16.016382 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:14:16.016362 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:14:16.018419 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:14:16.018398 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:14:16.024317 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:14:16.024299 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:19:16.039186 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:19:16.039077 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:19:16.044404 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:19:16.044381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:19:16.046564 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:19:16.046546 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:19:16.051674 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:19:16.051636 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:24:16.065752 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:24:16.065629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:24:16.072451 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:24:16.072430 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:24:16.072854 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:24:16.072835 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:24:16.079675 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:24:16.079645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:26:16.528061 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528023 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lrx94/must-gather-rznt7"] Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528344 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="storage-initializer" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528357 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="storage-initializer" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528368 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kube-rbac-proxy" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528377 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kube-rbac-proxy" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528392 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528398 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528408 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528415 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528421 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kube-rbac-proxy" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528426 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kube-rbac-proxy" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528440 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="storage-initializer" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528448 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="storage-initializer" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528456 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528462 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528470 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="storage-initializer" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528475 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="storage-initializer" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528480 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kube-rbac-proxy" Sep 17 18:26:16.528526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528485 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kube-rbac-proxy" Sep 17 18:26:16.529150 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528543 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kserve-container" Sep 17 18:26:16.529150 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528552 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kserve-container" Sep 17 18:26:16.529150 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528559 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kube-rbac-proxy" Sep 17 18:26:16.529150 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528565 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d75845-ca2d-42c4-8c18-426d10aa3a6d" containerName="kube-rbac-proxy" Sep 17 18:26:16.529150 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528571 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2c904e-062a-49b9-8602-16cd2543955b" containerName="kube-rbac-proxy" Sep 17 18:26:16.529150 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.528578 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="37923647-8dda-442f-8ac8-4f92515839fd" containerName="kserve-container" Sep 17 18:26:16.531552 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.531531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:16.531689 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.531648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z6vl\" (UniqueName: \"kubernetes.io/projected/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-kube-api-access-5z6vl\") pod \"must-gather-rznt7\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:16.531756 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.531711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-must-gather-output\") pod \"must-gather-rznt7\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:16.534105 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.534083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lrx94\"/\"default-dockercfg-mv65q\"" Sep 17 18:26:16.534224 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.534148 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lrx94\"/\"kube-root-ca.crt\"" Sep 17 18:26:16.535334 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.535319 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lrx94\"/\"openshift-service-ca.crt\"" Sep 17 18:26:16.541176 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.541155 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lrx94/must-gather-rznt7"] Sep 17 18:26:16.632231 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.632200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z6vl\" (UniqueName: \"kubernetes.io/projected/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-kube-api-access-5z6vl\") pod \"must-gather-rznt7\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:16.632425 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.632251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-must-gather-output\") pod \"must-gather-rznt7\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:16.632569 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.632549 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-must-gather-output\") pod \"must-gather-rznt7\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:16.641847 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.641816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z6vl\" (UniqueName: \"kubernetes.io/projected/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-kube-api-access-5z6vl\") pod \"must-gather-rznt7\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:16.841174 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:16.841090 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:17.111990 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:17.111909 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lrx94/must-gather-rznt7"] Sep 17 18:26:17.114860 ip-10-0-139-254 kubenswrapper[2577]: W0917 18:26:17.114832 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c07dad1_6a92_4f6b_ab86_a853a1e62b87.slice/crio-a2845ec063bd9605a49d2d34d0d27bf7ea9bccc520c9c57d9bce6daf7f17c35e WatchSource:0}: Error finding container a2845ec063bd9605a49d2d34d0d27bf7ea9bccc520c9c57d9bce6daf7f17c35e: Status 404 returned error can't find the container with id a2845ec063bd9605a49d2d34d0d27bf7ea9bccc520c9c57d9bce6daf7f17c35e Sep 17 18:26:17.116619 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:17.116601 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:26:17.788268 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:17.788235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrx94/must-gather-rznt7" event={"ID":"7c07dad1-6a92-4f6b-ab86-a853a1e62b87","Type":"ContainerStarted","Data":"a2845ec063bd9605a49d2d34d0d27bf7ea9bccc520c9c57d9bce6daf7f17c35e"} Sep 17 18:26:23.818026 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:23.817990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrx94/must-gather-rznt7" event={"ID":"7c07dad1-6a92-4f6b-ab86-a853a1e62b87","Type":"ContainerStarted","Data":"909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b"} Sep 17 18:26:23.818026 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:23.818031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrx94/must-gather-rznt7" event={"ID":"7c07dad1-6a92-4f6b-ab86-a853a1e62b87","Type":"ContainerStarted","Data":"6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6"} Sep 17 18:26:23.835778 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:23.835722 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lrx94/must-gather-rznt7" podStartSLOduration=1.720461002 podStartE2EDuration="7.83570525s" totalImagesPullingTime="6.115244248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:26:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:26:23.834416444 +0000 UTC m=+3130.311426616" watchObservedRunningTime="2026-09-17 18:26:23.83570525 +0000 UTC m=+3130.312715419" Sep 17 18:26:46.918949 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:46.918915 2577 generic.go:356] "Generic (PLEG): container finished" podID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerID="6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6" exitCode=0 Sep 17 18:26:46.919365 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:46.918982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lrx94/must-gather-rznt7" event={"ID":"7c07dad1-6a92-4f6b-ab86-a853a1e62b87","Type":"ContainerDied","Data":"6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6"} Sep 17 18:26:46.919365 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:46.919274 2577 scope.go:117] "RemoveContainer" containerID="6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6" Sep 17 18:26:47.222826 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:47.222743 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lrx94_must-gather-rznt7_7c07dad1-6a92-4f6b-ab86-a853a1e62b87/gather/0.log" Sep 17 18:26:50.803246 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:50.803220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9tvnp_95abfd80-c3af-45b0-adb6-12c29ecbde88/global-pull-secret-syncer/0.log" Sep 17 18:26:51.039434 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:51.039404 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kxtlt_a4e48b8b-081f-4b5e-bea8-8c452122ff60/konnectivity-agent/0.log" Sep 17 18:26:51.157643 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:51.157565 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-254.ec2.internal_ccbf594a5a3091ac836b07c85bd703c7/haproxy/0.log" Sep 17 18:26:52.651724 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.651694 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-lrx94/must-gather-rznt7"] Sep 17 18:26:52.652205 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.651888 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-lrx94/must-gather-rznt7" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerName="copy" containerID="cri-o://909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b" gracePeriod=2 Sep 17 18:26:52.657201 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.657179 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-lrx94/must-gather-rznt7"] Sep 17 18:26:52.879085 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.879061 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lrx94_must-gather-rznt7_7c07dad1-6a92-4f6b-ab86-a853a1e62b87/copy/0.log" Sep 17 18:26:52.880714 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.880694 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:52.883145 ip-10-0-139-254 kubenswrapper[2577]: E0917 18:26:52.883120 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rznt7\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lrx94\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:52.942046 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.942026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lrx94_must-gather-rznt7_7c07dad1-6a92-4f6b-ab86-a853a1e62b87/copy/0.log" Sep 17 18:26:52.942404 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.942382 2577 generic.go:356] "Generic (PLEG): container finished" podID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerID="909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b" exitCode=143 Sep 17 18:26:52.942503 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.942433 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:52.942503 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.942474 2577 scope.go:117] "RemoveContainer" containerID="909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b" Sep 17 18:26:52.945127 ip-10-0-139-254 kubenswrapper[2577]: E0917 18:26:52.945107 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rznt7\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lrx94\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:52.950125 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.950106 2577 scope.go:117] "RemoveContainer" containerID="6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6" Sep 17 18:26:52.962792 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.962776 2577 scope.go:117] "RemoveContainer" containerID="909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b" Sep 17 18:26:52.963060 ip-10-0-139-254 kubenswrapper[2577]: E0917 18:26:52.963041 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b\": container with ID starting with 909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b not found: ID does not exist" containerID="909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b" Sep 17 18:26:52.963109 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.963072 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b"} err="failed to get container status \"909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b\": rpc error: code = NotFound desc = could not find container \"909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b\": container with ID starting with 909ea2ca03cb668dd91a6e84a069bfe70b8be9a9a68cb35c1334d6a9872a3c0b not found: ID does not exist" Sep 17 18:26:52.963109 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.963088 2577 scope.go:117] "RemoveContainer" containerID="6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6" Sep 17 18:26:52.963346 ip-10-0-139-254 kubenswrapper[2577]: E0917 18:26:52.963305 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6\": container with ID starting with 6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6 not found: ID does not exist" containerID="6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6" Sep 17 18:26:52.963390 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:52.963353 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6"} err="failed to get container status \"6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6\": rpc error: code = NotFound desc = could not find container \"6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6\": container with ID starting with 6d83c12fa86ced1dfb58eb07ce1d323a3cbb3d6f064816740791338d92d39da6 not found: ID does not exist" Sep 17 18:26:53.051082 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:53.051052 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-must-gather-output\") pod \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " Sep 17 18:26:53.051227 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:53.051120 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z6vl\" (UniqueName: \"kubernetes.io/projected/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-kube-api-access-5z6vl\") pod \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\" (UID: \"7c07dad1-6a92-4f6b-ab86-a853a1e62b87\") " Sep 17 18:26:53.052670 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:53.052629 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "7c07dad1-6a92-4f6b-ab86-a853a1e62b87" (UID: "7c07dad1-6a92-4f6b-ab86-a853a1e62b87"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:26:53.053233 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:53.053212 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-kube-api-access-5z6vl" (OuterVolumeSpecName: "kube-api-access-5z6vl") pod "7c07dad1-6a92-4f6b-ab86-a853a1e62b87" (UID: "7c07dad1-6a92-4f6b-ab86-a853a1e62b87"). InnerVolumeSpecName "kube-api-access-5z6vl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:26:53.152094 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:53.152059 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-must-gather-output\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 18:26:53.152094 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:53.152086 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z6vl\" (UniqueName: \"kubernetes.io/projected/7c07dad1-6a92-4f6b-ab86-a853a1e62b87-kube-api-access-5z6vl\") on node \"ip-10-0-139-254.ec2.internal\" DevicePath \"\"" Sep 17 18:26:53.252668 ip-10-0-139-254 kubenswrapper[2577]: E0917 18:26:53.252624 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rznt7\" is forbidden: User \"system:node:ip-10-0-139-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lrx94\": no relationship found between node 'ip-10-0-139-254.ec2.internal' and this object" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" pod="openshift-must-gather-lrx94/must-gather-rznt7" Sep 17 18:26:53.928570 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:53.928528 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" path="/var/lib/kubelet/pods/7c07dad1-6a92-4f6b-ab86-a853a1e62b87/volumes" Sep 17 18:26:55.496543 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:55.496505 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-sfsg4_f93ebcf9-9f90-43de-afd0-58d71bf3fcff/kube-state-metrics/0.log" Sep 17 18:26:55.525984 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:55.525961 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-sfsg4_f93ebcf9-9f90-43de-afd0-58d71bf3fcff/kube-rbac-proxy-main/0.log" Sep 17 18:26:55.551623 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:55.551593 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-sfsg4_f93ebcf9-9f90-43de-afd0-58d71bf3fcff/kube-rbac-proxy-self/0.log" Sep 17 18:26:55.590922 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:55.590900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5986d59d8c-dslb6_aba535e9-5098-4537-bd01-16591260b5e8/metrics-server/0.log" Sep 17 18:26:55.760249 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:55.760224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nrb_d7927077-3a58-4b08-b77d-7be9d56371fa/node-exporter/0.log" Sep 17 18:26:55.784852 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:55.784825 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nrb_d7927077-3a58-4b08-b77d-7be9d56371fa/kube-rbac-proxy/0.log" Sep 17 18:26:55.809564 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:55.809540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-95nrb_d7927077-3a58-4b08-b77d-7be9d56371fa/init-textfile/0.log" Sep 17 18:26:56.037743 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.037645 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89899882-f68c-4d53-ab53-577d7b86eaf1/prometheus/0.log" Sep 17 18:26:56.060247 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.060223 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89899882-f68c-4d53-ab53-577d7b86eaf1/config-reloader/0.log" Sep 17 18:26:56.087127 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.087103 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89899882-f68c-4d53-ab53-577d7b86eaf1/thanos-sidecar/0.log" Sep 17 18:26:56.113425 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.113388 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89899882-f68c-4d53-ab53-577d7b86eaf1/kube-rbac-proxy-web/0.log" Sep 17 18:26:56.150777 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.150756 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89899882-f68c-4d53-ab53-577d7b86eaf1/kube-rbac-proxy/0.log" Sep 17 18:26:56.176939 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.176906 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89899882-f68c-4d53-ab53-577d7b86eaf1/kube-rbac-proxy-thanos/0.log" Sep 17 18:26:56.208056 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.208023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_89899882-f68c-4d53-ab53-577d7b86eaf1/init-config-reloader/0.log" Sep 17 18:26:56.313848 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.313764 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-h7rtc_2a7570ba-853a-45e0-adce-332fddd548b0/prometheus-operator-admission-webhook/0.log" Sep 17 18:26:56.504892 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.504859 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7488fb469c-dcvrl_5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd/thanos-query/0.log" Sep 17 18:26:56.549632 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.549599 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7488fb469c-dcvrl_5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd/kube-rbac-proxy-web/0.log" Sep 17 18:26:56.590055 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.590027 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7488fb469c-dcvrl_5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd/kube-rbac-proxy/0.log" Sep 17 18:26:56.629576 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.629545 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7488fb469c-dcvrl_5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd/prom-label-proxy/0.log" Sep 17 18:26:56.674128 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.674090 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7488fb469c-dcvrl_5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd/kube-rbac-proxy-rules/0.log" Sep 17 18:26:56.708024 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:56.707998 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7488fb469c-dcvrl_5b3d6e93-68b2-4e48-911d-2c2eaa6b12cd/kube-rbac-proxy-metrics/0.log" Sep 17 18:26:58.350346 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.350315 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/2.log" Sep 17 18:26:58.354397 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.354375 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-ldhm4_e6f99fb0-c136-483a-87c2-7dd429102383/console-operator/3.log" Sep 17 18:26:58.542337 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.542303 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45"] Sep 17 18:26:58.542711 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.542691 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerName="gather" Sep 17 18:26:58.542810 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.542713 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerName="gather" Sep 17 18:26:58.542810 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.542726 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerName="copy" Sep 17 18:26:58.542810 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.542736 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerName="copy" Sep 17 18:26:58.542903 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.542817 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerName="gather" Sep 17 18:26:58.542903 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.542833 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c07dad1-6a92-4f6b-ab86-a853a1e62b87" containerName="copy" Sep 17 18:26:58.546465 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.546447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.549365 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.549342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffk4x\"/\"kube-root-ca.crt\"" Sep 17 18:26:58.549474 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.549342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ffk4x\"/\"openshift-service-ca.crt\"" Sep 17 18:26:58.550572 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.550549 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ffk4x\"/\"default-dockercfg-lw4rk\"" Sep 17 18:26:58.557827 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.557801 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45"] Sep 17 18:26:58.700708 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.700678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-sys\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.700880 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.700712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-lib-modules\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.700880 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.700761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qm9\" (UniqueName: \"kubernetes.io/projected/f4affce4-368c-4d3f-bed0-be92022259b9-kube-api-access-g5qm9\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.700880 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.700866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-proc\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.700983 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.700906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-podres\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802170 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-proc\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802336 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-podres\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802336 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-sys\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802336 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-lib-modules\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802336 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qm9\" (UniqueName: \"kubernetes.io/projected/f4affce4-368c-4d3f-bed0-be92022259b9-kube-api-access-g5qm9\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802336 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802332 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-sys\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802523 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802366 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-proc\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802523 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802386 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-lib-modules\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.802523 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.802367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4affce4-368c-4d3f-bed0-be92022259b9-podres\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.817991 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.817967 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qm9\" (UniqueName: \"kubernetes.io/projected/f4affce4-368c-4d3f-bed0-be92022259b9-kube-api-access-g5qm9\") pod \"perf-node-gather-daemonset-4np45\" (UID: \"f4affce4-368c-4d3f-bed0-be92022259b9\") " pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:58.856572 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:58.856545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:59.128108 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:59.128082 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45"] Sep 17 18:26:59.130986 ip-10-0-139-254 kubenswrapper[2577]: W0917 18:26:59.130953 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf4affce4_368c_4d3f_bed0_be92022259b9.slice/crio-af00242cadb53ef7d3bf9dae2592b513a7e7df9620356b5950ec2d9b5c5133da WatchSource:0}: Error finding container af00242cadb53ef7d3bf9dae2592b513a7e7df9620356b5950ec2d9b5c5133da: Status 404 returned error can't find the container with id af00242cadb53ef7d3bf9dae2592b513a7e7df9620356b5950ec2d9b5c5133da Sep 17 18:26:59.971304 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:59.971267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" event={"ID":"f4affce4-368c-4d3f-bed0-be92022259b9","Type":"ContainerStarted","Data":"a150add5280b397c2766bc8b9f43bb9fd2035777c60d225efe6cf1f0f67518ee"} Sep 17 18:26:59.971708 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:59.971317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" event={"ID":"f4affce4-368c-4d3f-bed0-be92022259b9","Type":"ContainerStarted","Data":"af00242cadb53ef7d3bf9dae2592b513a7e7df9620356b5950ec2d9b5c5133da"} Sep 17 18:26:59.971708 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:59.971407 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:26:59.991589 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:26:59.991543 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" podStartSLOduration=1.99152831 podStartE2EDuration="1.99152831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:26:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:26:59.989758049 +0000 UTC m=+3166.466768219" watchObservedRunningTime="2026-09-17 18:26:59.99152831 +0000 UTC m=+3166.468538479" Sep 17 18:27:00.462526 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:00.462498 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kldhv_986d10f3-a483-409b-a4d0-436721350a4e/dns/0.log" Sep 17 18:27:00.488679 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:00.488640 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kldhv_986d10f3-a483-409b-a4d0-436721350a4e/kube-rbac-proxy/0.log" Sep 17 18:27:00.576158 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:00.576127 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8htvr_efda8b0b-921f-4643-9b36-bdf5f92b8e2e/dns-node-resolver/0.log" Sep 17 18:27:01.183926 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:01.183901 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r4w4q_167d5f18-0de8-4b9e-83dc-15ba015bbfa2/node-ca/0.log" Sep 17 18:27:02.346002 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:02.345969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ljqpn_0e128c41-0ce4-49a6-96d0-89f1e2586027/serve-healthcheck-canary/0.log" Sep 17 18:27:02.868549 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:02.868522 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8xww_25add384-5378-4300-be2c-220c3e7c587e/kube-rbac-proxy/0.log" Sep 17 18:27:02.898894 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:02.898870 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8xww_25add384-5378-4300-be2c-220c3e7c587e/exporter/0.log" Sep 17 18:27:02.925538 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:02.925514 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8xww_25add384-5378-4300-be2c-220c3e7c587e/extractor/0.log" Sep 17 18:27:05.875974 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:05.875940 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-mbnb4_f8d6df53-1df9-4152-95a2-d0c8fe1acd69/s3-init/0.log" Sep 17 18:27:05.899000 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:05.898975 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-mbnb4_f8d6df53-1df9-4152-95a2-d0c8fe1acd69/download-hf-model/0.log" Sep 17 18:27:05.983798 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:05.983771 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ffk4x/perf-node-gather-daemonset-4np45" Sep 17 18:27:10.704219 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:10.704188 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-s9gfj_5c60d7c3-1973-49e8-866e-a14ccbe0b6e1/migrator/0.log" Sep 17 18:27:10.730185 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:10.730160 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-s9gfj_5c60d7c3-1973-49e8-866e-a14ccbe0b6e1/graceful-termination/0.log" Sep 17 18:27:11.121928 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:11.121840 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-2bmct_5b5059fa-e6b0-4123-ac5e-4f135f51dd06/kube-storage-version-migrator-operator/1.log" Sep 17 18:27:11.123078 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:11.123031 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-2bmct_5b5059fa-e6b0-4123-ac5e-4f135f51dd06/kube-storage-version-migrator-operator/0.log" Sep 17 18:27:12.365188 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.365155 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk2qz_6b2dbe03-f597-453c-a050-2636af7d309e/kube-multus-additional-cni-plugins/0.log" Sep 17 18:27:12.400829 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.400799 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk2qz_6b2dbe03-f597-453c-a050-2636af7d309e/egress-router-binary-copy/0.log" Sep 17 18:27:12.435198 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.435166 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk2qz_6b2dbe03-f597-453c-a050-2636af7d309e/cni-plugins/0.log" Sep 17 18:27:12.482616 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.482595 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk2qz_6b2dbe03-f597-453c-a050-2636af7d309e/bond-cni-plugin/0.log" Sep 17 18:27:12.510868 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.510849 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk2qz_6b2dbe03-f597-453c-a050-2636af7d309e/routeoverride-cni/0.log" Sep 17 18:27:12.555730 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.555707 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk2qz_6b2dbe03-f597-453c-a050-2636af7d309e/whereabouts-cni-bincopy/0.log" Sep 17 18:27:12.602199 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.602177 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rk2qz_6b2dbe03-f597-453c-a050-2636af7d309e/whereabouts-cni/0.log" Sep 17 18:27:12.905470 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:12.905442 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h58h8_2d8aec86-cd5d-4d5f-9072-208f9b5b3755/kube-multus/0.log" Sep 17 18:27:13.146057 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:13.146030 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z6vms_c108c40b-fe8d-4a81-b08b-c926b0c103ed/network-metrics-daemon/0.log" Sep 17 18:27:13.171789 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:13.171769 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z6vms_c108c40b-fe8d-4a81-b08b-c926b0c103ed/kube-rbac-proxy/0.log" Sep 17 18:27:13.974770 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:13.974736 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-controller/0.log" Sep 17 18:27:13.998947 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:13.998915 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/1.log" Sep 17 18:27:13.999115 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:13.998962 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovn-acl-logging/0.log" Sep 17 18:27:14.022336 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:14.022301 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/kube-rbac-proxy-node/0.log" Sep 17 18:27:14.051536 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:14.051515 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 18:27:14.081252 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:14.081230 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/northd/0.log" Sep 17 18:27:14.108224 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:14.108200 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/nbdb/0.log" Sep 17 18:27:14.142610 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:14.142577 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/sbdb/0.log" Sep 17 18:27:14.190063 ip-10-0-139-254 kubenswrapper[2577]: I0917 18:27:14.190035 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9zjm4_c9c20e22-1c65-4c08-8086-ee74eb387729/ovnkube-controller/0.log"